EgoNormia
Can VLMs make normative decisions in physical social interactions?
Input Modality Types:
- Blind: Models receive only the questions with no visual input
- Pipeline: Models receive text-only descriptions of the scene (generated by Gemini 1.5 Flash)
- Video: Models receive both video input (1 fps, concatenated into a single image) and questions
Model | Modality | Both | Act | Jus | Sen | Date |
|---|---|---|---|---|---|---|
H Human | Video | 92.4 | 92.4 | 92.4 | 85.1 | 2025-02-15 |
  | Video | 53.7 | 58.9 | 56.8 | 56.7 | 2025-04-27 |
  | Video | 50.0 | 60.2 | 52.3 | 52.8 | 2025-04-27 |
| Video | 49.8 | 55.5 | 52.6 | 55.2 | 2025-04-27 |
| Video | 47.2 | 52.0 | 48.4 | 47.1 | 2025-04-27 |
| Video | 45.3 | 51.9 | 47.8 | 61.1 | 2025-02-15 |
| Video | 42.7 | 51.7 | 45.3 | 57.3 | 2025-02-15 |
| Video | 41.7 | 46.5 | 44.3 | 54.4 | 2025-02-15 |
| Pipeline | 41.5 | 45.7 | 45.2 | 65.0 | 2025-02-15 |
  | Video | 41.5 | 48.3 | 43.8 | 62.8 | 2025-02-15 |
| Video | 39.8 | 45.1 | 44.8 | 59.6 | 2025-02-15 |
| Video | 38.9 | 49.6 | 41.3 | 60.0 | 2025-02-15 |
| Video | 37.8 | 46.7 | 42.2 | 44.6 | 2025-04-27 |
| Pipeline | 37.5 | 46.3 | 42.1 | 58.8 | 2025-02-15 |
  | Pipeline | 36.5 | 42.9 | 40.0 | 61.0 | 2025-02-15 |
  | Video | 36.0 | 43.5 | 41.0 | 59.3 | 2025-02-15 |
S InternVL 2.5 | Pipeline | 32.7 | 40.9 | 38.0 | 62.5 | 2025-02-15 |
| Pipeline | 30.7 | 37.3 | 34.8 | 64.0 | 2025-02-15 |
R Constant Choice | Blind | 25.3 | 25.3 | 25.3 | 40.5 | 2025-02-15 |
| Pipeline | 23.9 | 36.7 | 33.5 | 61.2 | 2025-02-15 |
| Blind | 21.2 | 24.6 | 23.6 | 54.0 | 2025-02-15 |
| Pipeline | 21.0 | 23.7 | 23.5 | 66.0 | 2025-02-15 |
| Blind | 17.7 | 19.9 | 19.9 | 55.9 | 2025-02-15 |
| Blind | 16.1 | 19.4 | 17.1 | 27.3 | 2025-02-15 |
S InternVL 2.5 | Blind | 15.3 | 18.3 | 17.4 | 55.4 | 2025-02-15 |
S InternVL 2.5 | Video | 15.1 | 18.7 | 17.6 | 50.7 | 2025-02-15 |
| Blind | 15.0 | 16.8 | 17.1 | 51.9 | 2025-02-15 |
| Pipeline | 14.7 | 17.7 | 16.7 | 54.2 | 2025-02-15 |
| Blind | 12.2 | 15.0 | 14.1 | 46.6 | 2025-02-15 |
  | Video | 2.2 | 19.9 | 10.1 | 54.7 | 2025-02-15 |