๐Ÿ‘€ The official leaderboard is released! View results โ†’ ๐Ÿ“ System description form due Aug 15
ImageEval 2026

Cultural Grounding in Arabic Multimodal Generation and Understanding

Leaderboard

Final test-phase standings. Each team is ranked by its best valid submission, and every score was independently re-checked with the official scorers before release.

#TeamAccuracy โ†‘Balanced AccMacro-F1
1am24012950.96200.93320.9081
2NYUAD0.96100.91930.8718
3CUET_InferX0.91200.87720.8050
#TeamAccuracy โ†‘Balanced AccMacro-F1
1NYUAD0.87500.77990.7265
2am24012950.83400.72110.6856
3Digilians0.65600.57450.5044
#TeamContrastive Instability โ†“Combined AccCFHRQ+ AccQโˆ’ Acc
1miles_ma0.02900.97100.00000.97100.9855
2myamin660.03300.96700.00000.96700.9835
3mohaiminulhoque0.03500.96500.00000.96500.9825
4NYUAD0.04100.95900.00000.95900.9795
5hasankh0.05100.94900.00000.94900.9745
6sumaiya_1100.05800.94200.00000.94200.9710
7md_faisal0.06700.93300.00000.93300.9665
8keslerady0.11300.88700.00000.88700.9435

filtered: keslerady ยท run 876194 ยท no overlapping ids

#TeamContrastive Instability โ†“Combined AccCFHRQ+ AccQโˆ’ Acc
1ahmedbakr0.03600.96400.00000.96400.9820
2NYUAD0.04700.95300.00000.95300.9765
3myamin660.05600.94400.00000.94400.9720
4hasankh0.09600.90400.00000.90400.9520
5md_faisal0.10100.89900.00000.89900.9495
6keslerady0.14200.85800.00000.85800.9290

filtered: ahmedbakr ยท run 883723 ยท no overlapping ids

#TeamSpearman (composite) โ†‘MAE (composite)
1md_faisal0.82580.1469
2nannies0.80780.1512
322311717360.80400.1415
4ahmedbakr0.78060.1452
5am24012950.67340.2032

Test phase closed 10 August 2026, 12:00 UTC (August 9, AoE).

Standings from the development phase, scored on the devtest split. These were interim results; the test phase is the official ranking.

#TeamAccuracy โ†‘Balanced AccMacro-F1
1NYUAD0.97400.97430.9740
2NYUAD0.97400.97430.9740
3romey1010.97200.97180.9717
4CUET_InferX0.91600.91600.9157
โ€“hunzed baseline0.66400.66580.6614
#TeamAccuracy โ†‘Balanced AccMacro-F1
1NYUAD0.92000.91880.9211
2NYUAD0.92000.91880.9211
3Digilians0.78400.77990.7823
โ€“hunzed baseline0.39800.41010.3444
4md_faisal0.39800.41010.3444
#TeamContrastive Instability โ†“Combined AccCFHRQ+ AccQโˆ’ Acc
1mohaiminulhoque0.02800.97200.00000.97200.9860
2NYUAD0.02800.97200.00000.97200.9860
3miles_ma0.03000.97000.00000.97000.9850
4nawwad0.03600.96400.00000.96400.9820
5Nile Nexus0.05000.95000.00000.95000.9750
6ameya0.28400.71600.00000.71600.8580
โ€“hunzed baseline0.31330.68400.27230.94000.8390
7md_faisal0.31330.68400.27230.94000.8390

filtered: NAMAA Community ยท run 875076 ยท no overlapping ids

#TeamContrastive Instability โ†“Combined AccCFHRQ+ AccQโˆ’ Acc
1NYUAD0.03600.96400.00000.96400.9820
2NAMAA Community0.04600.95400.00000.95400.9770
3lettycat0.08200.91800.00000.91800.9590
โ€“hunzed baseline0.49000.50800.39090.83400.7730
4md_faisal0.49000.50800.39090.83400.7730
#TeamSpearman (composite) โ†‘MAE (composite)
1ahmedbakr0.70760.1876
2md_faisal0.64130.2036

Final development-phase snapshot, taken 3 August 2026, 10:55 UTC.