ImageEval 2026

Cultural Grounding in Arabic Multimodal Generation and Understanding

Welcome to ImageEval 2026

ImageEval 2026: Cultural Grounding in Arabic Multimodal Generation and Understanding is a shared task on culturally grounded Arabic multimodal AI. The task suite evaluates visual question answering, image-grounded hallucination detection, and cultural accuracy evaluation for text-to-image generation.

The shared task focuses on Arabic language varieties and culturally specific visual content from the MENA region, with dedicated tracks for participants to build, evaluate, and compare multimodal systems.

Tasks

  • Task 1: - Culturally Grounded Arabic Visual Question Answering and Hallucination Detection.
  • Task 2: CRAI-Bench - Cultural Accuracy Evaluation for Text-to-Image Generation.

Recent Updates

  • May 22, 2026: Task website, training/development data, and evaluation scripts released.
  • Registration is open: Teams can register until July 20, 2026 using the registration form.
  • Submission guidelines: Paper and submission guidance is available for participating teams.

Important Dates

  • May 22, 2026: Release of task website, training/dev data, and evaluation scripts
  • July 20, 2026: Registration deadline and release of blind test data
  • July 30, 2026: Final results announcement
  • August 15, 2026: Shared task system paper submission due
  • August 25, 2026: Notification of acceptance
  • September 5, 2026: Camera-ready version due
  • October 24-29, 2026: ArabicNLP main conference

Contact

For questions related to ImageEval 2026, contact the organizers at imageeval2026@gmail.com.

Organizers