Frequently Asked Questions
This page groups common questions about participation, evaluation, system papers, review expectations, and support for ImageEval 2026.
Participation
Who can participate in ImageEval 2026?
Anyone can participate, either independently or as part of a team.
Is there a fee to participate?
Participation in the shared task is free. At least one team member should register for the conference if the paper is accepted and presented.
How can I sign up?
Sign up on the relevant Codabench competition and get the data from the Hugging Face dataset. Join our Slack channel for announcements, deadlines, and task-specific updates.
Can I participate in multiple ImageEval tasks?
Yes. Teams may participate in Task 1, Task 2, or both.
Can I participate in multiple teams for the same task?
This depends on the task policy. If this is relevant to your team, contact the organizers before submitting runs.
Which models and methods can I use?
For Task 1, any model and any pipeline are welcome, cascaded or end to end, and both open and closed models are allowed (we especially encourage open models for reproducibility and low-resource settings). Please take part in good faith: run each track in its own language from end to end rather than reusing another track’s predictions. See the Task 1 page for the full participation notes.
Evaluation and Data
What does the evaluation period mean?
The evaluation period is the official competition window. Organizers release evaluation data at the beginning of this period, and system outputs are due before the deadline.
How many runs can a team submit?
Submission limits are task-specific. Check the task page and platform instructions for the final limits.
Where can I find the datasets?
Task datasets are distributed by the task organizers. Check the task pages and official announcements for release details.
Paper Requirements
Do I need to write a system paper?
Yes. Teams that participate and request task data are expected to submit a system description paper.
What happens if a participating team does not submit a paper?
Requesting the data commits the team to submitting a paper. Abandoning the task after receiving data may affect future participation.
What is the paper format?
System papers should follow the ArabicNLP 2026 short-paper format. Papers must use the official EMNLP/ACL LaTeX or Word templates and may be up to 4 pages, excluding unlimited references. Templates are available from acl-org/acl-style-files.
How should the paper title be formatted?
Use this format:
<Team Name> at <Task Name>: <Your Contribution>
Example:
Scholarly at ImageEval Shared Task: LLMs for Arabic Visual Question Answering
Must I cite the task overview paper?
Yes. Each team is required to cite the shared task overview paper in its system paper.
What happens if I exceed the page limit?
Submissions that exceed length requirements may be desk rejected.
Review and Publication
Are papers anonymous?
No. Shared task papers, including system papers and overview papers, are not anonymous.
Do I need an OpenReview account?
Yes. Participants and organizers are required to create an OpenReview account.
Will I need to review other papers?
Yes. Shared task teams are expected to serve as reviewers, and reviews will be checked by a member of the organizing team.
Must accepted papers be presented at the conference?
Yes. Accepted papers must be presented at the conference, either in person or virtually. Papers without at least one presenting author registered by the required deadline may be rejected.
Can I post my paper on arXiv?
Yes. Authors may submit papers to arXiv at any time. Since shared task papers are not anonymous, this does not interfere with the review process.
Can I make changes for the camera-ready version?
No additions, revisions, or name changes are allowed after the review period for the camera-ready version unless explicitly permitted by the organizers.
Support
What if my research raises ethical concerns?
Discuss ethical considerations, including potential misuse, clearly in the system paper.
Should I release my code?
Code and data release is highly encouraged. Include the URL in the system paper when possible to support reproducibility.
My question is not answered here. Who should I contact?
- For task-specific questions, consult the task page and contact the task organizers.
- For workshop logistics, contact the shared task organizers.
- For OpenReview technical issues, contact OpenReview support.