π Competition Rules
Welcome to the Embodied Agent Interface Challenge @ NeurIPS 2025!
To ensure fairness, transparency, and reproducibility, all participants must adhere to the following rules.
β Eligibility
- Open to all individuals and teams worldwide β including students, academics, and industry practitioners.
- No restrictions based on geography or affiliation.
- Multiple teams from the same institution are allowed but must submit independent entries.
π₯ Team Participation
- Participants can join individually or as part of a team.
- Each team must designate a primary contact for communications.
- Teams may participate in one or more of the four modules:
- Goal Interpretation
- Subgoal Decomposition
- Action Sequencing
- Transition Modeling
π¦ Submission Formats
You may submit:
- Prediction files (e.g., generated LTL goals, action plans, etc.)
- Docker containers that accept inputs and generate outputs in the specified format
All interfaces and submission formats are detailed in the starter kit.
π Submission Limits
- A maximum of 3 submissions per team per day during the development phase
- This limit helps avoid leaderboard overfitting and ensures fair resource usage
π Final Evaluation Phase
- The final leaderboard will be based on performance on a hidden test set
- Only Docker-based submissions are accepted in the final phase
- No manual tuning, hard-coding, or test set engineering allowed
π Reproducibility
To qualify for final ranking and awards:
- Submissions must include all code, dependencies, and setup files
- Top teamsβ submissions will be re-executed by organizers to verify results
- Models must be fully automated and deterministic
π Use of External Resources
- You may use external datasets or models if:
- They were publicly available before the competition launch
- They are clearly cited in your final write-up
π« Disallowed Practices
Violations will result in disqualification. These include:
- Using manually labeled outputs on test sets
- Hard-coding answers or exploiting leaderboard feedback
- Leaking or reverse-engineering the hidden test set
- Submitting outputs that do not generalize to new inputs
βοΈ Ethics & Conduct
All participants must follow the NeurIPS Code of Ethics, including principles of:
- Fairness
- Transparency
- Safety
- Responsible AI development
π§© Partial Participation Welcome
- You do not need to submit to all modules to participate
- Partial submissions are valid and encouraged
π’ Communication & Updates
Official announcements will be made via:
- π¬ Email list (make sure your registration email is up-to-date)
- π GitHub Issues for clarifications and bug reports
- π¬ Community forum or Discord for discussion and Q&A
Any rule updates will be posted with at least 72 hoursβ notice before taking effect.
Thank you for joining us in building the future of intelligent, interpretable embodied agents. Letβs benchmark brilliance β together!