Skip to content

2023 Challenge

Latest
Compare
Choose a tag to compare
@Lucaweihs Lucaweihs released this 19 Apr 00:04
· 5 commits to main since this release
2203acf

Our 2023 AI2-THOR Rearrangement Challenge has several upgrades distinguishing it from the 2022 version:

  1. New AI2-THOR version. We've upgraded the version of AI2-THOR we're using from 5.0.0, this brings performance improvements and bug fixes.
  2. New dataset. We've released a new rearrangement dataset to match the new AI2-THOR version. This new dataset has a more uniform balance of easy/hard episodes and requires interaction with more objects.
  3. Improved object-opening logic. In previous versions of the rearrangement challenge there was no downside to attempting to open all objects that the agent came across as the open action would only execute when opening an object that was in a state different from that during walkthrough phase. In this version of the challenge, all openable objects have open and closed states that are toggled when agent issues the open action upon them.
  4. Misc. improvements. We've fixed a number of minor bugs and performance issues from the 2022 challenge improving consistency.