Train and test in ALFRED

[anikem]

No description provided.

[kolbytn]

Is there a projected date for Alfred support in AllenAct? I'm interested in using AllenAct with the Alfred and Vision and Language Navigation tasks. I noticed that both Alfred and VLN are listed as supported in your paper.

From what I can tell this will involve adding new sensors, tasks, and task samplers to the iTHOR and Habitat plugins. Is this correct?

I want to get an idea of what this will involve and what your timeline is before I consider using AllenAct for my project or implementing support for these tasks myself. Thank you!

[Lucaweihs]

Hi @kolbytn,

We have an implementation ALFRED in AllenAct but have been holding off on making it public until it was a little more user friendly. I believe it is very near release but I'll let @jiasenlu answer with respect to exact timelines as he's been working very closely with the current implementation.

One thing I can say for certain: the whole team is working on various projects for the CVPR deadline this coming Monday so the release would definitely not be before then ;)

From what I can tell this will involve adding new sensors, tasks, and task samplers to the iTHOR and Habitat plugins. Is this correct?

Yes that's correct. I'm happy to have a chat at some point if you'd like to get a sense of what this would entail and how much work it would be, generally this just requires redirecting data from the simulator to the right locations in AllenAct. In any case please do reach out with questions or pain points as we're always looking for feedback from new users (this is the hardest feedback to generate ourselves!).

[jiasenlu]

Hi @kolbytn

I am working on integrating interaction tasks in Allenact (Alfred like tasks but not Alfred dataset). For Alfred, we can not directly port the dataset into Allenact is because Alfred collects the dataset based on a very old AI2thor version (2.1.0), and the currently supported version is 2.4.0. There is a room layout, object change between these two versions, so we can not recover the object location for Alfred's dataset anymore. As I am still working on these features, I think we can probably release this support in 1 month.

[kolbytn]

Thanks for the response! @jiasenlu any update on interaction tasks?