Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

generate_trajectories getting stuck #120

Closed
RishiHazra opened this issue Aug 6, 2022 · 11 comments
Closed

generate_trajectories getting stuck #120

RishiHazra opened this issue Aug 6, 2022 · 11 comments

Comments

@RishiHazra
Copy link

RishiHazra commented Aug 6, 2022 •
edited
Loading

Hi @MohitShridhar

I'm trying to generate new trajectories. However, the generation always gets stuck after resetting the environment: Here is output when I run it:

Force Unsave Data: False
Loaded 0 known failed tuples
Found path: ...
Mono path[0] = ...
Mono config path = ...
Preloaded 'ScreenSelector.so'
Display 0 '0': 1920x1200 (primary device).
Logging to ...
ThorEnv started.
###################################

Successes: 
Empty DataFrame
Columns: [goal, pickup, movable, receptacle, scene]
Index: []

##################################
('pick_and_place_with_movable_recep', 'Fork', 'Cup', 'DiningTable', 17)
sampled tuple: ('pick_and_place_with_movable_recep', 'Fork', 'Cup', 'DiningTable', 17)
PDDLGoalType: pick_and_place_with_movable_recep
Saving images to: dataset/new_trajectories/pick_and_place_with_movable_recep-Fork-Cup-DiningTable-17/trial_T20220806_035502_492636/raw_images/
Resetting ThorEnv

I have installed the exact version of AI2Thor as mentioned in the requirements.txt file. After debugging for a while, I was able to narrow it down to

alfred/env/thor_env.py

Line 66 in 1898b83

event = super().step(dict(

However, I'm unable to debug it. Would appreciate some help here.

Thanks in advance !!!
@askforalfred
Copy link
Owner

askforalfred commented Aug 6, 2022 via email

@RishiHazra
Copy link
Author 

Fallback handler could not load library /home/rishihazra/.ai2thor/releases/thor-Linux64-bdcefe04c17bef073ecfe3d90786e84740f7addf/thor-Linux64-bdcefe04c17bef073ecfe3d90786e84740f7addf_Data/Mono/libadvapi32.dll.so
Fallback handler could not load library /home/rishihazra/.ai2thor/releases/thor-Linux64-bdcefe04c17bef073ecfe3d90786e84740f7addf/thor-Linux64-bdcefe04c17bef073ecfe3d90786e84740f7addf_Data/Mono/libadvapi32.dll

@askforalfred
Copy link
Owner

askforalfred commented Aug 6, 2022 via email

@RishiHazra
Copy link
Author

I suspected that. Not sure why though. Anyways, appreciate the quick response. Thanks!

@jeje910 jeje910 mentioned this issue Aug 15, 2022
Closed
@YaqiXie
Copy link

YaqiXie commented Jan 7, 2023

@RishiHazra Did you solve the problem? I got the same issue Orz

@RishiHazra
Copy link
Author

RishiHazra commented Jan 7, 2023 •
edited
Loading

@RishiHazra Did you solve the problem? I got the same issue Orz

@YaqiXie Hi, the problem was mainly because of the torch module. You could try two things: The AI2Thor recommended version + older version of torch (alexpashevich/E.T.#8) or upgrading the AI2Thor package + newer torch version

@YaqiXie
Copy link

YaqiXie commented Jan 7, 2023

@RishiHazra I tried to use the recommended version torch 1.1.0 and torchvision 0.3.0. But it still doesn't work. And even tried a virtual env without torch at all. But I still run into the same issue Orz No idea why.

@RishiHazra
Copy link
Author

RishiHazra commented Jan 7, 2023 •
edited
Loading

@RishiHazra I tried to use the recommended version torch 1.1.0 and torchvision 0.3.0. But it still doesn't work. And even tried a virtual env without torch at all. But I still run into the same issue Orz No idea why.

@YaqiXie: In my case, I had to upgrade the AI2Thor version (ai2thor~=4.2.0) to be compatible with my torch version (torch==1.11.0+cu113 torchvision==0.12.0+cu113 torchaudio==0.11.0). This could depend on your system configuration -- however, I have been able to make it work on different systems without any issues. Note that you might have to make slight changes in the ALFRED code too since it is based on an older version of AI2Thor (2.1.0). I'd be happy to help with that.

Also, see if you can find something useful in another similar issue (alexpashevich/E.T.#8) if you want to keep using the recommended version.

@YaqiXie
Copy link

YaqiXie commented Jan 8, 2023

@RishiHazra Hi Rishi, Yep, a later version of AI2THOR works for me. How did you modify the ALFRED code? The action API seems different. Thank you a lot for the help!

@RishiHazra
Copy link
Author

RishiHazra commented Jan 8, 2023 •
edited
Loading

@RishiHazra Hi Rishi, Yep, a later version of AI2THOR works for me. How did you modify the ALFRED code? The action API seems different. Thank you a lot for the help!

@YaqiXie Hi Yaqi, while I'm unable to share my current code here, I can give you some pointers to help modify the code. Most of the modifications that I made were taken from this repository (https://github.com/jiasenlu/alfred) which is modified to be compatible with AI2THOR 2.5.1. If I remember correctly, these modifications worked even for AI2THOR 4.2.0. There were additional minor changes that I had to make in the object poses (see this). I'd also recommend you look into the AI2THOR documentation of actions to get a clear understanding of what you might need. Feel free to reach out at (rishi.hazra@oru.se) in case you run into issues.

@YaqiXie
Copy link

YaqiXie commented Jan 8, 2023

@RishiHazra Hi Rishi, Thank you very much :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@YaqiXie @RishiHazra @askforalfred