Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about i3d #18

Closed
aoteman233 opened this issue Apr 7, 2022 · 4 comments
Closed

about i3d #18

aoteman233 opened this issue Apr 7, 2022 · 4 comments

Comments

@aoteman233
Copy link

Hi @PaulAdamastor,
Thank you for your interest in our work.

I'm not getting this error when I run the code of both models. Are you using the latest annotations and data loading functions (pie_data.py and jaad_data.py)?

To use I3D with the optical flow you can modify the C3D config as follows: change the model to I3D and obs_input_type to [local_context_flow]. Any type with visual features should work if you append _flow to it.
However, the code expects the optical flow to be precomputed. We used FlowNet2.

Originally posted by @ykotseruba in #12 (comment)

@aoteman233 aoteman233 changed the title Hi @PaulAdamastor, about i3d Apr 7, 2022
@aoteman233 aoteman233 reopened this Apr 12, 2022
@aoteman233
Copy link
Author

Thank you for your excellent work!
When I run the code I have two problems:
1.Did you get the following error when you used flownet2 to generate optical flow?How did you solve this problem?
NameError: name 'validation_loader' is not defined
2.How much storage space is required for the final generated optical flow file?
Looking forward to your reply

@ykotseruba
Copy link
Owner

  1. I ran this code a while ago and did not have any issues. Perhaps it is better to ask the maintainers of flownet2.
  2. I don't have the exact number, but I recommend computing the optical flow only for the observed frames, not for the entire dataset. Once you extracted the data for training and testing you can save the frame ids and compute the optical flow only for those.

@aoteman233
Copy link
Author

Thank you very much for your reply!
unfortunately I didn't see your reply until after generating all the optical flow files, it took me a lot of time, obviously I'm a noob. I will try to do as you say。
thanks again for your reply!

@aoteman233
Copy link
Author

excuse me,I have successfully completed the training these days, but I can't find a way to extract the frame id. There are 267 subfolders in the folder data\features\jaad\local_context_c3d_raw_1.5\images, are the frames in these folders the ones that need to generate optical flow files?if not,Would you mind providing a solution?extremely grateful!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants