Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Process data after manually downloaded #9

Closed
amjltc295 opened this issue Apr 5, 2019 · 1 comment
Closed

Process data after manually downloaded #9

amjltc295 opened this issue Apr 5, 2019 · 1 comment

Comments

@amjltc295
Copy link

amjltc295 commented Apr 5, 2019

I already download the data with the scripts in https://github.com/epic-kitchens/download-scripts
However, I could not find how to extra these .tars and make them gulp dataset that could be read by the epic-kitchens lib.

I've tried to read the Snakemake file, yet the download speed is a bit slow.
How could I use snakemake to create the same results as snakemake -p gulp_all with downloaded .tars? The downloaded files are int /tmp/epic_kitchen and I've changed the tmp dir in config.yaml

@willprice
Copy link
Member

Hi there,
If you've downloaded the RGB and flow tars, you should be able to put them in the location snakemake is expecting them to be present (data/raw/$modality/$participant/$participant_video.tar, e.g. data/raw/rgb/P01/P01_01.tar), you might in addition have to 'touch' them so snakemake registers their existance:

# For both RGB and flow frames
$ snakemake -t download_all_frames

# Or for just RGB
$ snakemake -t download_all_rgb_frames

# Or for just flow
$ snakemake -t download_all_flow_frames

(see https://bitbucket.org/snakemake/snakemake/src/e049f5e49635ff9c56544a7b1efb5e1a193e1530/snakemake/__init__.py?at=master&fileviewer=file-view-default#__init__.py-776) or snakemake --help

Once you've done that you should be able to go ahead and run snakemake -p gulp_all

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants