Add the the Fine-Grained Visual Categorization IMET 2020 dataset

[mikayelh]

Describe the dataset

Add IMET 2020 FGVC7 dataset to Hub. So this would work.

import hub
ds = hub.load("username/imet-2020-fgvc7")

Steps

1. Please take a look at the docs on uploading datasets.

2. Uploading script should be added to examples folder

Example

You can find an example of large dataset loading and upload here:

• https://github.com/activeloopai/Hub/blob/master/examples/coco/upload_coco2017.py

[harshitsankhla]

Hi @mikayelh , please assign me to this ! Thanks :)

[mikayelh]

Hi @harshitsankhla Thank you so much for your willingness to contribute! Let me know if you have any questions, and please star our package while you're at it.

[mikayelh]

Hi, @harshitsankhla! Hope this finds you well. Dropping a note to check in on you an ask if you need a hand with uploading the dataset. Feel free to ask us in the GitHub Discussions (we have beta access!) or our dedicated Slack channel. Thanks a mil!

[harshitsankhla]

@mikayelh I'll have a go later in the day. If I find any problems will ping you here or on slack.

[mikayelh]

hi @harshitsankhla! Thanks a lot, let me know if you any further questions! :)

[AbhinavTuli]

@harshitsankhla Here's a tutorial for uploading datasets using Hub that might be helpful for you!

[harshitsankhla]

@mikayelh @AbhinavTuli I've tried downloading the dataset a couple of times, unsuccessfully. The connection to the host server doesn't seem all good. Do you have any alternative locations for this ?

[mikayelh]

Hi @harshitsankhla - I'm currently looking for other sources and will update you in about two hours. It doesn't look like they've published the dataset anywhere else. I'll let you know - if we don't manage to find an alternative source, you can pick another dataset!

[mikayelh]

Hey @harshitsankhla , what browser are you using for the download? I've just managed to download the entire dataset via Chrome (it allows you to resume the download if something fails). I would be happy to re-upload it, but it's going to take about 10 hours on my internet connection. Can you please give it a try via Chrome and let me know if it works?

[harshitsankhla]

I was using safari and the kaggle api. I'll try with chrome now.

[mikayelh]

In any case, I've already kickstarted the upload for you to our Google Drive, but it will take quite some time - just let me know how it goes! :)

[davidbuniat]

@harshitsankhla happy to provide access to an AWS instance for you to download the data and do the processing. Feel free to join our slack channel and claim one

[mikayelh]

Hey, @harshitsankhla - I've uploaded the dataset for you to access to our google drive. Let me know if this works for you.

[harshitsankhla]

Hey, @harshitsankhla - I've uploaded the dataset for you to access to our google drive. Let me know if this works for you.

Are you sure this is the right file ? Its just a 1MB CSV, I thought the dataset is 23GBs

[mikayelh]

Oops, apologies! I've updated the link. If this doesn't work for you, you can go ahead and pick another dataset!

[mikayelh]

Hey @harshitsankhla dropping a note to see if you're still interested in contributing! I would also love to invite you to the launch event of Hub v1.0, DM me here or in our slack community if interested!

[harshitsankhla]

Hi @mikayelh will finish this week

[mikayelh]

Supercool, @harshitsankhla, thanks!

[mynameisvinn]

Closing this feature request due to inactivity and lack of interest. Will revive it if more users request it.