-
Notifications
You must be signed in to change notification settings - Fork 599
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MPII Human Pose Dataset #106
Comments
@kristinagrig06 I would like to work on this issue, please assign me. |
Hi @sanchitvj ! Assigned you to this issue. Thanks for your willingness to contribute! Let me know if you have any questions! :) |
Hi, @sanchitvj ! Hope this finds you well. Dropping a note to check in on you an ask if you need a hand with uploading the dataset. Feel free to ask us in the GitHub Discussions (we have beta access!) or our dedicated Slack channel. Thanks a mil! |
Yes I'm working on it.
…On Wed, Oct 21, 2020, 11:20 AM mikayelh ***@***.*** wrote:
Hi, @sanchitvj <https://github.com/sanchitvj> ! Hope this finds you well.
Dropping a note to check in on you an ask if you need a hand with uploading
the dataset. Feel free to ask us in the GitHub Discussions
<https://github.com/activeloopai/Hub/discussions> (we have beta access!)
or our dedicated Slack channel
<https://join.slack.com/share/zt-ihfwn0s4-4dmI6BzPq6tqvVdEWq9kIg>. Thanks
a mil!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#106 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ANCEKBOUEUILZJUK2XY5PSDSLZZBVANCNFSM4SVU5C6A>
.
|
That's great @sanchitvj. Here's a tutorial for uploading datasets using Hub that might be helpful for you! |
I've one query, do I need to know the codebase of hub. |
@sanchitvj No, it's not required but feel free to take a look if you ever want to understand how something is working under the hood! |
@AbhinavTuli is there any example available on how to use the hub for loading dataset, visualize data(like what is present in the data), and training(using TensorFlow). The dataset I'm working on is challenging to use, process, and train. |
@sanchitvj did you take a look at the tutorial mentioned above? It has links to a couple of examples that would be helpful. |
@AbhinavTuli Can I know what CocoGenerator class is doing? I'm facing difficulties understanding that. How the output of that class looks like. And in the COCO upload example, it's not clear because I can't see what are the outputs. I've done most of the part just want to deal with this issue of the generator. COCO upload example isn't much useful because mpii annotations is not the same as COCO. So can you guide me on how to write a generator function for this purpose and what all code files from the hub collections should I understand to get the basic idea to come over this issue? |
@sanchitvj sorry for getting back to you so late, somehow missed this. |
@AbhinavTuli I'm almost done. But how can I see that output is as expected? Here is my code. When I'm trying to print, this: '<hub.collections.dataset.core.Dataset object at 0x7f55ae0aac50>' is the output. So how can I check it's working correctly? |
Hey @sanchitvj, you can test out the code by using ds.store("./mpii"), this will store the dataset locally instead of uploading it to hub and should be much faster. import hub
ds = hub.load("./mpii")
for item in ds:
print(item["data"].compute())
print(item["labels"].compute()) Just replace the keys ("data" and "labels") with your actual ones. Let me know how it goes! |
@AbhinavTuli This is the error coming after I'm doing ds.store(). Can you help me with it? `0 kwargs: {} |
I would probably need to look at the code to help you out but seems like an issue in implementing the call function |
@AbhinavTuli Here is the code. And how much time do you think it will take to store this 13 GB data. |
@AbhinavTuli @kristinagrig06 @davidbuniat dataset is uploaded, It's visible on the app and I've loaded it and used it. Working fine, so can I send the PR now with an example code. |
@AbhinavTuli I've sent PR but one of the checks is failing, can you help me understand it. |
@sanchitvj there is a linting error with Black, if you can fix it then happy to merge! thanks for making the dataset! |
@davidbuniat All build checks passed. |
@sanchitvj awesome! once we check the dataset is working will merge the PR! Thanks for the awesome job! |
Describe the dataset
Add MPII Human Pose Dataset dataset to Hub. So this would work.
Steps
Please take a look at the docs on uploading datasets.
Uploading script should be added to examples folder
Example
You can find an example of large dataset loading and upload here:
The text was updated successfully, but these errors were encountered: