Skip to content

Latest commit

 

History

History
77 lines (43 loc) · 3.36 KB

faq.rst

File metadata and controls

77 lines (43 loc) · 3.36 KB

FAQ

How do I add a new loader?

Take a look at our contributing docs!

How do I get access to a dataset if the download function says it’s not available?

We don't distribute data ourselves, so unfortunately it is up to you to find the data yourself. We strongly encourage you to favor datasets which are currently available.

Can you send me the data for a dataset which is not available?

Sorry, we do not host or distribute datasets.

What is the canonical version of a loader?

The canonical version of a loader is the source version of a dataset, i.e. the version that you get directly from the creators of the dataset or similar oficial source.

How do I request a new dataset?

Open an issue and tag it with the "New Loader" label.

What do I do if my data fails validation?

Very often, data fails vaildation because of how the files are named or how the folder is structured. If this is the case, try renaming/reorganizing your data to match what soundata expects. If your data fails validation because of the checksums, this means that you are using data which is different from what most people are using, and you should try to get the more common dataset version, for example by using the data loader's download function.

How do you choose the data that is used to create the checksums?

Whenever possible, the data downloaded using .download() is the same data used to create the checksums. If this isn't possible, we did our best to get the data from the original source (the dataset creator) in order to create the checksum. If this is again not possible, we found as many versions of the data as we could from different users of the dataset, computed checksums on all of them and used the version which was the most common amongst them.

Does soundata provide data loaders for pytorch/Tensorflow?

Not yet, but we plan to include this functionality soon. For now, check the examples of Tensorflow generators in tutorial

A download link is broken for a loader's .download() function. What do I do?

Please open an issue and tag it with the "broken link" label.

Why the name, soundata?

soundata = sound + data, and the library was built for working with audio data.

If I find a mistake in an annotation, should I fix it in the loader?

Please do not. All datasets have "mistakes", and we do not want to create another version of each dataset ourselves. The loaders should load the data as released. After that, it's up to the user what they want to do with it. If you are in doubt, open an issue and discuss it with the community.

Does soundata support data which lives off-disk?

Yes. While the simple useage of soundata assumes that data lives on-disk, it can be used for off-disk data as well. See Remote Data Example for details.