Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation: Updating tutorials to use TensorFlow Datasets (TFDS). #25364

Closed
dynamicwebpaige opened this issue Jan 31, 2019 · 4 comments
Closed
Assignees
Labels
comp:data tf.data related issues TF 2.0 Issues relating to TensorFlow 2.0 type:docs-bug Document issues

Comments

@dynamicwebpaige
Copy link
Contributor

TensorFlow Datasets (TFDS) is a collection of datasets ready-to-use with TensorFlow. Each dataset is defined as a tfds.core.DatasetBuilder, which encapsulates the logic to download the dataset and construct an input pipeline, as well as contains the dataset documentation (version, splits, number of examples, etc.).

The purpose of this issue is to migrate all tutorials to use TensorFlow Datasets, and to be compliant with the TF 2.0 API. Each migrated tutorial must be eager and distribution compatible, with tests, and all associated engineering artifacts.

@dynamicwebpaige dynamicwebpaige added type:docs-bug Document issues TF 2.0 Issues relating to TensorFlow 2.0 stat:contribution welcome Status - Contributions welcome labels Jan 31, 2019
@dynamicwebpaige dynamicwebpaige added this to In progress in TensorFlow 2.0 Jan 31, 2019
@dynamicwebpaige dynamicwebpaige removed the stat:contribution welcome Status - Contributions welcome label Feb 1, 2019
@piyush01123
Copy link

piyush01123 commented Feb 3, 2019

I want to contribute.
Is this referring to imports like

from tensorflow.examples.tutorials.mnist import input_data
where we would maybe want to import data from Tensorflow Datasets:

import tensorflow_datasets as tfds
ds_train, ds_test = tfds.load(name="mnist", split=["train", "test"])

Please correct me if I'm wrong.

@dynamicwebpaige
Copy link
Contributor Author

Hi, @piyush-kgp! Thanks for the offer to help - we appreciate it! 😊

For more information on tf.data.Datasets, check here.

@rsepassi would be the best contact, and is working with @yashk2810 + several other members of the TensorFlow team to get tutorials ready for TF 2.0. Also make sure to follow progress on these two issues for TFDS support and testing: #31, #25367 .

Ryan, Yash - are there any tutorials on GitHub right now that Piyush could help migrate?

@rsepassi
Copy link

rsepassi commented Feb 4, 2019

That’s great, thanks @piyush-kgp. TFDS is now TF 2.0-ready and can be used in the tutorials. @yashk2810 and his colleagues can coordinate work on the tutorials.

@jvishnuvardhan jvishnuvardhan added the comp:data tf.data related issues label May 31, 2019
@tensorflow-bot
Copy link

Are you satisfied with the resolution of your issue?
Yes
No

@dynamicwebpaige dynamicwebpaige moved this from In progress to Done in TensorFlow 2.0 Aug 23, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:data tf.data related issues TF 2.0 Issues relating to TensorFlow 2.0 type:docs-bug Document issues
Projects
Development

No branches or pull requests

5 participants