-
Notifications
You must be signed in to change notification settings - Fork 702
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Addding Support for Image Dataset #80
Comments
Hi, We are creating a import example gen for directly import external tfrecord files (with tf example in it) and create train and eval split for downstream component a custom component is also doable, we are working on creating an example for people to follow |
@1025KB I am eagerly waiting for the example. The preprocessing_fn reads the content of the tfrecord files as sparse tensors. I am unable to convert them to fixedlen features and reshape the image data. |
preprocessing_fn is for Transform, so you are able to custom ExampleGen to convert your input source to tf.Examples? |
if you are talking about custom ExampleGen for reading data file format that we don't support yet, check this you can also do your own conversion before TFX, and use ImportExampleGen to directly import the tf.Examples, check this if your problem is Transform related, let me know and I can find you a Transform expert |
@thak123 There are some pending work in the Schemagen to enable our support for fixedlen features. We will keep this thread updated. |
Thanks for showing me the right direction. I am able to train the model now. |
Hi,
We are looking for an pipeline example around Mnist or Cifar10 or Coco data sets.
If you could guide us on how to implement one also will do, we would be happy to support.
Thanks.
@thak123 FYI
The text was updated successfully, but these errors were encountered: