Saved Model support: implements Model.saved_model that enables the user to serialize pred_step as a SavedModel #171
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
saved_model
gets a sample input and a path, and serializes apred_step
as a SavedModel viajax2tf
:This creates a SavedModel with 2 signatures:
(1, 6)
(1, 4)
and
(8, 6)
(8, 4)
Due to google/jax#5915 only a finite set of static batch sizes work, if this is resolved in the future one will be able to omit the batch size to que a polymorphic batch dimension:
This SavedModel would contain the following signature:
(None, 6)
(None, 4)