Skip to content

Commit

Permalink
Update TFT dependencies to beam>=2.16<3, TFM>=0.15<0.16, TF>=1.15<2.2.
Browse files Browse the repository at this point in the history
PiperOrigin-RevId: 275890749
  • Loading branch information
zoyahav authored and tf-transform-team committed Oct 21, 2019
1 parent cd1254b commit 33810cd
Show file tree
Hide file tree
Showing 2 changed files with 31 additions and 24 deletions.
39 changes: 26 additions & 13 deletions RELEASE.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,40 +2,53 @@
# Current version (not yet released; still in development)

## Major Features and Improvements
* This release introduces initial experimental support for TF 2.0. TF 2.0
programs running in "safety" mode (i.e. using TF 1.X APIs through the
* This release introduces initial beta support for TF 2.0. TF 2.0 programs
running in "safety" mode (i.e. using TF 1.X APIs through the
`tensorflow.compat.v1` compatibility module are expected to work. Newly
written TF 2.0 programs may not work if they exercise functionality that is
not yet supported. If you do encounter an issue when using TFT with TF 2.0,
please create an issue https://github.com/tensorflow/transform/issues with
instructions on how to reproduce it.
* Performance improvements for preprocessing_fns with many Quantiles analyzers.
* Using new TF core quantiles ops, which are not publicly available until next
release. Analyzers and mappers now support missing tf.contrib module.
not yet supported. If you do encounter an issue when using
`tensorflow-transform` with TF 2.0, please create an issue
https://github.com/tensorflow/transform/issues with instructions on how to
reproduce it.
* Performance improvements for `preprocessing_fns` with many Quantiles
analyzers.
* `tft.quantiles` and `tft.bucketize` are now using new TF core quantiles ops
instead of contrib ops.
* Performance improvements due to packing multiple combine analyzers into a
single Beam Combiner.

## Bug Fixes and Other Changes
* Existing analyzer cache is invalidated.
* Saved transforms now support composite tensors (such as RaggedTensor).
* Saved transforms now support composite tensors (such as `tf.RaggedTensor`).
* Vocabulary's cache coder now supports non utf-8 encodable tokens.
* Fixes encoding of the `tft.covariance` accumulator cache.
* Fixes encoding per-key analyzers accumulator cache.
* Make various utility methods in `tft.inspect_preprocessing_fn` support
RaggedTensor.
`tf.RaggedTensor`.
* Moved beam/shared lib to `tfx-bsl`. If running with latest master, `tfx-bsl`
must also be latest master.
* Depends on `tfx-bsl>=0.15,<0.16`.
* `preprocessing_fn`s now have beta support of calls to `tf.function`s, as long
as they don't contain calls to `tf.Transform` analyzers/mappers or table
initializers.
* `tft.quantiles` is now using core TF ops, requiring `tensorflow>=1.15`.
* `tft.quantiles` and `tft.bucketize` are now using core TF ops.
* Depends on `tfx-bsl>=0.15,<0.16`.
* Depends on `tensorflow-metadata>=0.15,<0.16`.
* Depends on `apache-beam[gcp]>=2.16,<3`.
* Depends on `tensorflow>=0.15,<2.2`.
* Starting from 1.15, package
`tensorflow` comes with GPU support. Users won't need to choose between
`tensorflow` and `tensorflow-gpu`.
* Caveat: `tensorflow` 2.0.0 is an exception and does not have GPU
support. If `tensorflow-gpu` 2.0.0 is installed before installing
`tensorflow-transform`, it will be replaced with `tensorflow` 2.0.0.
Re-install `tensorflow-gpu` 2.0.0 if needed.

## Breaking changes
* `always_return_num_quantiles` changed to default to True in `tft.quantiles`
and `tft.bucketize`, resulting in exact bucket count returned.
* Removes the `input_fn_maker` module which has been deprecated since TFT 0.11.
For idiomatic construction of `input_fn`, see `tensorflow_transform` examples.
* Requires pre-installed TensorFlow >=1.15, < 3.

## Deprecations

# Release 0.14.0
Expand Down
16 changes: 5 additions & 11 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,21 +27,15 @@ def _make_required_install_packages():
# Make sure to sync the versions of common dependencies (absl-py, numpy,
# six, and protobuf) with TF.
return [
'absl-py>=0.7,<2',
'apache-beam[gcp]>=2.14,<3',
'absl-py>=0.7,<0.9',
'apache-beam[gcp]>=2.16,<3',
'numpy>=1.16,<2',
'protobuf>=3.7,<4',
'pydot>=1.2,<2',
'six>=1.10,<2',

'tensorflow-metadata>=0.14,<0.15',

# TODO(b/123240958): Uncomment this once TF can automatically select
# between CPU and GPU installation.
# 'tensorflow>=1.14,<2',

'tensorflow-metadata>=0.15,<0.16',
'tensorflow>=1.15,<2.2',
'tfx-bsl>=0.15,<0.16',

'pydot>=1.2.0,<2',
]

# TODO(b/121329572): Remove the following comment after we can guarantee the
Expand Down

0 comments on commit 33810cd

Please sign in to comment.