Skip to content

Latest commit

 

History

History
462 lines (327 loc) · 16 KB

RELEASE.md

File metadata and controls

462 lines (327 loc) · 16 KB
Raw

Release 0.17.0

Major Features and Improvements

  • New tff.aggregators package with interfaces for stateful aggregation compositions.
  • New Google Landmark Dataset tff.simulations.dataset.gldv2
  • New convenience APIs tff.type_clients and tff.type_at_server
  • Invert control of computation tracing methods to produce clearer Python stack traces on error.
  • Move executor creation to a factory pattern in executor service, allowing distributed runtimes to be agnostic to number of clients.
  • Significant improvements of type serialization/deserialization
  • New tff.simulations.compose_dataset_computation_with_iterative_process API to move execution of client dataset construction to executor stack leaves.
  • Extend parameterization of tff.learning.build_federated_averaging_process with use_experimental_simulation_loop argument to better utilize multi-GPU setups.

Breaking Changes

  • Removed tff.utils.StatefulFn, replaced by tff.templates.MeasuredProcess.
  • Removed tff.learning.assign_weights_to_keras_model
  • Stop removing OptimizeDataset ops from tff.tf_computations.
  • The research/ directory has been moved to http://github.com/google-research/federated.
  • Updates to input_spec argument for tff.learning.from_keras_model.
  • Updated TensorFlow dependency to 2.3.0.
  • Updated TensorFlow Model Optimization dependency to 0.4.0.

Bug Fixes

  • Fixed streaming mode hang in remote executor.
  • Wrap collections.namedtuple._asdict calls in collections.OrderedDict to support Python 3.8.
  • Correctly serialize/deserialize tff.TensorType with unknown shapes.
  • Cleanup TF lookup HashTable resources in TFF execution.
  • Fix bug in Shakespeare dataset where OOV and last vocab character were the same.
  • Fix TFF ingestion of Keras models with shared embeddings.
  • Closed hole in compilation to CanonicalForm.

Known Bugs

  • "Federated Learning for Image Classification" tutorial fails to load projector plugin for tensorboard. (google-parfait#914)
  • Certain Keras models with activity regularization fail in execution with unliftable error (google-parfait#913).

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

amitport, ronaldseoh

Release 0.16.1

Bug Fixes

  • Fixed issue preventing Python lists from being all_equal values.

Release 0.16.0

Major Features and Improvements

  • Mirrored user-provided types and minimize usage of AnonymousTuple.

Breaking Changes

  • Renamed AnonymousTuple to Struct.

Release 0.15.0

Major Features and Improvements

  • Updated tensorflow-addons package dependency to 0.9.0.
  • Added API to expose the native backend more conveniently. See tff.backends.native.* for more information.
  • Added a compiler argument to the tff.framework.ExecutionContext API and provided a compiler for the native execution environment, which improves TFF’s default concurrency pattern.
  • Introduced a new tff.templates.MeasuredProcess concept, a specialization of tff.templates.IterativeProcess.
  • Extends tff.learning interfaces to accept tff.templates.MeasuredProcess objects for aggregation and broadcast computations.
  • Introduce new convenience method tff.learning.weights_type_from_model.
  • Introduced the concept of a tff.framework.FederatingStrategy, which parameterizes the tff.framework.FederatingExecutor so that the implementation of a specific intrinsic is easier to provide.
  • Reduced duplication in TFF’s generated ASTs.
  • Enabled usage of GPUs on remote workers.
  • Documentation improvements.

Breaking Changes

  • The IterativeProcess return from tff.learning.build_federated_averaging_process and tff.learning.build_federated_sgd_process now zip the second tuple output (the metrics) to change the result from a structure of federated values to to a federated structure of values.
  • Removed tff.framework.set_default_executor function, instead you should use the more convenient tff.backends.native.set_local_execution_context function or manually construct a context an set it using tff.framework.set_default_context.
  • The tff.Computation base class now contains an abstract __hash__ method, to ensure compilation results can be cached. Any custom implementations of this interface should be updated accordingly.

Bug Fixes

  • Fixed issue for missing variable initialization for variables explicitly not added to any collections.
  • Fixed issue where table initializers were not run if the tff.tf_computation decorated function used no variables.

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

jvmcns@

Release 0.14.0

Major Features and Improvements

  • Multiple TFF execution speedups.
  • New tff.templates.MeasuredProcess specialization of IterativeProcess.
  • Increased optimization of the tff.templates.IterativeProcess -> tff.backends.mapreduce.CanonicalForm compiler.

Breaking Changes

  • Moved tff.utils.IterativeProcess to tff.templates.IterativeProcess.
  • Removed tff.learning.TrainableModel, client optimizers are now arguments on the tff.learning.build_federated_averaging_process.
  • Bump required version of pip packages for tensorflow (2.2), numpy (1.18), pandas (0.24), grpcio (1.29).

Bug Fixes

  • Issue with GPUs in multimachine simulations not being utilized, and bug on deserializing datasets with GPU-backed runtime.
  • TensorFlow lookup table initialization failures.

Known Bugs

  • In some situations, TF will attempt to push Datasets inside of tf.functions over GPU device boundaries, which fails by default. This can be hit by certain usages of TFF, e.g. as tracked here.

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

jvmcns@

Release 0.13.1

Bug Fixes

  • Fixed issues in tutorial notebooks.

Release 0.13.0

Major Features and Improvements

  • Updated absl-py package dependency to 0.9.0.
  • Updated h5py package dependency to 2.8.0.
  • Updated numpy package dependency to 1.17.5.
  • Updated tensorflow-privacy package dependency to 0.2.2.

Breaking Changes

  • Deprecated dummy_batch parameter of the tff.learning.from_keras_model function.

Bug Fixes

  • Fixed issues with executor service using old executor API.
  • Fixed issues with remote executor test using old executor API.
  • Fixed issues in tutorial notebooks.

Release 0.12.0

Major Features and Improvements

  • Upgraded tensorflow dependency from 2.0.0 to 2.1.0.
  • Upgraded tensorflow-addons dependency from 0.6.0 to 0.7.0.
  • Upgraded attr dependency from 18.2 to 19.3.
  • Upgraded tfmot dependency from 0.1.3 to 0.2.1.
  • Added a federated partition of the CIFAR-100 dataset to tff.simulation.datasets.cifar100.
  • Made the high performance, parallel executor the default (replacing the reference executor).
  • Added a new tff.learning.build_personalization_eval for evaluating model personalization strategies.
  • Added new federated intrinsic tff.federated_secure_sum.
  • tff.learning.build_federated_averaing_process() now takes a client_optimizer_fn and a tff.learning.Model. tff.learning.TrainableModel is now deprecated.
  • Improved performance in the high performance executor stack.
  • Implemented and exposed tff.framework.ExecutorFactory; all tff.framework...executor_factory calls now return an instance of this class.
  • Added remote_executor_example binary which demonstrates using the RemoteExecutor across multi-machine deployments.
  • Added close() method to the Executor, allowing subclasses to proactively release resources.
  • Updated documentation and scripts for creating Docker images of the TFF runtime.
  • Automatically call tff.federated_zip on inputs to other federated intrinsics.

Breaking Changes

  • Dropped support for Python2.
  • Renamed tff.framework.create_local_executor (and similar methods) to tff.framework.local_executor_factory.
  • Deprecated federated_apply(), instead use federated_map() for all placements.

Bug Fixes

  • Fixed problem with different instances of the same model having different named types. tff.learning.ModelWeights no longer names the tuple fields returned for model weights, instead relying on an ordered list.
  • tff.sequence_* on unplaced types now correctly returns a tff.Value.

Known Bugs

  • tff.sequence_*.. operations are not implemented yet on the new high-performance executor stack.
  • A subset of previously-allowed lambda captures are no longer supported on the new execution stack.

Release 0.11.0

Major Features and Improvements

  • Python 2 support is now deprecated and will be removed in a future release.
  • federated_map now works with both tff.SERVER and tff.CLIENT placements.
  • federated_zip received significant performance improvements and now works recursively.
  • Added retry logic to gRPC calls in the execution stack.

Breaking Changes

  • collections.OrderedDict is now required in many places rather than standard Python dictionaries.

Bug Fixes

  • Fixed computation of the number of examples when Keras is using multiple inputs.
  • Fixed an assumption that tff.framework.Tuple is returned from IterativeProcess.next.
  • Fixed argument packing in polymorphic invocations on the new executor API.
  • Fixed support for dir() in ValueImpl.
  • Fixed a number of issues in the Colab / Jupyter notebook tutorials.

Release 0.10.1

Bug Fixes

  • Updated to use grpcio 1.24.3.

Release 0.10.0

Major Features and Improvements

  • Add a federated_sample aggregation that is used to collect a sample of client values on the server using reservoir sampling.
  • Updated to use tensorflow 2.0.0 and tensorflow-addons 0.6.0 instead of the coorisponding nightly package in the setup.py for releasing TFF Python packages.
  • Updated to use tensorflow-privacy 0.2.0.
  • Added support for attr.s classes type annotations.
  • Updated streaming Execute method on tff.framework.ExecutorService to be asynchronous.
  • PY2 and PY3 compatability.

Release 0.9.0

Major Features and Improvements

  • TFF is now fully compatible and dependent on TensorFlow 2.0
  • Add stateful aggregation with differential privacy using TensorFlow Privacy (https://pypi.org/project/tensorflow-privacy/).
  • Additional stateful aggregation lwith compression using TensorFlow Model Optimization (https://pypi.org/project/tensorflow-model-optimization/).
  • Improved executor stack for simulations, documentation and scripts for starting simulations on GCP.
  • New libraries for creating synthetic IID and non-IID datsets in simulation.

Breaking Changes

  • examples package split to simulation and research.

Bug Fixes

  • Various error message string improvements.
  • Dataset serialization fixed for V1/V2 datasets.
  • tff.federated_aggregate supports accumulate, merge and report methods with signatures containing tensors with undefined dimensions.

Release 0.8.0

Major Features and Improvements

  • Improvements in the executor stack: caching, deduplication, bi-directional streaming mode, ability to specify physical devices.
  • Components for integration with custom mapreduce backends (tff.backends.mapreduce).
  • Improvements in simulation dataset APIs: ConcreteClientData, random seeds, stack overflow dataset, updated documentation.
  • Utilities for encoding and various flavors of aggregation.

Breaking Changes

  • Removed support for the deprecated tf.data.Dataset string iterator handle.
  • Bumps the required versions of grpcio and tf-nightly.

Bug Fixes

  • Fixes in notebooks, typos, etc.
  • Assorted fixes to align with TF 2.0.
  • Fixes thread cleanup on process exit in the high-performance executor.

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Gui-U@, Krishna Pillutla, Sergii Khomenko.

Release 0.7.0

Major Features and Improvements

  • High-performance simulation components and tutorials.

Breaking Changes

  • Refactoring/consolidation in utility functions in tff.framework.
  • Switches some of the tutorials to new PY3-only executor stack components.

Bug Fixes

  • Includes the examples directory in the pip package.
  • Pip installs for TensorFlow and TFF in turorials.
  • Patches for asyncio in tutorials for use in Jupyter notebooks.
  • Python 3 compatibility issues.
  • Support for federated_map_all_equal in the reference executor.
  • Adds missing implementations of generic constants and operator intrinsics.
  • Fixes missed link in compatibility section of readme.
  • Adds some of the missing intrinsic reductions.

Thanks to our Contributors

This release contains contributions from many people at Google.

Release 0.6.0

Major Features and Improvements

  • Support for multiple outputs and loss functions in keras models.
  • Support for stateful broadcast and aggregation functions in federated averaging and federated SGD APIs.
  • tff.utils.update_state extended to handle more general state arguments.
  • Addition of tff.utils.federated_min and tff.utils.federated_max.
  • Shuffle client_ids in create_tf_dataset_from_all_clients by default to aid optimization.

Breaking Changes

  • Dependencies added to requirements.txt; in particular, grpcio and portpicker.

Bug Fixes

  • Removes dependency on tf.data.experimental.NestedStructure.

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Dheeraj R Reddy, @Squadrick.

Release 0.5.0

Major Features and Improvements

  • Removed source level TF dependencies and switched from tensorflow to tf-nightly dependency.
  • Add support for attr module in TFF type system.
  • Introduced new tff.framework interface layer.
  • New AST transformations and optimizations.
  • Preserve Python container usage in tff.tf_computation.

Bug Fixes

  • Updated TFF model to reflect Keras tf.keras.model.weights order.
  • Keras model with multiple inputs. #416

Release 0.4.0

Major Features and Improvements

Breaking Change

  • Normalized func to fn across the repository (rename some parameters and functions)

Bug Fixes

  • Wrapped Keras models can now be used with tff.learning.build_federated_evaluation
  • Keras models with non-trainable variables in intermediate layers (e.g. BatchNormalization) can be assigned back to Keras models with tff.learning.ModelWeights.assign_weights_to

Release 0.3.0

Breaking Changes

  • Rename tff.learning.federated_average to tff.learning.federated_mean.
  • Rename 'func' arguments to 'fn' throughout the API.

Bug Fixes

  • Assorted fixes to typos in documentation and setup scripts.

Release 0.2.0

Major Features and Improvements

  • Updated to use TensorFlow version 1.13.1.
  • Implemented Federated SGD in tff.learning.build_federated_sgd_process().

Breaking Changes

  • next() function of tff.utils.IteratedProcesss returned by build_federated_*_process() no longer unwraps single value tuples (always returns a tuple).

Bug Fixes

  • Modify setup.py to require TensorFlow 1.x and not upgrade to 2.0 alpha.
  • Stop unpacking single value tuples in next() function of objects returned by build_federated_*_process().
  • Clear cached Keras sessions when wrapping Keras models to avoid referencing stale graphs.

Release 0.1.0

Initial public release.