Skip to content

HybridBackend 1.0.0

Latest
Latest
Compare
Choose a tag to compare
@francktcheng francktcheng released this 20 Jul 11:42
· 1 commit to main since this release
v1.0.0
4486ba1
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Objectives:

  • Memory-efficient loading of categorical data
  • Communication-efficient training and evaluation at scale
  • Easy to use with existing AI workflows

Features:

  1. Performance:
    - Support ORC format in data loading.
    - Support data deduplication.
    - Improve performance of data transfer.
    - Improve performance of loading and shuffling string data.
    - Support workers with unbalanced training data via SyncReplicasDataset.
    - Support pipeline-based semi-synchronous training.
    - Support a hierarchical embedding lookup.

  2. Usability
    - Support standalone evaluation and prediction APIs of estimator and keras.

  3. Bugfixes:
    - Fix shape calculation of tf.feature_column.shared_embeddings

Assets 2