Skip to content

HybridBackend 0.8.0
Compare
Choose a tag to compare
@2sin18 2sin18 released this 07 Mar 02:32
· 25 commits to main since this release
v0.8.0
d8d1514
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Objectives:

  1. Memory-efficient loading of categorical data
  2. Communication-efficient training and evaluation at scale

Features:

  1. Performance
    - Support of automatic embedding fusion on PAI DLC / PAI DSW
    - Support of row-wise shuffling
    - Improves data transfer prefetching

  2. Usability
    - Support of embedding_lookup_* API
    - Support of new composable Dataset API

Assets 2