Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Add Serialization for Optimizers and Gradients #815

Draft
wants to merge 21 commits into
base: main
Choose a base branch
from
Draft

[WIP] Add Serialization for Optimizers and Gradients #815

wants to merge 21 commits into from

Commits on Jun 28, 2023

  1. add infrastructure for hyperparameter support for TensorCollections; … 

    …add Gradients::as_model
    @nkoppel
    nkoppel committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    c6da1a1 View commit details
    Browse the repository at this point in the history

  2. run cargo fmt

    @nkoppel
    nkoppel committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    72f8b1a View commit details
    Browse the repository at this point in the history

  3. use 'scalar' instead of 'hyperparameter'; use NumCast instead of ToPr… 

    …imitive
    @nkoppel
    nkoppel committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    cd58811 View commit details
    Browse the repository at this point in the history

  4. run cargo fmt

    @nkoppel
    nkoppel committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    07f63cc View commit details
    Browse the repository at this point in the history

  5. add scalars to TensorCollection impls for examples listed in coreylow… 

    …man#485
    @nkoppel
    nkoppel committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    bf83966 View commit details
    Browse the repository at this point in the history

  6. run cargo fmt

    @nkoppel
    nkoppel committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    d2dd8ba View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. implement npz scalar serialization

    @nkoppel
    nkoppel committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    1b51fab View commit details
    Browse the repository at this point in the history

  2. fix documentation; simplify tensor/numpy.rs

    @nkoppel
    nkoppel committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    6f0092a View commit details
    Browse the repository at this point in the history

  3. add scalars to safetensor serialization

    @nkoppel
    nkoppel committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    c701cac View commit details
    Browse the repository at this point in the history

  4. small simplification

    @nkoppel
    nkoppel committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    0dbb1e0 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2023

  1. Add conversion of gradients to and from models

    @nkoppel
    nkoppel committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    289908e View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Merge branch 'main' into actually_serialize_optimizers

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    a4a1d36 View commit details
    Browse the repository at this point in the history

  2. add SerializeWithSurrogate trait

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    5660405 View commit details
    Browse the repository at this point in the history

  3. rename trait to SerializeWithModel; implement for Gradients

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    1ff1125 View commit details
    Browse the repository at this point in the history

  4. Fix error in no-std; run cargo fmt

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    da6b31f View commit details
    Browse the repository at this point in the history

  5. Add 'Serializer' associated type; Implement SerializeWithModel for Adam

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    f6d5003 View commit details
    Browse the repository at this point in the history

  6. run cargo fmt

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    67bbb72 View commit details
    Browse the repository at this point in the history

  7. fix typo

    @nkoppel
    nkoppel committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    9990e74 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. Merge branch 'main' into actually_serialize_optimizers

    @nkoppel
    nkoppel committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    019d2f5 View commit details
    Browse the repository at this point in the history

  2. Serialize scalars in AdamConfig

    @nkoppel
    nkoppel committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    2ff58e0 View commit details
    Browse the repository at this point in the history

  3. run cargo fmt; correct parameters for wd_tag

    @nkoppel
    nkoppel committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    5ff398f View commit details
    Browse the repository at this point in the history