Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core][Distributed] add fast broadcast for tensor dict #4757

Closed
wants to merge 31 commits into from
Closed

[Core][Distributed] add fast broadcast for tensor dict #4757

wants to merge 31 commits into from

Commits on May 11, 2024

  1. add FastBroadcastTensorDict

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    70bd52f View commit details
    Browse the repository at this point in the history

  2. add subclass init

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    4807171 View commit details
    Browse the repository at this point in the history

  3. add tests

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    fa717a4 View commit details
    Browse the repository at this point in the history

  4. rm new

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    dced974 View commit details
    Browse the repository at this point in the history

  5. update tests

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    ff95abf View commit details
    Browse the repository at this point in the history

  6. use FastBroadcastTensorDict in worker

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    88b9e28 View commit details
    Browse the repository at this point in the history

  7. add get_example_data

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    ce74136 View commit details
    Browse the repository at this point in the history

  8. update tests

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    a450b57 View commit details
    Browse the repository at this point in the history

  9. add get_example_data in worker

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    94e2d70 View commit details
    Browse the repository at this point in the history

  10. fix init

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    af22c7f View commit details
    Browse the repository at this point in the history

  11. add get_example_metadata_list

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    0bea4ae View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' into fbtd

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    b060e0d View commit details
    Browse the repository at this point in the history

  13. rename to TensorDictWithBoundedMetadata

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    3e6ee16 View commit details
    Browse the repository at this point in the history

  14. use vllm.TensorMeta

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    a8d1d3a View commit details
    Browse the repository at this point in the history

  15. avoid circular import

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    ed24009 View commit details
    Browse the repository at this point in the history

  16. add comments

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    1f9a910 View commit details
    Browse the repository at this point in the history

  17. use class attributes

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    0467afb View commit details
    Browse the repository at this point in the history

  18. no need to broadcast keys

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    ee60d78 View commit details
    Browse the repository at this point in the history

  19. fix key

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    6969587 View commit details
    Browse the repository at this point in the history

  20. fix buffer size calculation

    @youkaichao
    youkaichao committed May 11, 2024
    Configuration menu
    Copy the full SHA
    8158667 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2024

  1. use smaller align bytes

    @youkaichao
    youkaichao committed May 12, 2024
    Configuration menu
    Copy the full SHA
    52a59ec View commit details
    Browse the repository at this point in the history

  2. assert torch dtype initialized

    @youkaichao
    youkaichao committed May 12, 2024
    Configuration menu
    Copy the full SHA
    89bd1ec View commit details
    Browse the repository at this point in the history

  3. fix torch dtype

    @youkaichao
    youkaichao committed May 12, 2024
    Configuration menu
    Copy the full SHA
    d0a43ef View commit details
    Browse the repository at this point in the history

  4. use str

    @youkaichao
    youkaichao committed May 12, 2024
    Configuration menu
    Copy the full SHA
    62ac962 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Merge branch 'main' into fbtd

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    5469842 View commit details
    Browse the repository at this point in the history

  2. fix merge

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    59f094a View commit details
    Browse the repository at this point in the history

  3. update tests

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    5c9f0e9 View commit details
    Browse the repository at this point in the history

  4. type annotation for get_example_metadata_list

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    7f8ce07 View commit details
    Browse the repository at this point in the history

  5. type annotation for get_example_metadata_list

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    4ae2b3a View commit details
    Browse the repository at this point in the history

  6. add assert

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    8de5ba2 View commit details
    Browse the repository at this point in the history

  7. fix name error

    @youkaichao
    youkaichao committed May 13, 2024
    Configuration menu
    Copy the full SHA
    70c3664 View commit details
    Browse the repository at this point in the history