Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: large HG models example #1933

Merged
merged 11 commits into from
Nov 8, 2022
Merged

Conversation

jagadeeshi2i
Copy link
Collaborator

@jagadeeshi2i jagadeeshi2i commented Oct 31, 2022

Adds example of loading large Huggingface models using accelerate

Tested on
bigscience/bloom-7b1, bigscience/T0pp models

Signed-off-by: jagadeesh jagadeeshj@ideas2it.com

Description

Please read our CONTRIBUTING.md prior to creating your first pull request.

Please include a summary of the feature or issue being fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes #(issue)

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Feature/Issue validation/testing

Please describe the Unit or Integration tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

  • Test A
    Logs for Test A

  • Test B
    Logs for Test B

Checklist:

  • Did you have fun?
  • Have you added tests that prove your fix is effective or that this feature works?
  • Has code been commented, particularly in hard-to-understand areas?
  • Have you made corresponding changes to the documentation?

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@codecov
Copy link

codecov bot commented Oct 31, 2022

Codecov Report

Merging #1933 (90fdadc) into master (2ba7573) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1933   +/-   ##
=======================================
  Coverage   44.95%   44.95%           
=======================================
  Files          63       63           
  Lines        2609     2609           
  Branches       56       56           
=======================================
  Hits         1173     1173           
  Misses       1436     1436           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
 - add requirements.txt

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@jagadeeshi2i jagadeeshi2i changed the title [WIP] feat: large HG models example feat: large HG models example Nov 1, 2022
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
examples/Huggingface_Largemodels/Readme.md Show resolved Hide resolved
examples/Huggingface_Largemodels/Readme.md Show resolved Hide resolved
examples/Huggingface_Largemodels/Readme.md Outdated Show resolved Hide resolved
examples/Huggingface_Largemodels/Readme.md Outdated Show resolved Hide resolved
 - update readme doc

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@msaroufim msaroufim self-requested a review November 3, 2022 16:12
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
…erve into feat/hg_bigmodels

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@msaroufim msaroufim merged commit 0942611 into pytorch:master Nov 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants