Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Conversation

@Jack-Khuu
Copy link
Contributor

@Jack-Khuu Jack-Khuu commented Sep 28, 2024

The existing code results in an unhealthy import environment when executing from a distributed setting i.e. dist_run.py. This is continuation of the fix from ec7b510

The try-catch is a temporary patch to unbreak dist_run.py, while we investigate. Bug: #1220


Test:
python dist_run.py --model_name no longer fails ion import (see bug issue for details)

@pytorch-bot
Copy link

pytorch-bot bot commented Sep 28, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1228

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ No Failures

As of commit 83090cd with merge base 8278aa2 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Sep 28, 2024
Copy link
Contributor

@kwen2501 kwen2501 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks much for fixing this!!

@kwen2501
Copy link
Contributor

Resolves #1220 ?

@Jack-Khuu
Copy link
Contributor Author

Resolves #1220 ?

That's what I'm hoping for haha

@Jack-Khuu Jack-Khuu changed the title Pin Evaluate dep to a version to solve naming conflicts [WIP] Pin Evaluate dep to a version to solve naming conflicts Sep 29, 2024
@Jack-Khuu Jack-Khuu changed the title [WIP] Pin Evaluate dep to a version to solve naming conflicts Wrap unused lm_eval in try-catch: Unblock dist_run Sep 30, 2024
@Jack-Khuu Jack-Khuu merged commit ba4169d into main Sep 30, 2024
52 checks passed
metascroy pushed a commit that referenced this pull request Sep 30, 2024
* Fix Evaluate to a version

* clean comments

* Adding MPS Support for LLama3.2 11B Multimodal; Bump torchtune 9.28.24

* Lock onto a pre BC breaking version of datasets

* Bump lm_eval import before torchtune

* Minimize changes

* Minimize changes

* Test local import

* Just Try Catch
@Jack-Khuu Jack-Khuu deleted the fix-evaluate branch October 5, 2024 02:37
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants