Skip to content

Conversation

lucylq
Copy link
Contributor

@lucylq lucylq commented Aug 28, 2024

Sync torchao installs across ExecuTorch install_requirements. torchao is used in:

  • llama2
  • flamingo (via torchtune)
  • phi3 lora (via torchtune)

Currently:

  • ExecuTorch llama2 installs torchao==0.0.1
  • Torchtune installs torchao==0.3.0
  • To export flamingo, which contains recent changes in torch and torchtune, we require a recent version, due to torch x torchao bc issue fixed by Fix Inductor bench BC change ao#638

This PR adds a torchao commit hash, so that we can use a recent and consistent version of torchao in ExecuTorch.

Note that torchao does not have prebuilt macos nightlies, which is why we use a commit hash instead of nightly.

Test plan:

./install_requirements.sh --pybind xnnpack
bash examples/models/flamingo/install_requirements.sh
python examples/models/flamingo/export_preprocess.py

confirm torchao==0.5.0+git0916b5b installed
confirm preprocess.pte generated

Copy link

pytorch-bot bot commented Aug 28, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/4945

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit c642963 with merge base a5157de (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 28, 2024
@lucylq lucylq force-pushed the lfq.torchao-version branch 2 times, most recently from deaae41 to 845c7e1 Compare August 28, 2024 18:03
@lucylq lucylq marked this pull request as ready for review August 28, 2024 18:08
@lucylq lucylq requested a review from larryliu0820 August 28, 2024 18:08
@facebook-github-bot
Copy link
Contributor

@lucylq has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@lucylq lucylq force-pushed the lfq.torchao-version branch from 845c7e1 to 55f8f3d Compare August 28, 2024 18:43
@facebook-github-bot
Copy link
Contributor

@lucylq has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Summary:
Sync torchao installs across ExecuTorch install_requirements. torchao is used in:
- llama2
- flamingo (via torchtune)
- phi3 lora (via torchtune)

Currently:
- ExecuTorch llama2 installs torchao==0.0.1
- Torchtune installs torchao==0.3.0
- To export flamingo, which contains recent changes in torch and torchtune, we require a recent version, due to torch x torchao bc issue fixed by pytorch/ao#638

This PR adds a torchao commit hash, so that we can use a recent and consistent version of torchao in ExecuTorch.

Note that torchao does not have prebuilt macos nightlies, which is why we use a commit hash instead of nightly.


Test Plan:
Imported from GitHub, without a `Test Plan:` line.
```
./install_requirements.sh --pybind xnnpack
bash examples/models/flamingo/install_requirements.sh
python examples/models/flamingo/export_preprocess.py
```
confirm torchao==0.5.0+git0916b5b installed
confirm preprocess.pte generated

Reviewed By: larryliu0820

Differential Revision: D61925882

Pulled By: lucylq
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61925882

@facebook-github-bot facebook-github-bot merged commit 52c9f30 into main Aug 28, 2024
53 checks passed
@facebook-github-bot facebook-github-bot deleted the lfq.torchao-version branch August 28, 2024 23:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants