[Intel GPU] enable use of dinov2 models for offload benchmark_low_bit_adam

[arlesniak]

Fix for the assertion:
AssertionError: Input height (224) doesn't match model (518).
when running benchmark_low_bit_adam with i.e. timm/vit_giant_patch14_dinov2.lvd142m (results for the offload benchmarks)

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3191

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 24d094a with merge base b9e5780 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[pytorch-bot]

To add the ciflow label ciflow/xpu please first approve the workflows that are awaiting approval (scroll to the bottom of this page).

This helps ensure we don't trigger CI on this PR until it is actually authorized to do so. Please ping one of the reviewers if you do not have access to approve and run workflows.

[arlesniak]

@pytorchbot retest

[pytorch-bot]

❌ 🤖 pytorchbot command failed:

@pytorchbot: error: argument command: invalid choice: 'retest' (choose from 'merge', 'revert', 'rebase', 'label', 'drci', 'cherry-pick')

usage: @pytorchbot [-h] {merge,revert,rebase,label,drci,cherry-pick} ...

Try @pytorchbot --help for more info.

[liangan1]

@arlesniak this is the benchmark part, you also need to enable the realted UTs

[arlesniak]

@arlesniak this is the benchmark part, you also need to enable the realted UTs

The PR changes are solely for the purpose of the benchmark when dinov2 models are used with it. The root cause of the error was the hardcoded input size, fixed with more flexible solution.These changes don't affect the TorchAo functionality and IMHO are not to be unit tested.

[EikanWang]

@liangan1 , @arlesniak , is the issue a XPU-specific issue? According to the error message, it should be a general issue, rigth?

[arlesniak]

@EikanWang It's a general issue, the fix is needed for the benchmark to be run with models on IntelGPU and others. (https://github.com/pytorch/ao/blob/main/torchao/optim/README.md)

[jerryzh168]

can you add a example benchmark command for xpu in the start of the file as a comment?