From 96768027abd6b317561efb1ffece8743e0d9512b Mon Sep 17 00:00:00 2001 From: Chen Lai Date: Wed, 28 Aug 2024 17:56:02 +0800 Subject: [PATCH] update doc to disable dynamic shape --- examples/models/llama2/README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/examples/models/llama2/README.md b/examples/models/llama2/README.md index 980a1831b0e..b8a260865b5 100644 --- a/examples/models/llama2/README.md +++ b/examples/models/llama2/README.md @@ -316,9 +316,9 @@ Please refer to [this tutorial](https://pytorch.org/executorch/main/llm/llama-de Currently we supported lowering the stories model to other backends, including, CoreML, MPS and QNN. Please refer to the instruction for each backend ([CoreML](https://pytorch.org/executorch/main/build-run-coreml.html), [MPS](https://pytorch.org/executorch/main/build-run-mps.html), [QNN](https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html)) before trying to lower them. After the backend library is installed, the script to export a lowered model is -- Lower to CoreML: `python -m examples.models.llama2.export_llama -kv --coreml -c stories110M.pt -p params.json` -- MPS: `python -m examples.models.llama2.export_llama -kv --mps -c stories110M.pt -p params.json` -- QNN: `python -m examples.models.llama2.export_llama -kv --qnn -c stories110M.pt -p params.json` +- Lower to CoreML: `python -m examples.models.llama2.export_llama -kv --disable_dynamic_shape --coreml -c stories110M.pt -p params.json ` +- MPS: `python -m examples.models.llama2.export_llama -kv --disable_dynamic_shape --mps -c stories110M.pt -p params.json ` +- QNN: `python -m examples.models.llama2.export_llama -kv --disable_dynamic_shape --qnn -c stories110M.pt -p params.json ` The iOS LLAMA app supports the CoreML and MPS model and the Android LLAMA app supports the QNN model. On Android, it also allow to cross compiler the llama runner binary, push to the device and run.