[rewriter] Decouple llama rule sets #2128

New issue

Jump to bottom

Open

titaiwangms opened this issue Mar 24, 2025 · 0 comments

Contributor

titaiwangms commented Mar 24, 2025

https://github.com/microsoft/onnxscript/blob/main/onnxscript/rewriter/llama_rule_sets.py

The file contains a lot of rewrite rules, but it's name is misleading, and its test (https://github.com/microsoft/onnxscript/blob/main/onnxscript/rewriter/llama_rule_sets_test.py) is also tangled. We need the API in optimizer explicitly specify what rules we are applying.

onnxscript/onnxscript/optimizer/_optimizer.py

Line 20 in cde945d

_DEFAULT_REWRITE_RULES = [

titaiwangms mentioned this issue

[rewriter] Enable llama rule sets #2124

Merged

titaiwangms changed the title ~~[rewriter] llama rule sets~~ [rewriter] Decouple llama rule sets

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment