Skip to content

add contiguous operation for diffllama model for xpu to enable compile mode.#43614

Merged
IlyasMoutawwakil merged 2 commits intohuggingface:mainfrom
kaixuanliu:dynamic-compile-fix
Jan 30, 2026
Merged

add contiguous operation for diffllama model for xpu to enable compile mode.#43614
IlyasMoutawwakil merged 2 commits intohuggingface:mainfrom
kaixuanliu:dynamic-compile-fix

Conversation

@kaixuanliu
Copy link
Contributor

We need to add contiguous operation in sdpa stage for xpu as well for this model so as we can use compile mode. pls help review, thx! @IlyasMoutawwakil

Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
@github-actions
Copy link
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: diffllama

@kaixuanliu kaixuanliu changed the title Dynamic compile fix add contiguous operation for diffllama model for xpu to enable compile mode. Jan 30, 2026
@kaixuanliu
Copy link
Contributor Author

Related test case:
tests/models/diffllama/test_modeling_diffllama.py::DiffLlamaModelTest::test_sdpa_can_compile_dynamic

Copy link
Member

@IlyasMoutawwakil IlyasMoutawwakil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@IlyasMoutawwakil IlyasMoutawwakil merged commit e23f92b into huggingface:main Jan 30, 2026
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants