Skip to content

Add TE support for Lumina 2 LoRA #7075

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
rockerBOO wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add TE support for Lumina 2 LoRA #7075

rockerBOO wants to merge 1 commit into from

Conversation

@rockerBOO
Copy link

@rockerBOO rockerBOO commented Mar 4, 2025 •
edited
Loading

Key format:

lora_te_layers_0_self_attn_k_proj
lora_te_layers_0_mlp_gate_proj

@comfyanonymous
Copy link
Member

comfyanonymous commented Mar 6, 2025

Do you have an example lora with this?

@rockerBOO
Copy link
Author

rockerBOO commented Mar 6, 2025

https://rockerboo.us-east-1.linodeobjects.com/cyberpunk-boo-lumina-2025-03-04-030428-f2177119.safetensors

Also the key format is not in stone so could be adjusted if it aligns to something better, like lora_te1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@comfyanonymous comfyanonymous Awaiting requested review from comfyanonymous comfyanonymous is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@rockerBOO @comfyanonymous