Skip to content

Layer wise changes for kimi model#954

Closed
abhishek-singh591 wants to merge 15 commits into
quic:mainfrom
abhishek-singh591:layerwise_kimi
Closed

Layer wise changes for kimi model#954
abhishek-singh591 wants to merge 15 commits into
quic:mainfrom
abhishek-singh591:layerwise_kimi

Conversation

@abhishek-singh591
Copy link
Copy Markdown
Contributor

@abhishek-singh591 abhishek-singh591 commented Apr 29, 2026

Setup and Run Instructions

Follow the steps below to set up and run the Kimi model:

Step 1: Download the Model

Download the Kimi model from the official source:

  • Link: (https://huggingface.co/moonshotai/Kimi-K2.5)

Step 2: Configure Model Path

Open the run.py file and paste the downloaded model’s path into the appropriate configuration variable (model_path).

Step 3: Select Layerwise Strategy

In run.py, set the LAYERWISE_MODE flag to choose how the model runs:

  • single_qpc — Run the model on a single QPC
  • multiple_qpc — Run the model across multiple QPCs

Step 4: Run the Script

Execute the following command to start the model:

python run.py

Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
Signed-off-by: Abhishek Kumar Singh <sabhis@qti.qualcomm.com>
@abhishek-singh591
Copy link
Copy Markdown
Contributor Author

please refer to the #973 PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant