Skip to content

Conversation

@xuedinge233
Copy link
Contributor

  • I have added the release build package for openeuler-cann
  • Added support for Ascnd310p devices in cann.dockerfile

Make sure to read the contributing guidelines before submitting a PR

@xuedinge233
Copy link
Contributor Author

xuedinge233 commented Nov 12, 2025

@noemotiovon @hipudding Can you help review this pr?

@github-actions github-actions bot added the devops improvements to build systems and github actions label Nov 12, 2025
@hipudding hipudding assigned xuedinge233 and unassigned xuedinge233 Nov 13, 2025
@hipudding hipudding added the Ascend NPU issues specific to Ascend NPUs label Nov 13, 2025

# Define the Ascend chip model for compilation. Default is Ascend910B3
ARG ASCEND_SOC_TYPE=Ascend910B3
ARG ASCEND_SOC_TYPE
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ASCEND_SOC_TYPE can define chip type, CHIP_TYPE is not necessary?

# Define the CANN base image for easier version updates later
ARG CANN_BASE_IMAGE=quay.io/ascend/cann:8.1.rc1-910b-openeuler22.03-py3.10
ARG CHIP_TYPE=910b
ARG CANN_BASE_IMAGE=quay.io/ascend/cann:8.1.rc1-${CHIP_TYPE}-openeuler22.03-py3.10
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would CANN version 8.1 be a bit outdated?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bot?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I will update it

@xuedinge233 xuedinge233 requested a review from CISC as a code owner November 14, 2025 07:54
# Use the passed ASCEND_SOC_TYPE argument and add general build options
RUN source /usr/local/Ascend/ascend-toolkit/set_env.sh --force \
ARG CHIP_TYPE
ARG ASCEND_SOC_TYPE
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ASCEND_SOC_TYPE can be inferenced by CHIP_TYPE.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The modification has been completed.

@hipudding hipudding requested a review from ggerganov November 17, 2025 03:03
@hipudding
Copy link
Collaborator

Hi @ggerganov. We'd like to add releases for Ascend NPU, Can you please review this PR? Thanks.

strategy:
matrix:
arch: [x86, aarch64]
device: ['ascend910b3', 'ascend310p3']
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ascend910b, ascend310p

strategy:
matrix:
arch: [x86, aarch64]
device: ['ascend910b', 'ascend310p']
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nits: probably change this to chip_type to match the dockerfile params

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, I have modified it.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I mean the chip_type should not have the ascend prefix

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I made a mistake. Now it has been modified.

@xuedinge233 xuedinge233 force-pushed the test branch 2 times, most recently from 39dae72 to 3ede8a1 Compare November 17, 2025 11:15
@hipudding
Copy link
Collaborator

Please rebase to pass the CI.

Update openEuler version

Remove variable ASCEND_SOC_TYPE

Modify the chip type

Fix case in zip filename

Change "device" to "chip_type"

Modify the value of chip_type
@hipudding
Copy link
Collaborator

It seems that resources for amd-rocm and amd-vulkan are tight. Considering that this is a release package for adding the CANN backend, it is therefore unrelated to those two use cases.

@hipudding hipudding merged commit ffa277a into ggml-org:master Nov 18, 2025
62 of 64 checks passed
hipudding added a commit that referenced this pull request Nov 18, 2025
ronaldmannak pushed a commit to PicoMLX/llama.cpp that referenced this pull request Nov 19, 2025
Update openEuler version

Remove variable ASCEND_SOC_TYPE

Modify the chip type

Fix case in zip filename

Change "device" to "chip_type"

Modify the value of chip_type
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Ascend NPU issues specific to Ascend NPUs devops improvements to build systems and github actions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants