Skip to content

Conversation

@pengcheng888
Copy link
Contributor

@pengcheng888 pengcheng888 commented Sep 29, 2025

添加了 sigmoid, topksoftmax, and topkrouter,
算子的描述文档:
InfiniTensor/InfiniCore-Documentation#54

(1)新增: sigmoid, topksoftmax。
(2)修改:topkrouter。 对第一版的不完善topkrouter的代码, 有明显的增删改。

测试结果如下:

sigmoid测试结果

python-sigmoid-cpu:
python-sigmoid-cpu
python-sigmoid-nvidia:
python-sigmoid-nvidia
gguf-sigmoid-cpu:
cpp-sigmoid-cpu
gguf-sigmoid-nvidia:
cpp-sigmoid-nvidia

topksoftmax测试结果

python-topksoftmax-cpu:
python-topksoftmax-cpu
python-topksoftmax-nvidia:
python-topksoftmax-nvidia
gguf-topksoftmax-cpu:
cpp-topksoftmax-cpu
gguf-topksoftmax-nvidia:
cpp-topkrouter-nvidia

topkrouter测试结果

python-topkrouter-nvidia:
python-topkrouter-nvidia
python-topkrouter-cpu:
python-topkrouter-cpu
gguf-topkrouter-nvidia:
cpp-topkrouter-nvidia
gguf-topkrouter-cpu:
cpp-topkrouter-cpu

@wooway777 wooway777 merged commit 2c168b6 into InfiniTensor:main Oct 17, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DEV] 修改和添加MoE所需的算子, sigmoid, topksoftmax, topkrouter

2 participants