[SYCL] Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE

[arthw]

Overview

Fix issue: #26549

Additional information

Support DSv4 OPs:

• LIGHTNING_INDEXER
• DSV4_HC_COMB
• DSV4_HC_POST
• DSV4_HC_PRE

All related UT cases are passed.
Thank @mobilinkd to provide the patches.

To support DeepSeek-V4-Flash, need the solution in PR: #26515.

Requirements

• I have read and agree with the contributing guidelines
• AI usage disclosure: YES, help refactor the code

[jaroslavstreit]

Just bought Intel Arc Pro B65 and have problems with running DeepSeek V4 0731 - DSV4, so this could solve it, thank you, will let you know the results then. Without it, on Vulkan, got 7-9 t/s, 5070Ti got around 20 - because CUDA supports it.

EDIT: tested it, +11% on generating, -12% on prefill, totally worth it, thanks! DeepSeek-V4-Flash UD-IQ1_S — 76,9 GiB, context 16 384, --n-cpu-moe 43 (all 43 in RAM), KV cache f16, Ryzen 9950x, 96GB RAM 6000MHz, Arc B65 32GB.

[arthw]

@jaroslavstreit
Got it!
How many B65 GPUs in your case?

Thank you for your sharing!

[jaroslavstreit]

@jaroslavstreit
Got it!
How many B65 GPUs in your case?

Thank you for your sharing!

Just one.

[arthw]

DeepSeek-V4-Flash UD-IQ1_S is big: 76.9 GiB.
How to run it on one GPU: 32GB？
Do you load a part to GPU?

If yes, the performance will be impacted more.

Thank you!

[jaroslavstreit]

Rechecked it now with 24GB on VRAM, working stable. Now doing more tests and comparison with Vulkan. Plus then test with 200 000 ctx. Had error device_not_found when VRAM overflowed, but this is not code bug, it's wrong settings problem.

[jaroslavstreit]

I have Ryzen 9 9950X, Crucial PRO 96 GB DDR5-6000 · ASUS ROG CROSSHAIR 2006 X870E.