fix(cpu): remove hardcoded paths and unused arm_neon include#477
Merged
chenghuaWang merged 5 commits intoUbiquitousLearning:v2from Oct 14, 2025
Merged
fix(cpu): remove hardcoded paths and unused arm_neon include#477chenghuaWang merged 5 commits intoUbiquitousLearning:v2from
chenghuaWang merged 5 commits intoUbiquitousLearning:v2from
Conversation
Collaborator
chenghuaWang
commented
Oct 14, 2025
chenghuaWang
commented
- Replace absolute paths with relative includes for x86 kernel headers
- Remove unnecessary arm_neon.h include in radix attention implementation
…ment - Added `kvCache()` method to expose KV cache in `Qwen3ForCausalLM` - Adjusted `makeRotaryPosEmbedding` function signature for better formatting - Added new playground example for cache-reduced computation benchmarking - Included CMake and Python build scripts for the new example - Updated .gitignore to exclude SDK directories in playground
- Replace absolute paths with relative includes for x86 kernel headers - Remove unnecessary arm_neon.h include in radix attention implementation
- Expose `kvCache()` method in `Qwen2VLForCausalLM` to allow external access to the key-value cache for reduced computation scenarios - Add `qwen2vlLlmPartBench` function to benchmark Qwen2VL LLM part with configurable prefix cache length and prefill tokens - Update main function to support model selection between qwen2vl-2B and qwen3-0.6B for running corresponding benchmarks - Include necessary headers for Qwen2VL model components - Add python script for compiling and deploying the benchmark to Android using ADB toolkit
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.