Skip to content

Rewrite the model inputs finding mechanism #54

Merged
wine99 merged 2 commits intoravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/refact-model-inputs-v0
Mar 6, 2026
Merged

Rewrite the model inputs finding mechanism #54
wine99 merged 2 commits intoravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/refact-model-inputs-v0

Conversation

@zhaixuejun1993
Copy link

@zhaixuejun1993 zhaixuejun1993 commented Mar 5, 2026 •
edited
Loading

  1. Create new API compute_model_inputs(), which handles all model inputs related operations.
  2. Unified the stateful handle
  3. this method also support for sub c-graph from fallback

Verified with model Llama-3.2, Phi-3 w/o stateful & test-backend-ops pass

@github-actions github-actions bot added the ggml label Mar 5, 2026
cavusmustafa
cavusmustafa approved these changes Mar 5, 2026
View reviewed changes
Copy link
Collaborator

@cavusmustafa cavusmustafa left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Validated with Llama3.2, qwen2.5, and Phi3 with stateless (CPU,GPU,NPU) and stateful (CPU,GPU) on my side. Changes LGTM.

@wine99 wine99 merged commit 82051a9 into ravi9:dev_backend_openvino Mar 6, 2026
62 of 79 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cavusmustafa cavusmustafa cavusmustafa approved these changes

@wine99 wine99 Awaiting requested review from wine99 wine99 is a code owner

Assignees

No one assigned

Labels

ggml

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@zhaixuejun1993 @cavusmustafa @wine99