feat: add observation-bound model structure and q8 decoding - #156
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scope
Continue #150 with original CPU-only native-model foundations. This does not close #150 or #46.
The small positive GGUF fixture uses nondegenerate dimensions and actual observation construction. No caller-built Inspection or deserialization path can construct the profile. Q8_0 errors retain PartialEq/Eq traits; SNAFU Location now participates in equality.
Evidence
Boundaries
No model forward pass, whole-tensor Q8 load, mixed-text quant decoding, tokenizer/template parity, provenance admission, derived VRAM budget, service/routing change or GPU access. Observations are not atomic snapshots. The deliberately narrow profile can reject other upstream-valid layouts; it does not claim general Qwen-family support. Upstream format/model facts were read at pinned sources, not carried as implementation.