Skip to content

docs: refresh CLAUDE.md for grammar/structured-output, perplexity, KVarN defaults - #439

Merged
pekkah merged 1 commit into
masterfrom
claude/claude-md-docs-7a4d66
Jul 12, 2026
Merged

docs: refresh CLAUDE.md for grammar/structured-output, perplexity, KVarN defaults#439
pekkah merged 1 commit into
masterfrom
claude/claude-md-docs-7a4d66

Conversation

@pekkah

@pekkah pekkah commented Jul 12, 2026

Copy link
Copy Markdown
Owner

Summary

Updates the checked-in CLAUDE.md to reflect features added since it was last written. Documentation-only change — no code touched.

Changes

Test plan

Documentation-only; no build or test impact.

🤖 Generated with Claude Code


Generated by Claude Code

…arN defaults

- Document the Grammar/ subsystem in Core (ITokenConstraint,
  JsonSchemaOutputConstraint, per-family tool-arg constraints, #423/#425)
- Add the perplexity CLI command and -j/--json-schema structured-output flags
- Note --tq-mode auto default (KVarN where supported, Lloyd-Max fallback, #436)
  and KVarN CPU/CUDA decode paths (#180)
- Add SnapKvEval benchmark project; grammar coverage in Tests.Core

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01QNixcRevA5NPyFsKUeCySr
@pekkah
pekkah merged commit f90b870 into master Jul 12, 2026
1 check passed
@pekkah
pekkah deleted the claude/claude-md-docs-7a4d66 branch July 12, 2026 14:04

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the CLAUDE.md documentation to reflect several new features, including perplexity evaluation over a corpus, whole-turn structured JSON-schema output, grammar-constrained decoding, and the new auto mode for TurboQuant KV cache compression. The review feedback suggests correcting the spelling of 'honours' to 'honors' in the CLI documentation to maintain consistency with the American English spelling used throughout the rest of the codebase.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

Comment thread CLAUDE.md
3. **Engine** (`SharpInference.Engine`) — Forward-pass orchestration, KV cache, sampling, speculative decoding, MoE expert offloading, continuous batching. Depends on Core + backends.
4. **Frontends** —
- **CLI** (`SharpInference.Cli`, `Spectre.Console.Cli`, llama.cpp-compatible flags): `RunCommand` (default text/vision inference), `ImageCommand` (`image` subcommand), `ListMetadataCommand` (`list-metadata`), `ListTensorsCommand` (`list-tensors`).
- **CLI** (`SharpInference.Cli`, `Spectre.Console.Cli`, llama.cpp-compatible flags): `RunCommand` (default text/vision inference; also whole-turn JSON-schema structured output via `-j`/`--json-schema`/`--json-schema-file`), `ImageCommand` (`image` subcommand), `PerplexityCommand` (`perplexity` — accuracy gate over a corpus, honours `--tq`/`--tq-mode`), `ListMetadataCommand` (`list-metadata`), `ListTensorsCommand` (`list-tensors`).

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

To maintain spelling consistency across the codebase, please use the American English spelling honors instead of the British English spelling honours. The rest of the codebase consistently uses American English (e.g., honored in Sampler.cs and RunCommand.cs, and honor in RunCommand.cs).

Suggested change:

   - **CLI** (`SharpInference.Cli`, `Spectre.Console.Cli`, llama.cpp-compatible flags): `RunCommand` (default text/vision inference; also whole-turn JSON-schema structured output via `-j`/`--json-schema`/`--json-schema-file`), `ImageCommand` (`image` subcommand), `PerplexityCommand` (`perplexity` — accuracy gate over a corpus, honors `--tq`/`--tq-mode`), `ListMetadataCommand` (`list-metadata`), `ListTensorsCommand` (`list-tensors`).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants