Skip to content

History / Serving

Revisions

  • Sync wiki with main through bbe3ae8 Cover #3468: model.serve()/OpenAiServer gains bearer-token auth (api_key arg or GPTQMODEL_OPENAI_API_KEY, ASGI middleware on /v1 /v2 /inference), unauthenticated /health, loopback-or-key /shutdown, non-loopback no-key warning, stop as str|list with trimming, proper chat.completion response schema with finish_reason and usage, and threadpool + generation-lock request handling. #3466 and #3467 are test-only/internal exception-handling changes; skipped.

    @Qubitium Qubitium committed Oct 30, 2026
  • Rename Checkpoint-Formats page to Packing-Formats; add Complementary configs nav group - Checkpoint-Formats-and-Compatibility -> Packing-Formats-and-Compatibility (page file renamed; every inbound link retargeted and retitled). - Sidebar + Home: move Rotations/Smoothing/Norm Tuning and EoRA out of Quantization methods into a new Complementary configs group, with deep links to MSEConfig (mse=) and SmootherConfig in QuantizeConfig-Reference. These configs attach to multiple lifecycles rather than being methods.

    @Qubitium Qubitium committed Oct 29, 2026
  • Rename project references: GPTQModel -> GPT-QModel

    @Qubitium Qubitium committed Oct 28, 2026
  • Sync wiki with main through c1976918

    @Qubitium Qubitium committed Oct 27, 2026
  • Add workflow SVGs and refresh documentation navigation and accuracy

    @Qubitium Qubitium committed Oct 26, 2026
  • Full documentation site: concepts, all quant methods, config reference, lifecycle, backends, internals

    @Qubitium Qubitium committed Oct 26, 2026