v0.4.0

What's New

OpenAI API Spec Compliance

• Parameter range validation (temperature, top_p, frequency_penalty, presence_penalty, n, best_of)
• response_format support: json_object and json_schema for chat completions
• Embedding encoding_format=base64 support (little-endian)
• Stop sequences correctly skipped for JSON-formatted responses

vLLM Backend Compatibility

• Accept all vLLM-specific sampling params (top_k, min_p, use_beam_search, etc.) without error
• Response fields: stop_reason, service_tier, kv_transfer_params
• best_of and echo on chat completions

Scheduling

• response_format works in both scheduled and non-scheduled paths

Tests

• 19 new API compliance tests (TC14-TC17)
• 285 total tests passing