This repository was archived by the owner on Mar 7, 2025. It is now read-only.

Description
Currently generated Pydantic model has max_new_tokens set to 4096.
This value is not valid anymore and has been recently removed from the OpenAPI schema. We want to regenerate the schema and remove such limitations.
Workaround
from genai.schema import TextGenerationParameters
TextGenerationParameters(max_new_tokens=8000) # ❌
TextGenerationParameters.model_construct(max_new_tokens=8000) # ✅