adds FPT AI Factory as provider - #3735
Open
littlebeanhp wants to merge 4 commits into
Open
Conversation
Contributor
Action items
|
Contributor
Action items
|
littlebeanhp
force-pushed
the
add-fpt-ai-factory-provider
branch
from
July 25, 2026 04:54
8992189 to
2cb5baf
Compare
Contributor
Action items
|
Contributor
Action items
|
- Remove GLM-5.1 (not served by FPT's live /v1/models catalog; only GLM-5.2 is) - Inherit real base-model max-output instead of copying context into limit.output (FPT reports max_completion_tokens == context_length as a no-cap signal), matching peer relays (tinfoil, aki-io, nearai) - Keep limits where FPT genuinely differs (DeepSeek-V4-Flash 200k ctx, GLM-5.2 128k out) - reasoning_options = [] retained: FPT's supported_parameters expose no reasoning/effort control Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds FPT AI Factory as an OpenAI-compatible provider (
https://mkp-api.fptcloud.com/v1), serving 8 LLM/VLM models on NVIDIA GB300 nodes. Claude and GPT models are coming in an upcoming release.Sources
All values are captured from FPT's live first-party catalog endpoint (public, no auth):
GET https://mkp-api.fptcloud.com/v1/models.data[].id(exact-cased, e.g.gpt-oss-120b,DeepSeek-V4-Flash).[cost]—data[].pricing.prompt→input,data[].pricing.completion→output(per-token USD ×10⁶ = per-1M).[limit].context—data[].top_provider.context_length(the cap FPT actually serves; several are lower than the lab base, e.g. Llama-3.3-70B 128k→32k, DeepSeek-V4-Flash 1M→200k).[limit].output— FPT reportstop_provider.max_completion_tokens == context_lengthfor every model, which is a gateway "no separate output cap" signal rather than a real max-output. Following peer relays (tinfoil,aki-io,nearai),outputis left to inherit the lab base_model's true max-output rather than copy the context window. Overrides are kept only where FPT genuinely differs: GLM-5.2 (128k output, below the 1M context and below base) and DeepSeek-V4-Flash (output bounded by its 200k FPT context).Provider metadata: API keys at https://marketplace.fptcloud.com/ · docs at https://ai-docs.fptcloud.com/.
Reasoning options
reasoning_options = []is intentional and evidence-backed: FPT'sdata[].supported_parametersfor every served model is exactly["temperature","top_p","max_tokens","tools","tool_choice","response_format","stream"]— it exposes noreasoning,reasoning_effort,thinking, orbudget_tokensparameter. The gateway forwards no caller-facing reasoning control, so[]is affirmative (not "untested default").Changes since first review
limit.outputon the 6 models that had copied the context window; they now inherit the lab base max-output.logo.svgis a square (viewBox~1:1) icon mark usingcurrentColor, no fixed size or hardcoded colors.Validated with
bun run validate.