Repository navigation
NETFORY Client UI Web4 v1.135.118
The first public implementation of a decentralized network NETFORY WEB4.0
[1.135.118 / ai-worker 0.13.0 / ntfry-ai 0.2.0] (native chat dialogs Msg::InferChat)
Main-app release marker rolling up the frontend
changes since the last app version: the AI console Speed Badge
(ai-worker 0.10.1), the pipeline slots badge (0.11.0) and the model
catalog marketplace badges live tok/s + token price (0.12.0).
Added
- Native multi-turn dialogs (
Msg::InferChat): the OpenAImessages[]
array now travels to the gateway as structuredVec<ChatTurn>instead of
a pre-flattened transcript. The gateway renders the history with the
model's canonical chat template (newFamily::render_chatin
chat_template.rs: ChatML / Llama 3 / Mistral / Zephyr / GLM-4, including
system prompts andthink=false> empty<think></think>block). - Free prefix caching for chat: reuse is decided by the token prefix
after rendering (prefix_best_matchinrun_batch), so the next turn of
the same dialog automatically hits the shard snapshot and only prefills the
tail no extra hashing needed, fast TTFT on follow-ups. - ntfry-ai 0.2.0 mapping: OpenAI
messages[]map toChatTurnwith no
string concatenation; multi-turn / system >InferChat, a single user
message > plainInfer(compatible with older workers). If the gateway is
old andInferChatfails, the proxy automatically falls back to a flat
transcriptInfer.docs/NTFRY-AI.mdupdated.