Repository navigation
v1.10.0 #1140
elamceritech
announced in
Announcements
v1.10.0
#1140
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
v1.10.0
This release makes GenAssist faster, more stable and more secure when many people use it at once, and adds a set of everyday improvements to conversations, cost tracking and evaluations.
Heavy screens such as the dashboard, analytics and conversation lists can now read from a separate read-only database copy, so they no longer slow down live chats. The platform also limits how many agent replies run at once, so a traffic spike returns a clear "busy, try again" instead of making everything slow. Background jobs are much more dependable: jobs are no longer lost, duplicated or stuck after a restart.
On the security side, admins can now restrict which websites may call agent endpoints from a browser, and sensitive tenant settings can only be given to the admin role. New features include read receipts ("Seen") in chat, a new Conversations workspace, optional prompt caching to cut LLM costs, the ability to add your own LLM models per provider, exact date ranges on the dashboard and analytics, and more flexible evaluation rules.
API Allowlisting & Security
These changes control who can call the API and from where, and close a few gaps found in security reviews.
CORS_AGENT_ALLOWED_ORIGIN_REGEX, an optional allowlist of the websites allowed to call agent endpoints from a browser. When it's set, only matching sites can use the agent from a browser with credentials; any other site is blocked by the browser.scheme://host[:port]), so a look-alike domain such ashttps://app.example.com.attacker.comcan't slip through a rule forhttps://app.example.com.OPTIONS) returns400. When the setting is empty (the default), nothing changes. A mistyped pattern is logged and ignored instead of breaking the app. Example:https://([a-z0-9-]+\.)*example\.com.mark-read,llm-model-catalog,operators/list,ml-models/profile-csv) to your allowlist. The chat widget on customer websites callsmark-readdirectly, so it must also be allowed on the public ingress.adminrole. Trying to give them to any other role returns403 ADMIN_ONLY_PERMISSION.supervisorrole immediately loses access to the groups they used to supervise. Supervisors now also see their own group's data.Performance & Scalability
GenAssist now holds up better under heavy load and recovers cleanly from traffic spikes.
DB_READ_HOST). Dashboard, analytics, LLM usage and conversation-list screens read from the replica, so they don't compete with live chats for database connections.CHAT_TURN_MAX_INFLIGHT, default24). Extra requests wait briefly in a queue. If one waits longer thanCHAT_TURN_QUEUE_TIMEOUT_SECONDS(default10), the caller gets503 CHAT_TURN_CAPACITY_EXCEEDED("The assistant is busy right now") instead of a slow timeout.LLM_EXECUTOR_THREADS), and a time limit on graceful shutdown (GRACEFUL_SHUTDOWN_TIMEOUT_SECONDS) so deployments and pod restarts finish cleanly.Celery Reliability
Background jobs (scheduled workflows, evaluations, ML training) are now much more dependable.
Prompt Caching & LLM Cost
You can now lower LLM costs and track them more accurately.
promptCaching) on LLM, Agent and Sub-Agent nodes. When it's on, the fixed start of the system prompt is cached for 5 minutes, and repeat calls are billed at a lower rate. Works with Anthropic and Bedrock models that support caching.cache_read_per_1k,cache_creation_per_1k).Conversations & Chat
Conversations are easier to follow and manage in real time.
Evaluations
Evaluation rules can now describe real conversation behavior more accurately.
tool_used,route_takenoraction_taken).Integrations & Platform
ZENDESK_AUTH_METHOD,ZENDESK_CLIENT_ID,ZENDESK_CLIENT_SECRET). Zendesk removes API tokens on 2027-04-30, so new connections should use OAuth.New Endpoints
Conversations (
/api/conversations)PATCH/api/conversations/in-progress/mark-read/{conversation_id}conversation_id(path, UUID); Body:last_read_sequence(int ≥0, required). Reader role (customer/supervisor) is derived from the auth principal, never from the body. ReturnsConversationReadReceiptStatePATCH /api/conversations/in-progress/mark-read/3fa85f64-…LLM Model Catalog (
/api/llm-model-catalog)GET/api/llm-model-catalogGET /api/llm-model-catalogGET/api/llm-model-catalog/providersbuiltin_model_keys)GET /api/llm-model-catalog/providersPOST/api/llm-model-catalogprovider_key(str 1–64, required),model_key(str 1–512, required),label(str 1–255, required),is_active(int 0/1, default1). Returns201POST /api/llm-model-catalogPUT/api/llm-model-catalog/{entry_id}entry_id(path, UUID); Body:label(str, optional),is_active(int 0/1, optional). Identity is fixed — delete + recreate to move an entry;404if not foundPUT /api/llm-model-catalog/3fa85f64-…DELETE/api/llm-model-catalog/{entry_id}entry_id(path, UUID). Returns204;404if not foundDELETE /api/llm-model-catalog/3fa85f64-…Operators (
/api/operators)GET/api/operators/listskip(query, int ≥0, default0),limit(query, int 1–100, default20),search(query, str, optional — first / last name). Paginated, ordered by positive sentiment, then scoreGET /api/operators/list?skip=0&limit=20&search=annML Models (
/api/ml-models)POST/api/ml-models/profile-csvfile_url(str, required — path underDATA_VOLUMEor HTTP(S) URL). Returns a downloadable HTML profiling report;404if the file is not foundPOST /api/ml-models/profile-csvUpdated Endpoints
GET/api/conversations/{conversation_id}read_state(customer_last_read_sequence,customer_last_read_at,supervisor_last_read_sequence,supervisor_last_read_at,supervisor_user_id)GET/api/dashboard/summarydaysis now optional (defaults to30). Addedfrom_datetime/to_datetime(exact range; both required, with timezone offset) andall_time(bool); mixing modes returns422. Response addsconversations;workflow_runsis deprecated (alias ofconversations)GET/api/analytics/agents/summaryactivity_from_datetime/activity_to_datetime(exact activity interval; both required, with timezone offset, needfrom_date+to_date, not combinable withcompare); invalid combinations return422GET/api/analytics/agents/exportactivity_from_datetime/activity_to_datetimewith the same validationGET/api/analytics/llm-usage/summarytotal_cache_read_tokensandtotal_cache_creation_tokensPOST/api/llm-cost-ratescache_read_per_1kandcache_creation_per_1k(decimal, optional)PUT/api/llm-cost-rates/{rate_id}cache_read_per_1k/cache_creation_per_1k. Sent blank, a cache rate resets to the provider default; omitted, it is keptGET/api/llm-cost-rates/exportinclude_cache_rates(query, bool, defaultfalse);falsekeeps the 4-column CSV layoutPOST/api/llm-cost-rates/import400above the cap)GET/api/llm-providersLlmProviderReadnow includesprompt_caching_mode(explicit,automatic,none)GET/api/genagent/workflow/minimalagent_name(null when the agent is gone or retired)GET/api/operators/{operator_id}PATCH/api/llm-analyst/{llm_analyst_id}409 LLM_ANALYST_INACTIVEPUT/api/user/{user_id}role_idsmay be empty forconsoleusers; other login-capable users, including on auser_type_idchange, still need a role (400 USER_ROLES_REQUIRED)POST/api/role-permissions403 ADMIN_ONLY_PERMISSIONwhen assigning an App Settings / Feature Flag permission to a non-admin rolePATCH/api/role-permissions/{rp_id}POST/api/internal/agents/executeCHAT_TURN_CAPACITY_EXCEEDED) and abandoned (CHAT_TURN_CLIENT_DISCONNECTED) turns now keep their HTTP status instead of returning{ success: false }Full Changelog: v1.9.5...v1.10.0
This discussion was created from the release v1.10.0.
All reactions