Skip to content

v2.4.1

Choose a tag to compare

@Fly143 Fly143 released this 13 Sep 00:10
· 7 commits to main since this release

快速开始 / Quick Start

项 Item 值 Value
服务地址 URL http://localhost:8000 或 http://<本机IP>:8000
管理面板 Admin 同上(浏览器 HTTP Basic)
对外 API http://localhost:8000/v1(Chat / Anthropic Messages)
管理用户名 Admin user admin(固定 fixed)
管理密码 Admin password admin(config.json → admin_password)
pip install -r requirements.txt
python proxy.py

调用示例 / Call:

curl http://127.0.0.1:8000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model":"deepseek-default","messages":[{"role":"user","content":"hi"}],"stream":true}'

更新说明 / What's Changed

自 v2.3.12 起的主要变更(含 v2.4.0–v2.4.1 与 PR #30)。

中文

v2.4.1

  • 移除代理层 max_tokens=4096 兜底;temperature / top_p / max_tokens 纯透传
  • 思考+输出取消默认 HTTP 时限(DS_CLIENT_TIMEOUT 默认 0);需要保护时显式设秒数

v2.4.0(摘要)

  • 新增:上下文压缩(compress/truncation)、凭证 Fernet 加密、Anthropic 模型别名(4.7/日期后缀)、session token 峰值、工具流 content/tool_calls 一致性、StreamSieve 大小写不敏感、CORS allow_credentials=false
  • Anthropic 流异常收尾补发 tool_use;message_delta 含 input_tokens
  • PROXY_HOST;聊天失败指数退避重试
  • PR #30:app/batch.py 补齐 json / uuid import(Batch API 修复)

注意:DS_CLIENT_TIMEOUT=0 表示不限;若需防护请显式设如 600。

English

v2.4.1

  • Remove proxy-side max_tokens=4096 default; pure-pass temperature / top_p / max_tokens
  • No default HTTP deadline for thinking+output stream (DS_CLIENT_TIMEOUT defaults to 0)

v2.4.0 (summary)

  • Add: context compression (compress/truncation), Fernet credential encryption, Anthropic model aliases (4.7/date suffixes), session token peak tracking, tools stream content/tool_calls consistency, case-insensitive StreamSieve, CORS allow_credentials=false
  • Anthropic stream flushes tool_use on abnormal end; message_delta includes input_tokens
  • PROXY_HOST; exponential backoff retry on chat failures
  • PR #30: missing json / uuid imports in app/batch.py (Batch API fix)

Note: DS_CLIENT_TIMEOUT=0 means unlimited; set seconds explicitly if you need a guardrail.

Full Changelog: v2.3.12...v2.4.1