Skip to content

v0.6.4

Choose a tag to compare

@MiYui34 MiYui34 released this 14 Nov 03:56
· 1 commit to main since this release

修复

  • 跨机同步速度:此前每个文件都新建一条 TCP 连接,下载完还要再发一次 /v1/stat 复核,几万个小文件时光是握手就要几个小时。现在每个线程复用一条 keep-alive 连接,连接被对端关掉时自动换新重试。
  • sync.concurrency 默认从 4 提到 8(跨机高延迟链路可以调到 16)。
  • 新增 source.agent.verify_copy(默认 true):设为 false 时不再对每个文件发复核请求,省掉一半往返;代价是文件在传输途中被改写时可能要到下一轮才发现。

Fix

  • Cross-machine throughput: every file used to open a new TCP connection, plus a second /v1/stat request to verify the download — tens of thousands of small files spent hours in handshakes. Each worker thread now reuses one keep-alive connection and reconnects transparently when the peer closes it.
  • sync.concurrency defaults to 8 (raise to 16 on high-latency links).
  • New source.agent.verify_copy (default true): set it to false to skip the per-file verification round trip.