Skip to content

v0.4.5

Latest

Choose a tag to compare

@wangxingjun778 wangxingjun778 released this 21 Sep 08:25

Features

  • Add ms agent install with gated plugin loader (#68): Introduces ms-hub agent install -r owner/name, which downloads an agent into its framework's local workspace by delegating to a framework plugin published as a model repository. The hub remains framework-agnostic; it resolves the plugin, fetches and verifies it, then hands the agent ID over. Also adds the modelscope_hub.agent.install_agent SDK entry. Security is enforced via a three-gate model: explicit plugin source (no built-in default owner), an owner allow-list checked before any download, and a trust_remote_code opt-in verified against a content_sha256 manifest. Plugin code executes in-process behind explicit trust acknowledgment.

  • Upload pipeline: commit-only recovery (#70): Retryable commit failures now re-commit already-uploaded files without re-transferring blobs; repository-policy rejections are split by halving down to a single file.

  • Upload pipeline: pending-only batch planning (#70): Resumed uploads re-plan only not-yet-committed files, eliminating tiny micro-commits after an interruption.

Enhancements

  • LFS routing default lowered (#70): LFS routing threshold dropped from 1 MiB to 64 KiB, moving small files to object storage — fewer commits and smaller commit bodies for large datasets.

  • Dual-constraint commit batching (#70): Batches close on operation-count target (256) or estimated request-body budget (8 MiB), clamped to the server's 2,000-action ceiling. LFS pointers no longer count against the body budget.

  • Tail-batch rebalancing (#70): Avoids a tiny final commit (e.g. 256/32 → 144/144) without adding extra commits.

  • Non-blocking capacity pre-checks (#70): Total file count, per-directory count, single-file size, and normal-file total are now warnings instead of hard errors.

  • Richer commit-plan logging (#70): Pending/skipped counts, per-batch ops, estimated bytes, and LFS share are now logged.

Fixes

  • Non-retryable commit failures no longer cause silent data loss (#70): Every terminal failure is counted, reported, blocks sync-delete, and raises StorageError.

  • 409/400 commit errors now retryable (#70): "Branch changed, please retry" (409) and "commit rejected by repository policy" (400, business code 10030000001) are correctly treated as retryable instead of permanent.

  • HTTP 200 with Success: false now raises (#70): Commit responses returning HTTP 200 but Success: false are no longer accepted as success.

  • Manual re-runs retry any uncommitted file (#70): Re-runs now retry any file not marked committed, regardless of the previous run's error type.

Refactor

  • Unified commit batch planning (#70): Planning is centralized across the main loop and all recovery paths; commit-retryability is centralized into a single commit-context classifier.

Documentation

  • Add AGENTS.md upload-pipeline spec (#70): Mandates simulation-regression scenarios for any change to the upload_folder chain. Documents upload environment-variable semantics (advisory thresholds, batching, retry) in README.md.

  • Update README.md (#71): Removes outdated content from the README's News section.

What's Changed

Full Changelog: v0.4.4...v0.4.5