Repository navigation
Features
-
Add
ms agent installwith gated plugin loader (#68): Introducesms-hub agent install -r owner/name, which downloads an agent into its framework's local workspace by delegating to a framework plugin published as a model repository. The hub remains framework-agnostic; it resolves the plugin, fetches and verifies it, then hands the agent ID over. Also adds themodelscope_hub.agent.install_agentSDK entry. Security is enforced via a three-gate model: explicit plugin source (no built-in default owner), an owner allow-list checked before any download, and atrust_remote_codeopt-in verified against acontent_sha256manifest. Plugin code executes in-process behind explicit trust acknowledgment. -
Upload pipeline: commit-only recovery (#70): Retryable commit failures now re-commit already-uploaded files without re-transferring blobs; repository-policy rejections are split by halving down to a single file.
-
Upload pipeline: pending-only batch planning (#70): Resumed uploads re-plan only not-yet-committed files, eliminating tiny micro-commits after an interruption.
Enhancements
-
LFS routing default lowered (#70): LFS routing threshold dropped from 1 MiB to 64 KiB, moving small files to object storage — fewer commits and smaller commit bodies for large datasets.
-
Dual-constraint commit batching (#70): Batches close on operation-count target (256) or estimated request-body budget (8 MiB), clamped to the server's 2,000-action ceiling. LFS pointers no longer count against the body budget.
-
Tail-batch rebalancing (#70): Avoids a tiny final commit (e.g. 256/32 → 144/144) without adding extra commits.
-
Non-blocking capacity pre-checks (#70): Total file count, per-directory count, single-file size, and normal-file total are now warnings instead of hard errors.
-
Richer commit-plan logging (#70): Pending/skipped counts, per-batch ops, estimated bytes, and LFS share are now logged.
Fixes
-
Non-retryable commit failures no longer cause silent data loss (#70): Every terminal failure is counted, reported, blocks sync-delete, and raises
StorageError. -
409/400 commit errors now retryable (#70): "Branch changed, please retry" (409) and "commit rejected by repository policy" (400, business code 10030000001) are correctly treated as retryable instead of permanent.
-
HTTP 200 with
Success: falsenow raises (#70): Commit responses returning HTTP 200 butSuccess: falseare no longer accepted as success. -
Manual re-runs retry any uncommitted file (#70): Re-runs now retry any file not marked committed, regardless of the previous run's error type.
Refactor
- Unified commit batch planning (#70): Planning is centralized across the main loop and all recovery paths; commit-retryability is centralized into a single commit-context classifier.
Documentation
-
Add
AGENTS.mdupload-pipeline spec (#70): Mandates simulation-regression scenarios for any change to theupload_folderchain. Documents upload environment-variable semantics (advisory thresholds, batching, retry) inREADME.md. -
Update
README.md(#71): Removes outdated content from the README's News section.
What's Changed
- [Feature] Add ms agent install with a gated plugin loader by @mushenL in #68
- Upload Pipeline Reliability & Adaptive Batching by @wangxingjun778 in #70
- update readme by @wangxingjun778 in #71
Full Changelog: v0.4.4...v0.4.5