2.1.0
π Sync to Cloud v2.1 β Shared Drives, Native Files & Performance Upgrades
Release date: May 16, 2025
Version: v2.1.0
Highlights
This release introduces major improvements in performance, shared drive support, error handling, and user experience. Weβve refactored several core components and added monitoring tools to improve stability and visibility across environments.
β¨ New Features
-
Shared Drive Support
Now fully supports transfers from both user and shared drives, including batch processing and access validations. -
Native File Extension Handling
Automatically appends correct extensions for native Google file types (Docs, Sheets, etc.) to avoid misclassification by tools likerclone. -
Environment-Aware Deployments
Cloud Run job triggers now support bothproductionandstagingenvironments with dedicated artifact registries. -
Custom Sorting & UI Filtering
Enhanced the UI with custom sorting for statuses and new filters for failed transfers, labels, and buckets.
βοΈ Improvements & Refactors
-
Worker Refactor
Complete redesign of the sync-to-cloud worker for modularity and clarity.
Includes a new validation service, improved logging, and initializers for Firestore, BigQuery, and GCS clients. -
BigQuery Performance Enhancements
Optimized queries to fetch only required fields and handle missing file edge cases.
Introduced parallel batch processing usingThreadPoolExecutor. -
Drive API Resilience
Added retry logic and improved error handling for transient issues like 404s and timeouts. -
Logging & Monitoring
- Added dynamic log level configuration via environment variables.
- Introduced resource monitoring (CPU, memory) at key execution points using
psutil.
-
Cleaner Build Pipelines
Removed unnecessary steps in Cloud Build configs and updated.dockerignore&.gitignore.
π Fixes
- Adjusted timeouts in API and UI to prevent premature failures.
- Fixed race conditions on repeated update attempts in the UI using localStorage debounce.
- Various UI and backend adjustments for status, details, and bucket handling.
π¦ Dev & Misc
- Added example inventory report files for shared drives and user files.
- Removed outdated Rclone job creator docs.
- Added Firestore cleanup script for dev environments.
Thanks to all contributors involved in this release:
@lamongabriel @spencexyz @iuryescano
Full Changelog: https://github.com/automatearmy/sync-to-cloud-deploy/commits/2.1.0
Full Changelog: https://github.com/automatearmy/sync-to-cloud-deploy/commits/2.1.0