Skip to content

2.1.0

Choose a tag to compare

@lamongabriel lamongabriel released this 16 May 10:59
· 10 commits to main since this release

πŸš€ Sync to Cloud v2.1 – Shared Drives, Native Files & Performance Upgrades

Release date: May 16, 2025
Version: v2.1.0

Highlights

This release introduces major improvements in performance, shared drive support, error handling, and user experience. We’ve refactored several core components and added monitoring tools to improve stability and visibility across environments.


✨ New Features

  • Shared Drive Support
    Now fully supports transfers from both user and shared drives, including batch processing and access validations.

  • Native File Extension Handling
    Automatically appends correct extensions for native Google file types (Docs, Sheets, etc.) to avoid misclassification by tools like rclone.

  • Environment-Aware Deployments
    Cloud Run job triggers now support both production and staging environments with dedicated artifact registries.

  • Custom Sorting & UI Filtering
    Enhanced the UI with custom sorting for statuses and new filters for failed transfers, labels, and buckets.


βš™οΈ Improvements & Refactors

  • Worker Refactor
    Complete redesign of the sync-to-cloud worker for modularity and clarity.
    Includes a new validation service, improved logging, and initializers for Firestore, BigQuery, and GCS clients.

  • BigQuery Performance Enhancements
    Optimized queries to fetch only required fields and handle missing file edge cases.
    Introduced parallel batch processing using ThreadPoolExecutor.

  • Drive API Resilience
    Added retry logic and improved error handling for transient issues like 404s and timeouts.

  • Logging & Monitoring

    • Added dynamic log level configuration via environment variables.
    • Introduced resource monitoring (CPU, memory) at key execution points using psutil.
  • Cleaner Build Pipelines
    Removed unnecessary steps in Cloud Build configs and updated .dockerignore & .gitignore.


πŸ› Fixes

  • Adjusted timeouts in API and UI to prevent premature failures.
  • Fixed race conditions on repeated update attempts in the UI using localStorage debounce.
  • Various UI and backend adjustments for status, details, and bucket handling.

πŸ“¦ Dev & Misc

  • Added example inventory report files for shared drives and user files.
  • Removed outdated Rclone job creator docs.
  • Added Firestore cleanup script for dev environments.

Thanks to all contributors involved in this release:
@lamongabriel @spencexyz @iuryescano

Full Changelog: https://github.com/automatearmy/sync-to-cloud-deploy/commits/2.1.0

Full Changelog: https://github.com/automatearmy/sync-to-cloud-deploy/commits/2.1.0