Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add versioning scheme and fix GitHub issues #44

Merged
merged 1 commit into from
Feb 16, 2023

Conversation

renatolfc
Copy link
Contributor

@renatolfc renatolfc commented Feb 16, 2023

In this PR, we introduce a versioning scheme and start syncing our docker image
tags to that version.

Doing so will prevent breaking users' clusters when we introduce breaking
changes to the back-end images.

Additionally, we now introduce the update command, which both updates the
vibe-core library in Python, and also syncs images in the local cluster.

We also fixed a DNS issue that could happen in some environments, which
prevented workflows from running, because the cluster would end up without
a proper resolver.

This PR fixes:

Further changes are:

Script

  • [馃帀 NEW] The update command supersedes the update-images command, and
    manages the Python library automatically
  • [馃搱 IMPROVEMENT] We now use automatic retries by default when downloading
    binaries for cluster setup

Client

  • [馃搱 IMPROVEMENT] We now show the total run duration in the monitor header

Workflows

  • [馃帀 NEW] We added a new workflow that downloads MODIS 8-day surface
    reflectance rasters that intersect with the input geometry and time range
  • [馃帀 NEW] We added a new workflow to download gNATSGO raster data that
    intersect with the input geometry and time range
  • [馃搱 IMPROVEMENT] We added a step parameter to the chunk_onnx workflow to
    tune the step size of chunking
  • [鈿掞笍 FIX] We updated the linear_trend op to define the write_rel_limits
    attribute in RasterChunk

Notebooks

  • [鈿掞笍 FIX] We updated the crop_cycle notebook to use the step parameter to
    prevent errors when computing cycles with small regions
  • [鈿掞笍 FIX] We fixed the land_degradation notebook with our fix to the
    linear_trend op
  • [鈿掞笍 FIX] We updated the scenario.json file to match changes to the
    COMET-Farm API in the carbon whatif notebook
  • [鈿掞笍 FIX] We updated the wf_viz_crop_seg.yaml file with the correct sink name for the SpaceEye task
  • [馃搱 IMPROVEMENT] The carbon whatif notebook now uses the monitor, instead of
    block_until_complete
  • [馃搱 IMPROVEMENT] We ported the DeepMC notebook from Tensorflow to PyTorch

Backend

  • [馃搱 IMPROVEMENT] We now add traceparent
    headers to our cloudevents, enabling better inspection of messaging in our
    clusters
  • [馃搱 IMPROVEMENT] We now only deploy services in the cluster after images
    have been downloaded, making cluster creation 20% faster in our local
    tests
  • [馃搱 IMPROVEMENT] We added an in-memory reader for ChipDataset
  • [馃搱 IMPROVEMENT] We centralized hash computation, and improved our
    messaging system to pass cache information in messages, paving the way for
    improved caching mechanisms

Documentation

  • [馃帀 NEW] We added a new entry to the troubleshooting guide describing what
    to do when your containers run out of space

Co-authored-by: Alex Crown acrown@microsoft.com
Co-authored-by: Bruno Silva brunosilva@microsoft.com
Co-authored-by: Eduardo Rodrigues edrodrigues@microsoft.com
Co-authored-by: Naga Bilwanth Gangarapu Naga@zensa.co
Co-authored-by: Nalin Singal nasingal@microsoft.com
Co-authored-by: Rafael Padilha rpadilha@microsoft.com
Co-authored-by: Renato Luiz de Freitas Cunha renato.cunha@microsoft.com

Co-authored-by: Alex Crown <acrown@microsoft.com>
Co-authored-by: Bruno Silva <brunosilva@microsoft.com>
Co-authored-by: Eduardo Rodrigues <edrodrigues@microsoft.com>
Co-authored-by: Naga Bilwanth Gangarapu <Naga@zensa.co>
Co-authored-by: Nalin Singal <nasingal@microsoft.com>
Co-authored-by: Rafael Padilha <rpadilha@microsoft.com>
Co-authored-by: Renato Luiz de Freitas Cunha <renato.cunha@microsoft.com>
@renatolfc renatolfc marked this pull request as ready for review February 16, 2023 16:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants