Skip to content

euclidkit release v0.2.0

Choose a tag to compare

@rudolffu rudolffu released this 02 Mar 16:52
· 18 commits to main since this release

euclidkit v0.2.0

First public release of euclidkit, a toolkit for Euclid archive access and downstream workflows on ESA Datalabs.

Highlights

  • Added end-to-end CLI workflow for Euclid archive usage:
    • crossmatch
    • query-spectra
    • query-cutana
    • compile-spectra
    • upload-table
  • Added Cutana input generation from local source tables (object IDs or coordinates).
  • Added spectra compilation in both:
    • canonical mode (local Datalabs FITS paths), and
    • datalink mode (--use-datalink) for direct archive retrieval.
  • Added resumable spectra compilation (default behavior) with correct continuation even if previous runs used different chunk sizes.
  • Added optional chunk-level parallelism in canonical compilation (--workers).
  • Added robust metadata generation for compiled spectra chunks.
  • Added async crossmatch improvements:
    • object-id mode logging cleanup,
    • attempted async result download,
    • fallback async job-info sidecar when direct download is unavailable.
  • Expanded crossmatch output columns to include:
    • point_like_prob
    • extended_prob
  • Updated default spectra chunk size to 1000.
  • Added Sphinx + Read the Docs documentation scaffold and user guides.
  • Updated project licensing to BSD 3-Clause for public release/compliance.

Documentation and project setup

  • Added/expanded online docs pages for:
    • installation
    • configuration and secure credential handling
    • archive environments and IDR fields (WIDE/DEEP)
    • CLI reference
    • spectra compilation guidance and troubleshooting
    • API overview

Notes

  • For canonical compilation on shared Datalabs storage, --workers 1 is typically more stable than --workers 2 due to I/O contention; benchmark on your setup.
  • In datalink mode, schema defaults to sedm for spectra retrieval.
  • --full-async crossmatch may now produce either:
    • direct table output (when download succeeds), or
    • job metadata sidecar (.job.json) if download is not immediately available.