Skip to content

Releases: rudolffu/euclidkit

euclidkit release v0.2.2

20 May 15:39
@rudolffu rudolffu
v0.2.2
083dd47

Choose a tag to compare

View all tags
euclidkit release v0.2.2 Latest
Latest

euclidkit v0.2.2

This release updates euclidkit for the latest IDR WIDE MER catalogue layout and improves large async crossmatch behavior.

Changed

  • IDR WIDE MER queries now use both catalogue.mer_catalogue_wide_survey and catalogue.mer_catalogue_wide_mode.
  • Results from the two WIDE MER catalogues are combined and deduplicated by object ID, with wide_survey taking priority.
  • crossmatch, --user-table-name, and query-cutana automatically use the split WIDE catalogues when -e IDR --idr-field WIDE is selected.
  • Async crossmatch metadata now uses timezone-aware UTC timestamps.

Notes

  • No CLI changes are required.
  • Explicit Python API mer_table=... overrides still query only the provided MER table.
Assets 2
Loading

euclidkit release v0.2.0

02 Mar 16:52
@rudolffu rudolffu
v0.2.0
4fb5ec9

Choose a tag to compare

View all tags
euclidkit release v0.2.0

euclidkit v0.2.0

First public release of euclidkit, a toolkit for Euclid archive access and downstream workflows on ESA Datalabs.

Highlights

  • Added end-to-end CLI workflow for Euclid archive usage:
    • crossmatch
    • query-spectra
    • query-cutana
    • compile-spectra
    • upload-table
  • Added Cutana input generation from local source tables (object IDs or coordinates).
  • Added spectra compilation in both:
    • canonical mode (local Datalabs FITS paths), and
    • datalink mode (--use-datalink) for direct archive retrieval.
  • Added resumable spectra compilation (default behavior) with correct continuation even if previous runs used different chunk sizes.
  • Added optional chunk-level parallelism in canonical compilation (--workers).
  • Added robust metadata generation for compiled spectra chunks.
  • Added async crossmatch improvements:
    • object-id mode logging cleanup,
    • attempted async result download,
    • fallback async job-info sidecar when direct download is unavailable.
  • Expanded crossmatch output columns to include:
    • point_like_prob
    • extended_prob
  • Updated default spectra chunk size to 1000.
  • Added Sphinx + Read the Docs documentation scaffold and user guides.
  • Updated project licensing to BSD 3-Clause for public release/compliance.

Documentation and project setup

  • Added/expanded online docs pages for:
    • installation
    • configuration and secure credential handling
    • archive environments and IDR fields (WIDE/DEEP)
    • CLI reference
    • spectra compilation guidance and troubleshooting
    • API overview

Notes

  • For canonical compilation on shared Datalabs storage, --workers 1 is typically more stable than --workers 2 due to I/O contention; benchmark on your setup.
  • In datalink mode, schema defaults to sedm for spectra retrieval.
  • --full-async crossmatch may now produce either:
    • direct table output (when download succeeds), or
    • job metadata sidecar (.job.json) if download is not immediately available.
Loading