Skip to content

v0.5.0

Choose a tag to compare

@kirkrodrigues kirkrodrigues released this 22 Aug 02:36
· 538 commits to main since this release

A release that includes support for configuring retention periods for archives, deleting datasets entirely, and some other features and bug fixes.

Note

This release includes some changes that are incompatible with previous releases. If this affects you, reach out and we may be able to help with version migration. These changes are marked with "Breaking".

This release includes two tars:

  • clp-json for compressing and searching JSON logs
  • clp-text for compressing and searching unstructured text logs

Docs

The docs for this release are available here.

New features

  • clp-json/clp-text: Add support for configuring retention periods for archives and search results. (#1035, #1181, #1205, #1231)
  • clp-json: Add dataset-manager tool to support listing datasets, and deleting them entirely. (#1144, #1215, #1225)

Bug fixes & improvements

  • clp-json/clp-text: Fix scheduler freezes by updating celery to 5.5.3 with the redis extra (replacing the direct redis dependency) (fixes #1059). (#1213)
  • clp-json/clp-text: Remove dependency on native libraries for scripts run on the host (fixes #895, #1185). (#1105, #1197)
  • core-clp: Preserve escaped ?-wildcards in queries (fixes #243). (#1070)
  • core: Unify clp-s and clp’s unstructured text parsing and search code. (#1101, #1103, #1112, #1138, #1143, #1163)
    • Breaking: This is a change to the archive format used by clp-json (and the core clp-s binary).
  • webui: Delete old search results after 60min by default. (#1231)
    • Breaking: Previously, the results of the last query executed before refreshing the page would be retained indefinitely.
  • webui: Update query time range on any change in the UI to prevent query submission with out-of-date time range. (#1171)
  • webui: Focus/refocus query input box for ease of use. (#1160)
  • clp-json/clp-text: Only mount stream_output_dir when stream storage type is FS, to allow running the webui on a different node when using S3 storage. (#1129)
  • clp-json/clp-text: Explicitly convert enum to integer to ensure accurate conversions when using the mysql Python library. (#1133)
  • webui: Cast BIGINT values as UNSIGNED to fix MySQL-specific type errors in dashboard stats queries (fixes #1137). (#1136)
  • clp-json/clp-text: Mark incomplete jobs as failed when schedulers restart. (#1208)
  • clp-json/clp-text: Add verbose logging option to archive_manager and simplify output on errors. (#1173)
  • clp-json/clp-text: Add query_engine option to clp-config.yml to support starting only compression and UI components when using the Presto query engine. (#1095)
    • Breaking: This is a change to clp-json/clp-text’s config file format.
  • core: Replace YAML config with CLI args and env vars for metadata DB. (#1148)
    • Breaking: This is a change to how the core clp/clp-s binaries can be configured to use a MySQL-based database (the change is transparent to clp-json/clp-text users).
  • core: Address CVE-2024-3094 and CVE-2025-31115 for xz/lzma dependency (fixes #1093). (#1094)

View the full changelog for more details.

Thanks to @anlowee, @Bill-hbrhbr, @davemarco, @davidlion, @gibber9809, @haiqi96, @hoophalab, @jackluo923, @junhaoliao, @kirkrodrigues, @LinZhihao-723, @quinntaylormitchell, @SharafMohamed, and @wraymo for their contributions.