Repository navigation
Release 2.0.0
·
181 commits
to main
since this release
Immutable
release. Only release title and notes can be modified.
๐ Highlights
- Major CLI overhaul โ Several deprecated commands have been removed and renamed as part of the 2.0 cleanup:
ado show summary,ado show details,ado get measurementrequest, and the legacy migrator inado upgradeare gone.--queryis renamed to--filter, andado show entitiesis nowado show measurements. See the migration guide for details. - Provenance & versioning โ ado now records distribution package provenance on resource creation and ships full experiment and operator versioning support, giving every measurement a clear traceable lineage.
- Rich statistics everywhere โ A new
ado show statscommand and-o statsoutput mode are available across operations, spaces, sample stores, and data containers, making it easy to get a quick quantitative summary of any resource. - Trace support โ
ado show tracelets you inspect the execution trace of a space or store, surfacing how resources relate across operations.
Migration guide for ado 2.0.0: https://ibm.github.io/ado/migration/1x-to-2x/
โจ Features
CLI enhancements
- Statistics output โ
ado show statsprovides aggregated statistics across resource types. A new-o statsflag is supported byado get operation,ado get space,ado get samplestore, andado get datacontainer. - Trace commands โ
ado show traceandado show trace space/storeexpose the execution provenance graph for spaces and stores. - Non-interactive patching โ
ado editnow supports--patchand--patch-fileflags for scripted, non-interactive metadata updates. --use-latestinado getโ Convenience flag extended toado getcommands so the most recent resource is selected automatically.
Core improvements
StandardActuatorbase class โ A new base class simplifies authoring actuator plugins with minimal boilerplate.- Experiment and operator versioning โ Full versioning support for experiments and operators, with an upgrade mechanism for orchestrator references in modules.
- Provenance recording โ Distribution package provenance is captured at resource creation time and exposed through
ado provenance. - Statistics API โ New functions to calculate statistics for operations (including multi-operation aggregation), spaces, sample stores, and data containers, surfaced through
DiscoverySpaceStatistics. - Measurement filtering โ Sample stores now support server-side filtering of measurements.
- Script operation support โ
DiscoverySpacegains support for script-based operations. - Improved Ray resilience โ Detection of Ray measurement tasks that never start, plus new remote runtime setup options; improved SIGTERM shutdown handling.
- Conditional plugin model validation โ Resources can now disable plugin model validation when needed.
- Multi-operation query support โ
operation_measurement_statisticsandmeasurement_requests_for_operationboth accept multiple operation IDs. - Relationship queries โ New
get_resources_by_relationshipfunction replaces the legacy camelCase equivalents.
๐ Fixes
- CLI deletion โ
ado deleteno longer truncates output when related resources prevent deletion. - Python 3.10 compatibility โ Fixed scanning of
RECORDfiles for distributions on Python 3.10. - SIGTERM handling โ Operation shutdown is now handled correctly when SIGTERM is received mid-run.
๐งฐ Build
- Entry-point-based actuator loading โ Actuators are now loaded via Python entry points (
ado.actuators), replacing the previous discovery mechanism. - Decoupled plugin versioning โ All in-tree plugins (anomalous-series, autoconf, cplex-mip, example-actuator, profile-space, ray-tune, sfttrainer, trim, vllm-performance) now have independent version tags and are no longer coupled to the ado-core version.
- Python 3.14 support โ ado now supports Python 3.14.
- Pinned Python 3.11 โ CI is pinned to Python 3.11 as the baseline test version.
- Git tag handling โ Forward slashes in git tags are handled correctly for component versioning.
๐ Docs
- Migration guide โ A new migration guide is published on the website covering all breaking changes in 2.0.
- Installation instructions โ Updated to reflect the new entry-point plugin model.
- JOSS paper โ A citation file and JOSS badge have been added to the repository.
- Website updates โ README, website index, local context example, and roadmap have all been refreshed.
๐งน Refactoring
The following are breaking changes in this release:
- BREAKING
--queryrenamed to--filterin allado getandado showcommands. - BREAKING
ado show detailsremoved โ useado showwith the appropriate resource type. - BREAKING
ado show summaryremoved โ replaced byado show stats. - BREAKING Legacy migrator system in
ado upgraderemoved. - BREAKING
ado get measurementrequestremoved. - BREAKING
ado show entitiesrenamed toado show measurements. - BREAKING Import package renamed from
orchestratortoadoโ any code importing fromorchestratormust be updated.
Internal refactoring (no user impact):
dict_to_measurementsrenamed toobserved_property_values_from_dict.searchoperations renamed toexploreinternally.getRelatedResourceIdentifiers/getRelatedResourcesreplaced byget_resources_by_relationship.- Sample store instantiation moved to class methods.
configuration_model_defaultrenamed toexample_configurationin the plugin interface.- Experiment ID parsing unified across CLI commands.
โ๏ธ Autoconf
- Fixed a bug where
avoid_oom_recommenderdid not correctly consider the originalnumber_gpuswhen evaluating GPU configurations. - Fixed an incorrect model mapping for Llama 3.1-8b.
- Internal:
avoid_oom_recommendernow skips GPU counts fewer than the original GPU count.
๐ง SFTTrainer
- Weight download helper no longer uses Ray for execution, improving reliability in environments without a Ray cluster.
๐ vLLM Performance
- IOProcessor thread pool โ Added thread pool support for vLLM IOProcessors, improving concurrency under load.
- OpenTelemetry traces โ Full OpenTelemetry trace support for vLLM benchmark runs.
- Dependency installation in workers โ Dependencies are now installed in benchmark execution workers at runtime.
- Fixed propagation of
max_batch_tokens,gpu_memory_utilization,dtype,cpu_offload, andmax_num_seqwhen creating a deployment. - Fixed deletion of deployments that time out during creation.
- Fixed
TypeErrorwhen parsingrenderer_num_workers.
โ๏ธ TRIM
No user-visible changes in this release cycle beyond build and versioning decoupling.
๐งฎ CPLEX-MIP
- New CPLEX-MIP operator โ Added a custom experiment for solving Mixed-Integer Programming problems using CPLEX.
- Warm start & memory handling โ Added warm start support and improved memory management for large MIP problems.
๐จ Detect Anomalous Series
No user-visible changes in this release cycle beyond build and versioning decoupling.
Full Changelog: 1.8.0...2.0.0