Repository navigation
Changelog
Added
-
Annotations
- A new "Annotation classes" tab in the settings to add, find, rename, recolor and delete the annotation classes of a dataset.
- Annotation class colors are saved in the dataset and shared by all users of it.
-
Filtering
- Filter samples by evaluation run and per-sample metrics in the GUI query filter using
sample_evaluation(...). - Type exact minimum and maximum filter values alongside the sliders for numeric metadata, image and video dimensions, video frame numbers, FPS, and duration.
- Typing
(,[,"or'in the query editor wraps the selected text in that pair.
- Filter samples by evaluation run and per-sample metrics in the GUI query filter using
-
Evaluation
- Python SDK: Compute per-class and mean average precision for object detection with
compute_average_precision=TrueinObjectDetectionEvaluationConfig. Read the results withdataset.evaluate().metrics(run_id), averaged over IoU thresholds 0.50 to 0.95 and at each threshold.
- Python SDK: Compute per-class and mean average precision for object detection with
-
Embedding plot
- The embedding plot shows the active plot filter and lets you clear it right on the plot.
-
Other
- Python SDK: Added Python 3.15 support.
Changed
-
Annotations
- The class for new annotations is remembered per collection across browser sessions and follows class renames and deletions. Selecting an existing annotation no longer changes it.
- Users with the labeler or viewer role can only choose existing annotation classes in the labeling tools.
- BREAKING: Annotation classes have new database fields for their custom color. DuckDB databases created with an earlier version are not upgraded and stop working. Re-index your data. Enterprise users are not affected.
-
Embedding plot
- Embedding plots color faster when no filters are active and when coloring image and crop embeddings by annotation class.
-
Other
- Python SDK: BREAKING: Upgraded scikit-learn to 1.9.1 on Python 3.11 and newer. Retrain saved random-forest classifiers created with scikit-learn 1.7.2 before loading them in the upgraded environment.
- Python SDK: BREAKING:
multi_strategiesaccepts only the built-in sampling strategies, andSamplingStrategyis removed. Type strategy lists asSequence[Strategy]fromlightly_studio.sampling.sampling_config.
Fixed
-
Annotations
- Renaming an annotation class that has annotations no longer fails on DuckDB. If your DuckDB database was created before this version, re-index your data to get the fix.
- Smart select stays active when you select a segmentation mask or change its class in the sample details sidebar.
- Zooming with the mouse wheel or trackpad works while the Smart select tool is active.
- Parts of a segmentation mask stroke that land on locked annotations no longer trim other annotations' masks.
-
Filtering
- The browser no longer freezes when a collection has an integer metadata field with a very wide range, such as an ID.
- The value counts of categorical metadata now match the filters of the images grid.
What's Changed
- Validate evaluation query serialization and scope by @lukas-lightly in #3011
- Upgrade scikit-learn to 1.9.1 on Python 3.11+ by @lukas-lightly in #3003
- Test sample evaluation filters through the API by @lukas-lightly in #3012
- Fix: Rename annotation classes that have annotations on DuckDB by @michal-lightly in #3008
- Cap integer metadata slider ticks to stop the browser freezing by @mrpositron in #3017
- Add Python 3.15 support by @lukas-lightly in #2973
- Add: Annotation classes tab in the settings by @michal-lightly in #2954
- Override handlebars to 4.7.10+ to fix security alerts by @iunir in #3025
- Bump pypa/gh-action-pypi-publish to v1.14.3 by @iunir in #3035
- Bump GitPython to 3.2.1 by @iunir in #3031
- Bump PyJWT to 2.15.1 by @iunir in #3033
- Bump brotli to 1.2.1 by @iunir in #3034
- Bump anyio to 4.16.0 by @iunir in #3032
- Bump pyasn1 to 0.6.5 by @iunir in #3038
- Bump urllib3 to 2.8.0 by @iunir in #3037
- Bump joserfc to 1.7.7 by @iunir in #3039
- Bump graphql-core to 3.2.13 by @iunir in #3040
- Bump aiohttp to 3.14.5 by @iunir in #3036
- Bump pillow to 12.3.0 on Python 3.10 by @iunir in #3043
- Bump tinypool to 2.2.0 by @iunir in #3042
- Bump storybook to 10.6.5 by @iunir in #3046
- Bump fsspec to 2026.9.0 by @iunir in #3041
- Bump devalue to 5.9.4 by @iunir in #3044
- Bump cryptography to 50.0.2 by @iunir in #3050
- Bump oauthlib to 4.0.1 by @iunir in #3051
- Bump @actions/github to 9.1.1 by @iunir in #3048
- Bump dompurify to 3.4.17 by @iunir in #3045
- Bump pymdown-extensions to 11.0.2 by @iunir in #3052
- Bump vite to 6.4.5 and 7.3.7 by @iunir in #3055
- Cleanup: Use Popover for the color picker by @michal-lightly in #3020
- Cleanup: Use d3-color for the color picker's color state by @michal-lightly in #3021
- Cleanup: Saturation box component for the color picker by @michal-lightly in #3022
- Cleanup: Split the color picker panel by @michal-lightly in #3023
- Bump filelock to 4.2.7 by @iunir in #3067
- Design and plan: annotation class colors in the DB by @michal-lightly in #3018
- Share the MCAP sequence grid query scope and order by @horatiualmasan in #3026
- Apply the grid filters and text search to MCAP sequence adjacents by @horatiualmasan in #3027
- Accept the grid filters and text search in MCAP sequence adjacents by @horatiualmasan in #3029
- Send the grid filters to MCAP sequence prev/next by @horatiualmasan in #3030
- Bump simple-git to 4.0.2 by @iunir in #3047
- Bump postcss to 8.5.32 by @iunir in #3053
- Bump brace-expansion, js-yaml, browserslist and form-data by @iunir in #3066
- Test annotation evaluation filters through the API by @lukas-lightly in #3013
- Add: Color columns for annotations by @michal-lightly in #3056
- Add: Resolver to set an annotation class color by @michal-lightly in #3057
- Add: Endpoint to set an annotation class color by @michal-lightly in #3058
- Bump black to 26.10.1 by @iunir in #3049
- Bump werkzeug to 3.1.9 by @iunir in #3078
- Bump requests to 2.34.2 by @iunir in #3079
- Add sample evaluation query grammar and translation by @lukas-lightly in #3070
- Decode camera RGB colors from sRGB to linear by @horatiualmasan in #3071
- Fix quoted evaluation metric autocomplete replacement by @lukas-lightly in #3084
- Upgrade vitest to 4 and remove the tinypool override by @iunir in #3054
- Keep Smart Select active when selecting a mask in the sidebar by @iunir in #3085
- Add sample evaluation query editor assistance by @lukas-lightly in #3087
- Fix: Annotation class color picker seed and button name by @michal-lightly in #3072
- Refactor: Extract the custom color store into a factory by @michal-lightly in #3073
- Bump idna to 3.20 by @iunir in #3082
- Bump starlette to 1.3.1 and fastapi to 0.133.0 by @iunir in #3086
- Bump pytest to 9.2.0 by @iunir in #3081
- Refactor: Keep color previews in a separate layer by @michal-lightly in #3074
- Refactor: Color annotations by source through getColorBySource by @michal-lightly in #3075
- Fix: Keep annotation source colors in their own store by @michal-lightly in #3076
- Refactor: Pass the source name to AnnotationCanvas in its own field by @michal-lightly in #3090
- Add collection transport protocol by @iunir in #3060
- Refactor: Let the color picker save changes asynchronously by @michal-lightly in #3093
- Save annotation class colors in the dataset by @michal-lightly in #3094
- Load annotation class colors from the dataset by @michal-lightly in #3095
- Add Storybook stories for the color picker by @michal-lightly in #3103
- feat: store per-class average precision of object-detection runs by @lorinczszabolcs in #2976
- Document annotation class settings and colors by @michal-lightly in #3102
- Track annotation class management in PostHog by @michal-lightly in #3105
- Fix: Align labeling tool UI and organize manual tools by @IgorSusmelj in #3114
- Skip the whole E2E run when the file hash already passed by @iunir in #2500
- Log runner hardware and test timings in CI by @michal-lightly in #3106
- Show mcap sequence tags in the details page by @horatiualmasan in #3112
- Update migration script template by @mihnea-necsulescu in #3146
- Fix: Speed up embedding coloring without filters by @IgorSusmelj in #3148
- Igor speed up coloring embeddings by annotation by @IgorSusmelj in #3149
- feat(point clouds): group annotations by parent track in the right panel by @LeonardoRosaa in #3000
- Fix: Simplify embedding coloring by metadata by @IgorSusmelj in #3150
- feat: read per-class and mean average precision in metrics() by @lorinczszabolcs in #2977
- Add browser coverage for sample evaluation queries by @lukas-lightly in #3089
- Count categorical metadata values with the images-grid filter by @JonasWurst in #3156
- Add reusable exact numeric range inputs by @lukas-lightly in #3191
- Fix wheel and trackpad zoom with Smart select by @mrpositron in #3192
- Add spec and plan: only editors create annotation classes by @michal-lightly in #3131
- Add useCanCreateAnnotationClass hook by @michal-lightly in #3137
- Let SelectList hide class creation by @michal-lightly in #3138
- Hide class creation in pickers below editor by @michal-lightly in #3139
- Block class creation on async class removal by @michal-lightly in #3140
- Add one check for an enterprise server by @iunir in #3113
- Add localStorage, API error message and key press helpers by @gabrielfruet in #3115
- Share the annotation query refresh and add delete with undo by @gabrielfruet in #3116
- Add: Read the user and role from auth proxy headers by @iunir in #3015
- Document that only editors create annotation classes by @michal-lightly in #3197
- Add a plot filter chip inside the embedding plot by @JonasWurst in #3019
- Drop the Python 3.10 recommendation for plugins by @michal-lightly in #3201
- Add: Require a minimum role for a route by @iunir in #3129
- Add overwrite flag to enable replacing annotations by @horatiualmasan in #3198
- Add FilterList helpers, row and action buttons by @JonasWurst in #3157
- Add the shared FilterList component by @JonasWurst in #3158
- Add StudioTransport and the active transport by @iunir in #3061
- Delete empty object tracks when overwriting annotations by @horatiualmasan in #3202
- Reuse deleted track numbers by @horatiualmasan in #3203
- Remove unused useDistributionPanel hook and its components by @michal-lightly in #3205
- Return collections without their children from the transport by @iunir in #3110
- Highlight points in selected cuboid by @ikondrat in #3098
- Keep the class for new annotations across reloads and renames by @gabrielfruet in #3117
- Upgrade @hey-api/openapi-ts to 0.99.0 by @iunir in #3199
- Use FilterList for the tag filter by @JonasWurst in #3159
- Add sample, tag and metadata transport protocols by @iunir in #3062
- Stop strokes on locked masks from trimming other masks (STU-25) by @michal-lightly in #3214
- Cleanup: Reduce complexity of the segmentation brush finish step (STU-25) by @michal-lightly in #3215
- Use FilterList for the annotation class filter by @JonasWurst in #3160
- Allow exact value input for numeric metadata filters by @lukas-lightly in #3194
- Allow exact image dimensions and video frame filters by @lukas-lightly in #3195
- Allow exact video dimensions, FPS, and duration filters by @lukas-lightly in #3196
- Introduce object track timeline initial version by @ikondrat in #3091
- Fix cuboid face resize moving the opposite side by @horatiualmasan in #3229
- Add annotation and ingestion transport protocols by @iunir in #3063
- Speed up Postgres backend tests with a single TRUNCATE by @michal-lightly in #3235
- Add compute and export transport protocols by @iunir in #3064
- Wrap selected text in the query editor when typing a bracket or quote by @mrpositron in #3241
- Support implicit collection scope in query parsing and validation by @lukas-lightly in #3260
- refactor: enforce the X | Y union syntax with ruff by @iunir in #3271
- Type the sampling strategies as the discriminated union by @iunir in #3111
- docs: update the pull-requests skill with the repository rules by @iunir in #3266
- improve buffering UX by @ikondrat in #3237
- Run Postgres E2E tests only in the merge queue by @michal-lightly in #3238
- Apply collection scope throughout the query editor by @lukas-lightly in #3244
- Improve point cloud camera navigation by @horatiualmasan in #3239
- fix: support numeric video queries by @lukas-lightly in #3276
- feat: apply query expressions throughout video filtering by @lukas-lightly in #3245
- Respect plot selection in image distributions and class counts by @michal-lightly in #3217
- refactor: enforce no assert outside tests with ruff by @iunir in #3278
- Respect plot selection in video distributions and class counts by @michal-lightly in #3218
- Say "all" in the operator scope when no filter is set by @michal-lightly in #3219
- refactor: pass query state into shared controls by @lukas-lightly in #3277
- refactor: enforce more python-guide rules with ruff by @iunir in #3282
- Bump lightly-studio version to 1.3.0 by @github-actions[bot] in #3279
Full Changelog: v1.2.1...v1.3.0
Released by @lukas-lightly