Repository navigation
v1.2.1
Changelog
Added
-
Annotations
- Label with the "Smart select" and "Find all instances" assisted labeling tools in the sample details view, which save results as segmentation masks or bounding boxes. The tools use SAM 3 on fal.ai, need the
falextra (pip install "lightly-studio[fal]") and theFAL_KEYenvironment variable, and send images to fal.ai. - Delete selected annotations in bulk from the annotation grid.
- Set the opacity of segmentation masks with the "Mask opacity" slider in the sample details view.
- Reset brightness, contrast, and mask opacity to their defaults with one button in the sample details view.
- Label with the "Smart select" and "Find all instances" assisted labeling tools in the sample details view, which save results as segmentation masks or bounding boxes. The tools use SAM 3 on fal.ai, need the
-
Filtering
- See histograms of the image width and height in the distribution panel of image datasets, and compare them by tag. Select a range on a histogram to filter the images by width or height.
- Use metadata and boolean values in the query editor, with hover help and a metadata filter example.
-
Other
- Python SDK:
connect()trusts the custom CA certificates of an S3-compatible storage when the enterprise instance provides them.
- Python SDK:
Changed
-
Embedding plot
- Saved embedding plots now load in milliseconds instead of seconds on datasets with over 100k samples.
-
Settings
- The settings dialog is organized in tabs.
- "Save changes" in the settings dialog is enabled only when there are changes to save.
-
Other
- The sample details view keeps collapsed and hidden annotation sources when you go to another sample. A page reload restores the defaults.
- DuckDB database files retain a format readable by DuckDB 1.x when created or updated with DuckDB 2.x.
Removed
- BREAKING: Dropped Python 3.9 support. Upgrade to Python 3.10–3.14.
Fixed
-
Annotations
- Labeling with superpixels no longer skips cells or leaves pixels behind.
- Existing selections no longer disappear while you paint with superpixels, and selecting many cells is faster.
- Brush, eraser, and box drawing previews now use the custom color of the label.
- In the annotation grid, changing the class after "Select all" now changes every selected annotation, not only the first 100. The selected annotations count and undo also cover all of them.
- In Safari, the image in the details view has the correct size again, so annotations and labeling tools line up with it and show on top of it.
-
Filtering
- The header of the filters panel, with the button to hide the panel, stays visible when you scroll the filters. You no longer have to scroll back to the top to hide the panel.
- In the distribution panel, metadata bars now include images without annotations. Before, those images showed as filtered out even with no filters set.
- The distribution panel keeps the selected plot when you open a sample and go back to the grid.
-
Other
- In the settings dialog, pressing Escape while setting a shortcut now cancels the change instead of closing the dialog. The "Go back" shortcut is now always Escape and can no longer be changed.
- Exporting from the export dialog no longer fails on Windows.
- Python SDK:
add_samples_from_coconow shows the real cause when it cannot read the annotations file from cloud storage.
What's Changed
- Add: Smart select preview logic by @iunir in #2834
- feat: add the evaluation class metric table by @lorinczszabolcs in #2381
- Fix: Scale the sample image correctly in Safari by @iunir in #2915
- Add: Smart select overlay and pop-up by @iunir in #2835
- Add: Smart select tool by @iunir in #2836
- Add context-aware metadata query completions by @lukas-lightly in #2920
- Add metadata query hover help and editor example by @lukas-lightly in #2921
- Docs: Explain metadata query filtering and missing values by @lukas-lightly in #2922
- feat(point cloud): edit cuboid geometry from annotation details panel by @LeonardoRosaa in #2904
- Introduce annotations and point cloud projection on camera strips by @ikondrat in #2887
- Add: Bulk delete annotations by filter endpoint by @JonasWurst in #2861
- Make the settings dialog wider and tabbed by @michal-lightly in #2923
- Add: Find all instances preview logic by @iunir in #2837
- feat: keep collapsed and hidden annotation sources when switching samples by @lorinczszabolcs in #2800
- Add: Find all instances overlay by @iunir in #2838
- Run CI on Python 3.10 instead of 3.9 by @JonasWurst in #2933
- Add: Find all instances pop-up by @iunir in #2839
- Add: useBulkDeleteAnnotations hook by @JonasWurst in #2862
- Add: Storage for saved embedding plots by @IgorSusmelj in #2934
- Add: Find all instances tool by @iunir in #2840
- Add: Changelog entry for assisted labeling by @iunir in #2841
- Fix: use strftime in export filename to avoid colons on Windows by @LeonardoRosaa in #2932
- feat(point cloud): add scale gizmo handles to cuboid face resize by @LeonardoRosaa in #2924
- Cancel shortcut setting on Escape instead of closing the settings dialog by @michal-lightly in #2925
- Enable Save changes in settings only when there are changes by @michal-lightly in #2931
- Add: Mark saved embedding plots dirty when embeddings change by @IgorSusmelj in #2936
- Add: Reuse saved plots without scanning source vectors by @IgorSusmelj in #2939
- Add: Return unfiltered plots without another sample lookup by @IgorSusmelj in #2940
- Fix: Remove the unused embedding plot cache table by @IgorSusmelj in #2941
- Bump Playwright to the latest version by @mihnea-necsulescu in #2942
- Fix: Hide assisted labeling tools when fal.ai is unavailable by @iunir in #2946
- Add design and plan for the annotation classes settings tab by @michal-lightly in #2937
- Add: List annotation classes with their annotation counts by @michal-lightly in #2948
- Add: Bulk delete annotations button and confirmation dialog by @JonasWurst in #2863
- Cleanup: Stop reading the old Go back key setting by @michal-lightly in #2957
- Fix: Iterate on superpixel labeling UX by @IgorSusmelj in #2943
- Add: Delete annotations together with their annotation class by @michal-lightly in #2949
- Fix: Color picker inside a modal dialog by @michal-lightly in #2950
- Add: Hook to manage annotation classes by @michal-lightly in #2951
- Add: Delete annotation class dialog by @michal-lightly in #2952
- Refactor: Extract shared histogram bin helpers by @JonasWurst in #2965
- Drop Python 3.9 support by @lukas-lightly in #2961
- Introduce synchronized orthographic projection views by @ikondrat in #2938
- Add: Bulk relabel annotations endpoints by @JonasWurst in #2944
- Add: Image width and height histograms resolver by @JonasWurst in #2966
- Add mask opacity slider and reset button to image adjustments by @mrpositron in #2971
- Use the mask opacity setting for brush and eraser previews by @mrpositron in #2972
- Add: Image width and height histograms endpoint by @JonasWurst in #2960
- Add: Section headings in the distribution group picker by @JonasWurst in #2967
- Add: Hook for image width and height histograms by @JonasWurst in #2968
- Report assisted labeling usage by @iunir in #2806
- Add usage reporter by @iunir in #2809
- Add: Compare image width and height by sample tag by @JonasWurst in #2969
- Count images without annotations in metadata distribution bars by @mrpositron in #2980
- Keep the selected distribution plot after opening a sample by @mrpositron in #2983
- Fix: Relabel all selected annotations, not only loaded ones by @JonasWurst in #2945
- Introduce point cloud accumulation by @ikondrat in #2981
- Add: Write cuboid labels as a Foxglove SceneUpdate MCAP by @horatiualmasan in #2984
- Add: Image width and height in the distribution panel by @JonasWurst in #2962
- Rename LIGHTLY_STUDIO_CONTROL_PLANE_TOKEN to LIGHTLY_STUDIO_SERVICE_TOKEN by @iunir in #2995
- Add: Read MCAP metadata records and share cuboid frame mapping by @horatiualmasan in #2985
- Add: Bulk resolvers for the MCAP sequence export by @horatiualmasan in #2987
- Add: Map cuboids of many ticks with preloaded transforms by @horatiualmasan in #2988
- Add: Build SceneUpdate labels for an MCAP sequence by @horatiualmasan in #2989
- Fix: Slic: investigate skipped regions and inconsistent coarse fine cells by @IgorSusmelj in #2996
- Add: Write and upload SceneUpdate annotation files for MCAP sequences by @horatiualmasan in #2990
- Add: Python API to export MCAP labels as SceneUpdate annotation files by @horatiualmasan in #2991
- Add: API routes to export MCAP labels as SceneUpdate annotation files by @horatiualmasan in #2992
- Add: SceneUpdate export tab by @horatiualmasan in #2993
- Add: Export MCAP sequences from the collection export dialog by @horatiualmasan in #2994
- Introduce rgb projection from cameras onto the point cloud by @ikondrat in #2997
- feat(point cloud): allow changing the annotation class of a cuboid by @LeonardoRosaa in #2958
- Prepare DuckDB 2.x support for Python 3.15 by @lukas-lightly in #2979
- Report access errors instead of file not found by @mihnea-necsulescu in #2999
- Security: Upgrade uv to 0.13.6 and certifi by @michal-lightly in #3007
- Keep filters panel header visible while scrolling by @JonasWurst in #3002
- Add: Annotation class row by @michal-lightly in #2953
- Support custom CA bundles for S3 compatible cloud storage by @mihnea-necsulescu in #2917
- Add CA bundle helpers for custom S3 CA certificates by @mihnea-necsulescu in #3005
- Add scoped evaluation query model definitions by @lukas-lightly in #3009
- Translate evaluation query contracts into sample filters by @lukas-lightly in #3010
- Bump lightly-studio version to 1.2.1 by @github-actions[bot] in #3014
Full Changelog: v1.2.0...v1.2.1
Released by @horatiualmasan