Skip to content

Neat Insight v0.0.7

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 20 Aug 07:10
· 5 commits to main since this release
v0.0.7
5dd1a18
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Neat Insight v0.0.7

Neat Insight is the browser-based workspace for testing, visualizing, and troubleshooting Neat vision applications. This release adds H.265 video playback, native segmentation overlays, clearer diagnostics, persistent test media, and interactive API documentation.

Important: When using Insight through the Neat SDK, setup now exposes ports for 4 video channels by default, down from 80. If your application needs more than 4 channels, set the count with sima-cli sdk setup --insight-video-channels <count>. Supported values are 1 through 80.

Highlights

  • View H.265 video directly in your browser. Insight now supports H.265/HEVC streams alongside H.264 and automatically selects the appropriate format for each channel. Improved recovery helps viewers reconnect after stream interruptions, codec changes, or decoder stalls.

  • See segmentation results without modifying your video. Insight can display segmentation masks, outlines, labels, bounding boxes, and confidence scores as browser-based overlays. You can adjust mask opacity, colors, outlines, and confidence thresholds globally or per channel.

  • Troubleshoot streams faster. Expanded diagnostics help you determine whether an issue originates with the video source, metadata timing, browser delivery, or video decoding. This reduces guesswork when investigating missing video or incorrectly aligned results.

  • Keep test media between SDK sessions. Imported media is now stored in the SDK workspace when available, so your test assets remain accessible after the SDK environment is recreated.

  • Match the viewer to your environment. Insight now respects the video-channel capacity configured for your SDK across channel selection, layouts, pagination, and direct viewer links. Existing installations continue to support the default 80-channel configuration.

  • Automate Insight with documented APIs. A new interactive API reference makes it easier to automate health checks, media imports, source configuration, workspace inspection, viewer discovery, and diagnostics. Open /api/docs on your Insight instance to explore and test the APIs.

What's New

H.265/HEVC playback

Insight can now receive H.265 RTP streams and deliver them to compatible browsers through WebRTC. It automatically detects the codec used by each channel and negotiates the correct browser playback format.

Additional safeguards prevent incomplete or corrupted frames from reaching the decoder after packet loss, while improved reconnection behavior helps restore playback after temporary failures.

Native segmentation overlays

Segmentation results can now be visualized directly in the Video Viewer. Supported presentation options include:

  • Filled masks and contours
  • Bounding boxes
  • Class labels and confidence scores
  • Configurable colors, opacity, and outline styles
  • Global and per-channel display settings

The renderer is designed to handle realistic segmentation payloads efficiently while protecting the browser from malformed or excessively large masks.

Improved diagnostics

New ingest and egress statistics provide greater visibility into how video and metadata move through Insight. You can now distinguish between:

  • Video that is not reaching Insight
  • Metadata that cannot be matched to a video frame
  • Metadata that arrives too late or is removed under load
  • Browser delivery failures
  • Browser decoder stalls or unsupported decoder behavior

Persistent media and configurable capacity

Within the Neat Development Environment, Insight stores imported media under /workspace/.insight-media when the workspace is writable. This allows media to survive SDK environment recreation and reduces repeated setup work.

Insight also honors the SDK's configured video-channel capacity throughout the user interface. If no valid capacity is configured, Insight retains its existing 80-channel behavior.

Interactive REST API documentation

Insight now includes a comprehensive OpenAPI 3.1 specification and a bundled interactive API reference:

  • /api/docs — interactive Swagger UI
  • /api/openapi.json — machine-readable OpenAPI specification

The reference covers system health, diagnostics, media management, streaming-source control, viewer configuration, workspace inspection, and DevKit shell integration. Documentation assets are bundled with Insight and remain available in offline environments.

Compatibility

Existing H.264 streams, legacy metadata workflows, and installations without a configured channel capacity remain supported.

H.265 playback requires compatible browser and platform decoding support. If playback does not start, the egress statistics expose the selected decoder implementation to help identify browser-specific compatibility issues.

Segmentation RLE masks must use the supported uncompressed, bounding-box-local format. Compressed COCO byte strings are not currently supported.

Existing SDK environments may retain the previous use-neat-insight playbook entry. It can be removed with:

sima-cli playbooks delete use-neat-insight

Reinstall the playbooks afterward to use the updated sima-use-neat-insight identifier.

Full Changelog: v0.0.6...v0.0.7

Assets 2
Loading