Skip to content

Releases

0.3.2 — Validate local image access before rendering

Choose a tag to compare

@ComicBit ComicBit released this 07 Nov 15:32
d8cac8d

Fixed

  • check_ui now validates local Image, Gallery, Compare, Hotspots and Entity images with the same sandboxed loader as the renderer. External absolute screenshots are no longer approved when the chat cannot read them; missing and oversized local images also fail preflight.
  • Agents are told to copy external tool screenshots into the thread workspace, thread storage or /tmp before displaying them. Existing file-access restrictions are unchanged.

Update a tracking install with:

bb plugin update genui

No prebuilt artifacts are attached; managed Git installs build from source. See PR #34 and the CHANGELOG for details.

0.3.1 — Code stays drawn in tabs and Details

Choose a tag to compare

@ComicBit ComicBit released this 21 Oct 22:53

Fixed

  • Code stays drawn in tabs and Details. A Code or Snippet inside Tabs or Details showed an empty frame once its tab was left and opened again, or its Details closed and opened again: the caption, the line range and the copy button were there, the lines were not. A tab hidden from the start went blank the second time it was shown. Each now comes back drawn, at the same height. BB 0.46 ships a code viewer (@pierre/diffs 1.2.9) that keeps a blank placeholder after it is hidden; the plugin now makes a new viewer while it is hidden. Diff was not affected.
bb plugin update genui

Thanks to @alexandre-vl for the fix (#12).

See the changelog for every detail.

Full changes: v0.3.0...v0.3.1

0.3.0 — Answers go to your message

Choose a tag to compare

@ComicBit ComicBit released this 21 Oct 22:37

The biggest change: nothing you pick in a reply is sent on its own any more. Choices, Form fields, a Plan's Approve and a Decision go into your message box, and you send them with BB's send button, together with anything you type. Apps can now keep their state and answer too, and threads full of cards move much less under you, most of all on a phone.

bb plugin update genui

Agent sessions started after the update get the new components and instructions.

Changed

  • Your message is the answer sheet. Choice buttons, a Form's fields, a Plan's Approve, a Decision's option, a follow-up and a reply row of a List go into your message box as one block of plain lines, kept up to date as you change them. A reply that asks several questions, in one block or several, can be answered in full: answering one no longer closes the others. Delete the block from your message to clear those picks; edit it and it is your text.
  • Choices are toggles: picking again takes a pick back out, picking another switches. A muted In your message line marks a question answered in your draft, and picks survive a page reload. Forms have no submit button: your first change puts every field in your message as Label: answer lines. After you send, every answered block folds into what it sent.
  • Replies written before this version still render. Without a composer for the thread on screen, a pick is still sent at once, and a Form keeps a Send button.
  • Agents show what is better seen than read, and write real prose around it. On a 64-prompt battery, Haiku 5.5 now uses UI on 103 of 110 prompts that call for it (52 before) and Sonnet 5.5 on 109 of 110; one-line-over-a-card replies fell from 74 to 3, and a blind judge preferred the new replies 181 to 67. Claude Code sessions use UI as often as omp ones. UI belongs only in the reply that ends the agent's turn, and questions go in one Form or one run of buttons.
  • The instructions cost 6,432 input tokens per session instead of 6,949.
  • Buttons that open a file in BB show a file icon, so the external-link arrow only means a web page. A Button's or List row's own icon: stays in front and the action's glyph goes at the end; rows that answer show a paper plane.

Added

  • Apps keep their state. In a ```app block, localStorage is saved with the reply (256 KB per app, 1 MB in all) and sessionStorage works while the app is on screen. alert, confirm, prompt and window.open show a note instead of failing silently; forms submit without reloading the app; https links open in BB.
  • Apps can answer. genui.answer(text), from a click or key press, puts the app's answer in your message like any other pick; genui.openLink(url) opens an https page in BB.
  • Apps follow the Animations setting, open at the height they last had, draw their layout as it streams in, and have Full screen and Download as HTML buttons. An SVG kit (text, boxes, connectors, theme tints, an arrowhead) for diagrams drawn in apps.
  • ui_examples(["app"]) gives agents the app contract and two example apps; check_ui checks app pages for syntax errors, network use, dialogs and other things the sandbox refuses.
  • Copy as markdown beside a reply's Source toggle: the block as plain markdown with the values you changed.
  • Chart types histogram and box for raw observations such as latencies or benchmark runs.
  • Map trips: a place can name a Wikipedia article and shows its lead photo with author and licence (only openly licensed ones, behind Web lookups); places can carry day, with a colour, legend and route per day; tour: true drops the pins in order.
  • Where the numbers come from: Table, Chart and Metric take source: ("illustrative", "user-provided", a note or a URL); data read with Load names its file.
  • Buttons say what pressing them does. A glyph at the end names the action (send, open a link, copy), and BB's tooltip says exactly what is sent, opened or copied. A link shows the address the browser really opens, so https://github.com@evil.com/ reads https://evil.com/.

Fixed

  • Less movement while you scroll a thread full of cards, found and checked in iOS Safari: a diagram keeps its height until BB draws it, Code and Snippet open at the height their code will take, and PullRequest() opens at about its final height.
  • A thread opened again no longer shows gaps under its pictures that then snap shut, and the choices of an answered reply no longer show for a moment and then fold away.
  • With threads side by side or stacked in BB, a picture, diagram or app opened full screen covers its own thread's pane instead of the whole window.
  • Chart series written as {name: {values, tone}} were rejected though the reference shows that form; a review artifact that is a web address opens as a link.

Thanks to @alexandre-vl for #10 (pictures at their size when a thread opens again) and #11 (buttons that say what they do).

See the changelog for every detail.

Full changes: v0.2.6...v0.3.0

0.2.6 — An Animations setting

Choose a tag to compare

@ComicBit ComicBit released this 20 Oct 22:42

Added

  • An Animations setting. The plugin's settings now have an Animations switch beside Web lookups, on by default. Turn it off and nothing in inline UI moves: text and cards appear at once, charts don't draw in, sections open without gliding, maps and carousels jump instead of scrolling, transitions and pulses stop, and 3D scenes and shaders hold a still frame. It applies live to blocks already on screen. Your system's reduced-motion setting is honoured either way; sandboxed ```app blocks keep their own motion.

Turn it off in Settings → Installed plugins → Generative UI, or from a terminal:

bb plugin update genui
bb plugin config genui set animations false

Thanks to @alexandre-vl for the change (#9).

See the changelog for everything since 0.1.0.

Full changes: v0.2.5...v0.2.6

0.2.5 — Install from GitHub again

Choose a tag to compare

@ComicBit ComicBit released this 20 Oct 22:11

Fixed

  • Installing from GitHub works again. Since 0.2.0, bb plugin install https://github.com/ComicBit/bb-plugin-genui.git (and git:github.com/ComicBit/bb-plugin-genui@^0.2.0) failed with Could not resolve "three". BB installs only a plugin's runtime dependencies before building it, and three.js and the GLSL parser were listed as development dependencies. Both are now runtime dependencies.

If an update to 0.2.x failed for you, run it again:

bb plugin update genui

See the changelog for everything since 0.1.0.

Full changes: v0.2.4...v0.2.5

0.2.4 — Changelog

Choose a tag to compare

@ComicBit ComicBit released this 20 Oct 22:03

Changelog

The plugin now has a CHANGELOG.md covering every version since 0.1.0: the 3D Scene and Shader components and the check_ui input checks in 0.2.0, the zoomable image viewer and touch-friendly diagrams in 0.2.1–0.2.3, and the fixes in between. The README links to it next to the update command.

No behaviour changes since 0.2.3.

Updating

bb plugin update genui

Full changes: v0.2.3...v0.2.4

0.2.3 — Drag zoomed diagrams in every direction

Choose a tag to compare

@ComicBit ComicBit released this 20 Oct 21:59

Drag a zoomed diagram in every direction

In full screen, a zoomed diagram could only be dragged sideways. A wide diagram zoomed on a phone, or any diagram zoomed a little on a large screen, was still shorter than the screen, so the viewer kept it centred top to bottom and ignored the drag. Once you zoom in, you can now drag it anywhere inside the view; zoom back out and it centres again. This applies to every picture in the full-screen viewer and to Compare.

Updating

bb plugin update genui

Full changes: v0.2.2...v0.2.3

0.2.2 — Pictures and diagrams you can zoom and pan

Choose a tag to compare

@ComicBit ComicBit released this 20 Oct 21:44

Fixes for pictures and diagrams, mostly on touch screens. Includes the unreleased 0.2.1.

Diagrams pan after you zoom

On the iOS app you could pinch a diagram but not move it around. BB's mobile swipe gestures were taking the touch: the outer finger of a pinch, or a sideways drag, slid BB's side panel over the thread, so the next drag landed on the panel instead of the diagram. Every surface you drag or pinch now tells BB to leave its swipes alone: diagrams, the full-screen viewer, Compare, Map, and 3D Scenes and Shaders you can orbit. A zoomed diagram also keeps its zoom when BB redraws the message.

Every picture opens and zooms (0.2.1)

  • Images in every component now open in one full-screen viewer: Image, Gallery, ImageSearch, Entity, Hotspots, OptionCards, Compare, and Acceptance and Provenance evidence. Some of them used to open only for workspace files, or not at all.
  • In the viewer: zoom with the wheel, a trackpad pinch, two fingers or a double tap; drag to pan; step through a component's pictures with the arrows or a swipe; close with Escape, the close button or a tap beside the picture.
  • Where tapping a picture already does something (Hotspots pins, choosing an option card, Compare's wipe), an expand button in the corner opens the viewer.

Diagrams on touch screens (0.2.1)

  • Pinch to zoom a diagram in place, or ⌘/Ctrl + scroll on a computer. At normal size one finger still scrolls the thread; once you've zoomed in, it pans the diagram.
  • Full screen uses the plugin's own viewer, which zooms and pans on iOS too. Tapping a part that has details opens a popup inside the full-screen view; before, the tap closed it.

Also

  • The README carousel now shows the 3D components moving.
  • Fallback widgets open links in BB's in-app browser with the right thread context (#6, with Nikolai Berezovskii).

Updating

bb plugin update genui

Full changes: v0.2.0...v0.2.2

0.2.0 — 3D in the chat

Choose a tag to compare

@ComicBit ComicBit released this 20 Oct 15:20

Real 3D, in the chat

Agents can now answer with interactive 3D, drawn natively in the reply. The design follows the 3D visuals in Zeron (its ui.scene and ui.shader).

glTF model lit by an HDR Glass prism with dispersion
Animated solar system Raymarched shader
  • Scene (three.js): boxes, spheres, cylinders, surfaces (f: (x, z) => y), meshes, lines, paths, points with hover hints, labels, grids, axes, glTF models, HDR environments and glowing sprites. Materials take roughness, metal, glow with bloom, and glass with refraction and dispersion. A key light casts soft shadows. Drag to orbit, pinch or ctrl/⌘ + scroll to zoom, double-click to reset the camera. Pass t => [...] to animate: it runs every frame, and sliders change it live.
  • Shader: Shadertoy-style GLSL passes, including feedback buffers, iMouse, an iCamera you can orbit, inputs bound to sliders and toggles, textures and iNoise. Blend modes are light, alpha and opaque, with optional bloom.
  • Both use BB's theme colours in light and dark. A thread holds at most six WebGL contexts at once; the other 3D blocks show their last frame at the same size. On touch, vertical swipes still scroll the thread.
  • New math functions in the language: sin cos tan asin acos atan atan2 sqrt floor ceil clamp lerp range random, plus PI and TAU.
  • 8 new gallery examples: rainfall bars, a solar system, an island terrain, a prism splitting light, a glTF pawn in gold and ivory, raymarched metaballs, light trails and wave interference.

Mistakes caught before you see them

  • check_ui now tries a block's inputs the way a reader would: each slider and stepper at both ends, toggles flipped, every option picked, lists emptied and filled, text cleared, Set buttons pressed. An error one of them causes comes back as After setting $n to 0: fmt() needs a number, so a block that only breaks on the first drag gets fixed before you see it. Scenes are checked at t = 0 and t = 1.5, and every shader pass is parsed, with errors given by pass and line.
  • Style arguments (color:, background:, size:) explain why they're refused: components draw in BB's theme, so use tone: where a component has one.

Smoother streaming

  • Text, callouts, table cells and step details now grow as the reply streams, instead of each appearing whole when its closing quote arrives. An open ** or code span is styled from its first word. Paths, place names, icons and labels you could tap wait for their closing quote.
  • Content that appears while a block streams only fades in, at the stream's own pace (120–400 ms), and never shifts the conversation.

BB integration

  • Blocks render through BB's native code fence renderer slot (get-bb/bb#5387) where BB offers it (BB 0.46.1 does); older BB keeps the DOM overlay.
  • Built against @get-bb/plugin-sdk 0.6.54.

Updating

bb plugin update genui

Agent sessions started after the update get the new components. The plugin's page code grows from 0.9 MB to 1.6 MB because of three.js. The GLSL checker runs on the server only, so it adds nothing to the page.

Full changes: v0.1.0...v0.2.0