Rokid Lumen 0.2.0-beta.22

Web apps

• The glasses' camera, through the standard APIs (GeckoView): getUserMedia with video
  asks the wearer once per app (Allow or Not now) and gives the app Gecko's live camera, the
  microphone too when asked; a photo field (<input type="file" accept="image/*">) opens a
  capture screen on the glasses (the index tap takes the photo, then Use photo or Take
  another) and gives the page the JPEG. A hidden app lets the camera go.

Glasses

• The status bar shows a white Camera pill while any app has the camera.

Companion

• Camera switch in an app's details on the Apps tab, for the apps that asked for the camera.

Rokid Lumen 0.2.0-beta.21

Glasses

• Status bar: the time and the glasses' battery in the strip above the app, over any app
  but the Rokid launcher (which has its own), so a page is never covered. The battery turns
  amber at 20 % or less and shows a bolt while charging. Lumen's home moves its clock up there.
  Turn it off in the companion's Glasses settings.

Web apps

• No more blinking pages: since beta.19 a page in any web app went black for a moment, and
  stayed black until a gesture when left still, about every 10 seconds on a busy page (Google
  News). Lumen asked Gecko to free memory whenever the glasses had less than 350 MB free, which
  is most of the time with a page open, and Gecko dropped what it had drawn. Lumen no longer
  asks: out of memory, the page goes and Lumen loads it again, as since beta.19.

Rokid Lumen 0.2.0-beta.20

Glasses

• Lumen's keyboard: Lumen is the glasses' input method, in any app (web apps, Rokid's
  settings). A focused field shows a hint under the page; the index tap opens a panel to
  dictate, write with the band, or type on the phone (the companion offers its keyboard for that
  field and the text shows on the glasses as you type). The panel names the field and its Enter
  action (Search, Send, Sign in…) and offers it once there is text. A password gets writing and
  the phone, masked. It replaces the shim's typing in web apps: no script is injected for it any
  more. Turn it off in the companion's Glasses settings to go back to Rokid's keyboard.
• Pictures in notifications: a notification's photo (a chat photo, a post's picture) shows
  in its bubble, fetched from the phone when you open it, full screen on the index tap. Never for
  hidden or redacted notifications.
• Reply with your own words: a field and a send button above the quick replies, typed with
  Lumen's keyboard and sent through the notification's own reply on the phone, without opening
  the app. The reply shows in the conversation; a failure keeps the text.

Rokid Lumen 0.2.0-beta.19

Band

• Index hold and middle hold are gestures of their own on every device: the phone's and the
  computer's profiles and the glasses. The index hold is a pinch held and let go without
  turning the wrist (turning keeps it pinch and turn).
• Pause or resume the band is an action: the middle hold's by default, any gesture's when
  mapped, and the only one that works while paused. A mapping without it doesn't stay paused.

Glasses

• Move the band from the glasses: a Band tile in Controls shows where the band is and opens
  the device chooser (the glasses, the phone, the computers), then that device's profile; it is
  also an action, the index double tap's by default. Each step shows as a toast in Meta's style,
  and a hand-over that gets no answer brings the band back.
• A value changed in the Glasses settings from the phone shows at once, as sending.

Companion

• Write on the phone: a gesture switches to the Lumen handwriting keyboard on the focused
  field and the band writes there; your keyboard comes back when the writing ends.
• Apps tab: changes show at once and reach the glasses even when Rokid's link is slow (a
  package dropped in or an app changed on the glasses reaches the phone too).

Web apps

• Sign in on another site's page: an online app's page on another site (the Google sign-in
  of a YouTube app) now takes the phone's keyboard and the composer in its text fields. It still
  gets nothing else from the host (settings, microphone, speech, installs, Back).
• Out of memory, the page goes and Lumen stays: watching Instagram's Reels ran the glasses
  out of memory and Android stopped Lumen with the page. Now only the page goes; Lumen loads it
  again, and after a second time within two minutes shows a notice (index tap: try again).
  Gecko keeps less for later (no spare process, no pages kept for Back, smaller caches) and
  builds no accessibility trees, whose teardown crashed Lumen when a page's process died.
  Apps left open behind another screen are closed when memory runs low or the page in front
  runs out of it (a hidden YouTube held 175 MB next to Instagram's Reels); opened again, they
  load again, still signed in.
  Gecko is asked to free memory as soon as the glasses run low (it otherwise heard only when
  Android trimmed, after the page was already gone), and its crash helper process (40-70 MB,
  for crash reports Lumen never sends) no longer runs.
• Video fits the display: Instagram's videos play at 480 pixels on the short side at most,
  in H.264 when offered, and players asking about bigger sizes or more than 30 fps hear no.
• Online app packages with site scripts: a .mrbd.zip without index.html whose
  manifest's start_url is an https:// address installs as an online app that brings scripts
  for the sites it names (lumen_scripts). GeckoView runs them in those pages, in the page's own
  world before its scripts, only while the app is in front; the install confirmation names the
  sites. Such a package can also show a gesture card the first three times the app opens
  (lumen_gestures); any gesture closes it. It takes over an app added by address for the same
  site, keeping its sign-ins and its place in the grid.
• The band on any site: in an online app, swipes move a highlight between what can be
  clicked on the page (the page scrolls when there's nothing more that way), the index tap opens
  it, and a page that handles the arrows itself keeps them. An online app without a gesture card
  says so ("Swipe: move · Index: open · Middle: back") the first three times it opens. Site
  scripts get the same pieces (window.lumen.band, highlight, toast, click, nav).
• Dark pages: GeckoView asks every site for its dark theme (prefers-color-scheme: dark):
  on the glasses black is see-through and a white page washes out the view.

Rokid Lumen 0.2.0-beta.18

Companion

• Air Mouse on the phone (experimental): a phone profile can put it on a gesture. A cursor
  shows in the middle of the screen and your forearm moves it; the index pinch is a finger there
  (tap, long press, hold and move to drag and scroll), the middle pinch is Back, and the same
  gesture hides it. Its speed, steadiness and flick boost are sliders in the Phone settings. It
  goes through Screen gestures, the accessibility service the screen actions already use.
• The Glasses settings list every gesture of the glasses, with the actions grouped and
  Restore the default gestures, and the glasses' Air Mouse sliders.

Glasses

• Every band gesture is mappable on the glasses (the navigation was fixed), with the same
  defaults as before.
• Air Mouse on the glasses (experimental): the same cursor on the display, from any gesture.
  It taps apps and web pages, and on Lumen's home the tab, app, control or notification under it.

Rokid Lumen 0.2.0-beta.17

Companion

• Air Mouse (experimental): with the band on a computer, a gesture turns it on and the same
  gesture off; off and on again is the clutch, to set the arm somewhere comfortable while the
  pointer stays. The forearm moves the pointer like a mouse (relative, steadied while the arm is
  still, accelerated on a flick); the index pinch is the left button and the middle pinch the
  right one, held to drag; swipes keep their actions. Pointer speed, steadiness and flick boost
  are sliders in the Computer settings. Ported from kinesis' experimental air cursor.

Band

• The orientation and gyro samples reach the air mouse (they were read and dropped before), with
  their lateness measured by the band's clock: late data is skipped and a held button let go.

Rokid Lumen 0.2.0-beta.16

Companion

• The band on a computer: Other device, the switch's third choice, keeps the band on the
  phone and makes the phone a computer's Bluetooth keyboard and mouse, with nothing to install
  there. Pair from the computer's Bluetooth settings (a computer already paired with the phone
  is listed); the phone reconnects to the last one by itself.
• Computer profiles: Notebook (scrolling, desktops, Enter, Esc, writing) and Presentation
  (the arrows), plus your own, with keys, macOS desktops and Mission Control, the app switcher,
  scrolling, media, volume and brightness; the phone's switch gesture moves between them.
• Writing on the computer: a gesture turns the band's handwriting on and types each letter
  at the computer's cursor; the middle tap ends it. A notification on the phone shows the last
  letters.
• The computer's settings: its keyboard layout (ABC/US or Brazilian ABNT2), the scrolling
  speed, reversed scrolling. The Band tab's settings follow the band to the device it moves to.

Glasses and companion

• Debug builds: the simulated band writes (--es handwriting_text), and --es simulated
  switches it from adb; the companion's WRITE_TEXT types into the handwriting keyboard or the
  computer while they write.

Rokid Lumen 0.2.0-beta.15

Companion

• Gesture profiles on the phone: Media, Navigation and your own, each with every gesture, its
  pinch and turn and whether the band listens while the phone is locked. A switch gesture (the
  same in every profile) moves to the next one, and any gesture can go to the next, the previous
  or a given profile; the phone names the new profile in a short notification. Your layout from
  before became My layout.
• The locked phone: a profile that doesn't listen while locked turns the band off (its power
  saving) until the phone is unlocked.
• The Band tab, redesigned: where the band is and the switch on top, then the phone's and
  the glasses' settings apart; a page per profile, and Key and pairing on its own page.
• Home shows the band's state from the device it's with (it said Off while the band was on
  the phone).

Glasses and companion

• Pinch and turn follows the audio: while something plays it's the volume; otherwise what
  you chose (the glasses: navigation, brightness, volume or nothing; the phone: brightness,
  arrows, volume or nothing).

Band

• After a handwriting session, the hand still moving while the band is restored can't pause the
  band any more.

Rokid Lumen 0.2.0-beta.14

Companion

• Handwriting keyboard: Lumen handwriting, a keyboard for the phone's own apps. With the band
  on the phone, a text field switches the band's handwriting on and each letter goes in at the
  cursor; the middle tap ends it and hides the keyboard, a pause stops it. Password fields never
  get the band; with the band on the glasses it offers to bring it over. Band tab: Handwriting
  keyboard shows whether it's on and opens the keyboard settings or the picker.

Rokid Lumen 0.2.0-beta.13

Glasses

• Write with the band: the composer of a web app's text field now asks Dictate or write?
  (the last choice preselected). Write switches on the band's own handwriting model: write
  with a finger on any surface and each letter goes into the field; a push forward is a space,
  a sweep back deletes, the middle tap finishes (a pause does too). While it writes only the
  middle tap gets through, so a stroke can't move the screen or pause the band. The band is
  always put back to normal afterwards, at the next connection if the app stopped in the
  middle, and before it's handed to the phone.

Band

• The bridge can switch the band's handwriting model on and off (from kinesis 0.5.0), with its
  settings found by name, every change read back and a recovery for a band left in the model.