Skip to content

v0.4.0: Jev can look

Latest

Choose a tag to compare

@8itlab 8itlab released this 15 Oct 07:01
· 1 commit to main since this release

Jev can look now

Jev 1.13 reads images and Jev 1.14 adds a question type that boxes one thing in a picture. reflex-cu 0.4 uses both through a new look: true option:

  • find with look finds icons and things in game scenes that have no text: a rough box on the whole window, then a second box on an enlarged crop around it. confidence is Jev's probability, after zooming in, that the target is really there; it clicks only when that is high enough.
  • check / wait with look give Jev the window's screenshot along with the text read from it.
  • The screenshot goes to Jev only, never into the agent's context.

Measured without clicking, against known positions: 8 of 8 targets on a game screenshot; 6 of 8 small browser-toolbar buttons (one refused for low confidence, one landed on a tab's title instead of its close button). A find takes about 1–3 s, a check about 0.6 s.

Limits. Experimental at TypeSafe ("Dreamer-ready"). Only a TypeSafe key works for now: OpenRouter already serves Jev 1.14 but drops the image, so look fails with an error there instead of answering blind. status reports jev_images. Boxing uses jev-preview until jev-latest moves to 1.14 (CU_JEV_VISION_MODEL to change).


Jev 1.13 起能看图,1.14 加了框选题型。0.4 新增 look: true:find 能找图标和游戏画面里的东西(整窗粗框 + 放大细框),check/wait 能连截图一起判断;截图只发给 Jev,不进代理的上下文。目前只支持 TypeSafe 官方密钥。