Repository navigation
Requires polaris-tui 0.3.0 and polaris-ai 0.9.3.
Added
- A
view_imagetool lets the agent look at a PNG, JPEG, GIF or WEBP file in the working directory, in every front end including-p. The model receives the picture; the live conversation, activity block and Session RDF/ABox tool-call record show a short line such as[image shots/a.png, PNG, 34.0 KB]. Saved session history and ATIF exports (--trajectory-path, underextra.image) retain the whole encoded image. The type is read from the file's first bytes, not its name. A file over 3,750,000 bytes, or one that is not one of those four types, is refused with a message that says what to do next. It followsread_file's path rules, changes nothing and asks no one. Pictures are not scanned for secrets, unlike text results. A permission rule names one tool, so a rule that protects an image path needs aview_imagerule as well as aread_filerule. --image-input/POLARIS_CODE_IMAGE_INPUT/image_input(auto,onoroff) says whether the model takes images.auto, the default, is on for Claude models reached through Anthropic or Bedrock and off for every other route, including--provider openaiand--provider openai-chat. When it is off,view_imageis not offered. The choice is made once from the model the session starts on;/modeldoes not change it. For a vision model behind--provider openai-chat, seton: this release usespolaris-ai0.9.3, which sends the image to Chat Completions. Do not setonfor--provider openai, whose Responses API provider still refuses image tool results.- For embedders,
ViewImageToolsPluginregisters the tool, andCodeToolsConfig::with_image_inputsets the wording ofread_file's refusal of an image file.
Changed
read_fileandread_spanon an image file now return an error that names the type and size instead of "stream did not contain valid UTF-8". With image input on it ends with theview_imagecall to make; with it off it says the model takes text only.- Bedrock Claude model ids (
anthropic.claude-…) andclaude-fable-…ids are now recognised as models that take images, for composer attachments as well. - Uses
polaris-ai0.9.3. Its Chat Completions provider no longer fails on an image tool result: thetoolmessage carries a note, and the image follows in a user message after the tool messages, labeled with the call's id.Cargo.locklocks every Polaris crate underpolaris-aiat 0.9.3.polaris-tui,polaris_cosmosandpolaris_ontraceare unchanged at 0.3.0.
Full Changelog: v0.4.4...v0.4.5