Skip to content

Eye Of Hermes v0.2.0

Choose a tag to compare

@mojomast mojomast released this 05 Nov 20:08
· 92 commits to main since this release
29de8b6

The user-facing name is Eye Of Hermes (EOH). Plugin id godseye, the godseye_ tool prefix, /gev, routes, and the repository name are unchanged.

The model catalog is eleven composable tools: godseye_view, godseye_query, godseye_layers, godseye_feeds, godseye_annotate, godseye_nav, godseye_track, godseye_scene, godseye_watch, godseye_capture, and godseye_admin. Their registered schemas are about 6.6k o200k_base tokens (6636). The catalog those tools replaced was about 30k o200k_base tokens (30133) across 97 tools, measured on this tree before investigation export. Old Hermes names are not registered. router.dispatch_legacy is the only path that still runs one.

This release also adds a per-turn map line, concise tool output (detail defaults to concise), and fix-it errors (code, message, fix). Pins are ground-clamped, and a pin info drawer shows title, markdown, images, and links. godseye_query op=brief_and_show flies a brief onto the globe. Live commands route to the chat's pane. /gev slash commands, the godseye:godseye-analyst playbook, godseye_doctor, a saved home view, share links, and guided tours are included. Annotations, camera, and caption persist per session and come back when a pane reopens. godseye_scene op=export writes GeoJSON, KML, and an optional pack zip. Tests replay hand-written HTTP fixtures and block the public network. A lost WebGL context is recovered in the same pane, and recovery calls window.__godsEyeView.recreateViewer when that hook is present. The time slider is godseye_nav op=timeline: mode=wayback scrubs Esri World Imagery Wayback releases, and mode=events shows earthquakes, fires, and stored watch alerts.

Breaking changes

  • Retired tool names are no longer registered and are not listed in plugin.yaml provides_tools. Call one of the eleven composable tools with an op. A saved call that still uses a retired name runs only through router.dispatch_legacy. Scenes, tours, /gev, the relay, and the pane keep bare action names such as fly_to_location.

Changed

  • Pane branding: the panel header, loader, page title, status line and open button now say Eye Of Hermes (EOH) (gev/panel_brand.js, re-applied by a MutationObserver when the app re-renders); the header tooltip credits God's Eye View. Pane status messages and the pane loading text use the new name.
  • Renamed the user-facing title to Eye Of Hermes (EOH) (pane title, plugin description, /gev help, skill, README). Plugin id godseye, tool names, /gev, routes and repo name are unchanged.

Added

  • Time slider on the EOH pane, driven by godseye_nav op=timeline. The sub-action is an argument named timeline: set, play, step, stop, state, list_dates. mode=wayback scrubs Esri World Imagery Wayback release dates over the current view (swipe or fade). mode=events shows USGS quakes and NASA FIRMS fires, plus stored watch alerts, as pins that appear when the playhead reaches them. from/to default to the last 7 days for events. The catalog is cached for six hours and not refetched inside two seconds. Tiles are for viewing only; photorealistic 3D tiles are hidden, not sampled. The slider is stored with the scene and with investigations, and it is restored on pane reopen and WebGL recovery. User scrubs persist through /live/timeline.
  • Composable tools, the rest of the catalog. godseye_layers, godseye_feeds, godseye_annotate, godseye_nav, godseye_track, godseye_scene, godseye_watch, godseye_capture, and godseye_admin join godseye_view and godseye_query. The camera read is godseye_view op=state (there is no separate state tool). Investigation export is godseye_scene op=export. godseye_view also gains op=show, and godseye_query gains op=terrain and op=features. Every legacy name is unregistered. dispatch_legacy still runs one. Feed ops keep the person-tracking refusal and the CCTV/ALPR public-camera limit. The golden selection set covers every op.
  • Composable tools, phase A. godseye_view (op fly, move, zoom, globe, home, share, panes) and godseye_query (op find_places, osm, context, what_is_here, brief, brief_and_show, analyst, military, poi, resolve_area, entity) call the existing handlers through one router. The 18 names those ops replaced are not registered. router.dispatch_legacy still runs a saved call that uses one of those names. Scenes, tours, /gev, the relay, and the pane keep their bare action names. fly accepts style (nvg and night vision mean surveillance) and then calls set_visual_style. here=true, or a "near me" / "this area" phrase, reads the open pane's camera and then calls the original lookup. The map of every tool, including ones not routed yet, is docs/COMPOSABLE-TOOLS.md. Selection checks live in evals/selection_golden.json (pytest, offline). evals/run_selection.py scores that set with a live model only when an API key is set and CI is unset. evals/measure_schemas.py prints schema bytes and token counts.
  • Automatic WebGL recovery. On webglcontextlost the pane prefers window.__godsEyeView.recreateViewer when that hook is present (the hook owns loseContext, destroy, and the new viewer, and rebinds the voice runner). Otherwise the pane calls WEBGL_lose_context.loseContext() before viewer.destroy() and creates a new viewer in the same container. Either path restores the saved scene with the existing restore_commands (camera heading, pitch, and roll, pins and annotations, drawer, filters, layers, and the time slider). The click-to-reload card stays as the fallback. GODSEYE_GL_RECOVER=0, or glRecover: false in plugin-data/godseye/config.json, turns recovery off (env wins). After 3 losses in 20 seconds, recovery stops and the card is shown. The relay reports {code:"CONTEXT_LOST", message, fix} when the context is lost and {code:"CONTEXT_RESTORED", message} when recovery succeeds; both are drained into the next turn. Intentional teardown still releases the context before destroy. scripts/gl_recover_harness.mjs (port 4233) forces loseContext() and checks that the camera and pins come back.
  • Per-turn map state. When Hermes provides pre_llm_call, the plugin injects one line (pane connected/busy/closed, camera center, range, pitch, heading, active layers, pin count, open drawer), under 300 bytes, from the relay cache. It does not call the pane. A hermes_context result updates that cache from camera.center. The same callback also returns queued area-watch alerts, so both contexts reach the turn. GODSEYE_TURN_STATE=0 turns the map line off; alerts still use the hook. Hosts without register_hook skip both.
  • Concise tool results. Large-payload tools take detail: concise|full (concise by default): ids and counts instead of full objects, and screenshots only when detail=full. The same default covers live context, what-is-here, measure, isochrone, draw, compare, research pins, investigation list/load/report, pin filters, and watch create/list. A short distance, area, contour summary, or open/closed pin state stays intact; route lines, polygons, long catalogs, notes, and screenshots do not. The argument is removed before the MCP server or the pane sees it.
  • Fix-it errors. Failures the model sees include code, message and fix (pane closed or busy, relay down, timeout, set_map_stack key failures, missing keys, Overpass down or unconfigured, area too large, upstream app down, policy refusal, plus routing_unavailable, wayback_unavailable, no_focus, no_drawing, unsupported_side, confirm_required / CONFIRM_REQUIRED, NOT_FOUND, BAD_AREA, BAD_FEEDS, no_pins). The original error string is unchanged.
  • Embed protocol matches the God's Eye View fork (docs/EMBEDDING.md): the pane posts {type:'gev:visibility', visible} from page visibility and an intersection observer, and {type:'gev:config', ...keys, perf:'embed'} before the viewer starts (?waitForConfig=1). Replies gev:visibility-applied and gev:config-applied are forwarded out of the inline frame. ?perf=embed is on by default (GODSEYE_PERF=default turns it off). Client keys are written to dist/panel/config.json (mode 0600) when the pane is served, so a current build does not need a rebuild. Older builds still use the baked bundle. Values are never logged. godseye_doctor treats a matching config.json as fresh.
  • Pin clustering and filters (pane side, gev/panel_pins.js + vendored opening_hours subset gev/panel_oh.js). Above ~2.5 km camera height, pins within 56 px merge into a count bubble; clicking one zooms to its members. A chip bar filters by category (amenity / shop / tourism / leisure / cuisine / category tags), rating >= 4 (rating or stars tags) and "Open now" (OSM opening_hours; unsupported syntax such as PH, months, sunrise is UNKNOWN, never guessed; unknown stays visible unless include_unknown:false). New annotation field tags (filled by godseye_find_places). New tool godseye_live_filter_pins (set / state / expand). Filters, including chip clicks (new /live/filters route), persist in the scene and are re-applied after a restore. Pins stay grounded and the drawer shows rating and open state.
  • Area watches: godseye_watch_create, godseye_watch_list (with check=<id> to run one now), godseye_watch_pause, godseye_watch_delete (needs confirm:true). Area is a bbox, polygon, center + radius or the current view. Feeds: earthquakes (USGS, keyless), fires (NASA FIRMS, FIRMS_MAP_KEY), flights (OpenSky, keyless), ships (AISSTREAM_API_KEY + the app's vessels_in_area), pois (OSM). Feeds without a key report KEY_MISSING. The first run is a baseline by default. After that, only unseen ids alert; last-seen ids persist in plugin-data/godseye/watches.json. Each new item is pinned with drawer details. Alerts are queued and handed to the next chat turn through the same pre_llm_call hook as the map line. deliver:"inject" also calls ctx.inject_message, which needs allow_gateway_injection. The checks run in a daemon thread that exists only while an active watch exists. Nothing is created automatically.
  • Default pin enrichment: every pin-creating path (annotate_map, godseye_find_places, godseye_brief_and_show, tour stop pins, and any other annotate) produces non-empty drawer content shaped by an intent/context arg (the user's request). Light mode uses local/OSM/hit tags (cached, fast); godseye_research_pins {mode:"full"} deepens with Wikipedia/Wikidata/Commons/website meta. Empty pins are auto-enriched in the background and pushed to the pane drawer. Facts are never invented.
  • godseye_research_pins: research pins in the current scene into each drawer's description_md (with a Sources section), images[] and links[]; persist + redraw. Caps, disk cache, per-pin failure isolation. Agent web search is documented: pass verified snippets as agent_notes (the plugin cannot call Hermes web_search itself).
  • Named investigations: godseye_investigation_save / _list / _load / _delete (delete requires confirm:true) store the whole scene under plugin-data/godseye/investigations/.
  • godseye_investigation_report: self-contained HTML + Markdown report (title, map screenshot via hermes_capture when the canvas allows, pin table, drawers, routes, sources) under plugin-data/godseye/reports/; optional share link.
  • godseye_investigation_export: write a saved investigation, or the current scene, under plugin-data/godseye/exports/ as GeoJSON (RFC 7946, longitude then latitude) and KML. Pins are Points with their drawer and enrichment properties; drawings and areas are Polygons or LineStrings; routes are LineStrings. format:"pack" adds a zip of the GeoJSON, the KML, the Markdown report and any saved screenshots. Google photoreal tile imagery is left out (those terms allow viewing only). Property values are the investigation's own data. /gev export.
  • Recorded HTTP fixtures for the services tests used to call live: an OSRM route, a Valhalla isochrone, Overpass POI elements, Nominatim search/reverse, USGS quake events, a FIRMS CSV and OpenSky states (tests/fixtures/cassettes/). Pytest blocks non-local network unless a cassette is playing, so CI does not call the public demo servers. GODSEYE_E2E=1 is the only opt-in for a live call.
  • /gev research|save|list|load|delete|report|export subcommands.
  • "What am I looking at": godseye_live_context returns the pane's camera (center, heading, pitch, range), visible bbox, selected pin, last clicked point, user drawings and a focus for "this/here", plus a Nominatim reverse geocode (1.2 s pacing, descriptive User-Agent) and nearby named places (Overpass, falling back to sampled Nominatim reverse). godseye_what_is_here does the same for a coordinate without a pane. The analyst skill calls it on "this", "here", "around here", "what's that building".
  • Draw tool in the pane (gev/panel_context.js): box / polygon / line with distance or area labels, clear; godseye_live_draw starts draw mode for the user or draws Hermes' own labelled shapes (persisted with the scene and restored on reopen).
  • godseye_measure: great-circle distance (legs, bearings) between points, pins or a drawing; spherical polygon area + perimeter; op:"route" walk/bike/drive distance and time via public OSRM (routing.openstreetmap.de), with a clear routing_unavailable error.
  • godseye_isochrone: reach within N minutes via public Valhalla isochrones, else an OSRM-table approximation flagged approximate, else routing_unavailable (no fake circles). Rings are drawn with labels.
  • godseye_live_compare: split-view swipe with a draggable divider between imagery layers (current, osm, wayback:YYYY[-MM[-DD]] = Esri World Imagery Wayback historical releases), list_dates, position, toggle, stop. Map stacks cannot be split; photoreal tiles are hidden while comparing.
  • "Ask Hermes" button in the pane toolbar and pin drawer: copies a ready question to the clipboard and focuses the chat composer (the plugin SDK cannot submit chat messages).
  • Grounded pins: annotation/POI/brief/tour pins are drawn as Cesium markers anchored at their tip (verticalOrigin BOTTOM) with a ground dot, depth test disabled and the ground height re-sampled per zoom level. Fixes pins hovering above the spot at street level (upstream's screen-space reticle samples the height once, usually at a coarse zoomed-out tile LOD, and never re-samples). Upstream's reticle for those pins is hidden; ids, list and clear are unchanged.
  • Pin info drawer: click a pin (or godseye_live_pin_drawer) for a slide-out with title, sanitized markdown, lazy images and http(s) links (opened by the host via ui/open-link). New optional annotation fields title, description_md, images[], links[]; godseye_find_places fills them from OSM tags, godseye_brief_and_show from hits (pin_details overrides). The open drawer persists with the scene and is restored.
  • godseye_find_places: keyless POI search ("ramen restaurants in Montreal"). Category/cuisine-in-bbox via Overpass (configured endpoint first, then overpass.kumi.systems, overpass.private.coffee, overpass-api.de; 20 s per request, 45 s total, per-endpoint circuit breaker), name/address lookup and a keyword fallback via Nominatim (descriptive User-Agent, 1.2 s pacing, 1 h cache). Returns lat/lon, name, address, website, opening hours; pin:true pins up to 24 via annotate_map.
  • godseye_poi_details (best effort): OSM record, website, menu URL if linked, and verbatim price snippets from the venue's site. Prices are never invented.
  • resolve_area falls back to around:true (buffer polygon) for point-only places, then to a Nominatim bbox polygon.
  • AREA_TOO_LARGE remediation says to fly with rangeM <= 15000 first. OVERPASS_NOT_CONFIGURED explains the public fallback and gives the exact OVERPASS_UPSTREAMS= line.
  • godseye_brief_and_show: runs situation_brief or military_awareness, then flies the live globe, enables the brief's layers, pins the top N hits and sets a caption line. Returns the brief plus what was shown, and still returns the brief when no pane is open. If upstream geocoding is unavailable, it retries with coordinates.
  • Multi-pane live relay. Panes register an id and their chat session ids, and commands go to the session's pane, else the most recently active ready pane. Every live tool takes an opt-in fanout. New godseye_live_panes tool and /live/panes route. pane_busy is now distinct from no_pane.
  • /gev slash command (fly, layers, status, brief, home [set], share, doctor) via ctx.register_command.
  • Bundled skill godseye:godseye-analyst (analyst playbook) via ctx.register_skill.
  • godseye_doctor health check with fix text (Node 24, checkout, :4173, patches #1571/#1572, relay, panes and last-poll age). It is read-only.
  • Saved home view (godseye_home, /gev home) in ctx.state with a plugin-data/godseye/home.json mirror. The pane cold-starts at home (/home route).
  • godseye_share_link: upstream share-codec /share/<code> link on GODSEYE_PUBLIC_URL, with a camera-hash fallback.
  • In-frame caption line (hermes_caption) over the globe.
  • Scene persistence: annotations (stored with resolved coordinates, so a restore never re-geocodes), camera (look-at target, range, pitch and heading) and caption are saved per session in plugin-data/godseye/scenes.json. A reopened pane restores them automatically. New tools: godseye_live_list_annotations, godseye_live_delete_annotation, godseye_live_restore_scene, godseye_live_reload_pane.
  • Guided tours: godseye_live_run_tour (street/rooftop/district framing with exact pitch, optional orbit, dwell, optional route between stops) runs server-side as one job, with godseye_live_tour_status and godseye_live_stop_tour. A tour always ends with the camera stopped.
  • Doctor panel checks: PANEL_MISSING, PANEL_STALE, KEY_MISSING, ION_SCOPES (local JWT decode, values never shown), plus the active map stack and the scene annotation count. godseye_rebuild_panel rebuilds dist/panel from ~/.config/gods-eye-view.env and reloads open panes. set_map_stack failures include remediation text.
  • Doctor now reports per-provider key presence (CESIUM_ION_TOKEN, GOOGLE_MAPS_API_KEY, MAPILLARY_CLIENT_TOKEN in env+bundle; AISSTREAM_API_KEY, FIRMS_MAP_KEY in env), the active map stack, layer feed states from feedProvenance (nominal/fallback/unavailable), and the current scene's annotation count. Key values are never printed.
  • Pane bookkeeping: stable pane id per chat session, one pane per session by default, auto-prune of stale closed records plus godseye_live_panes {prune:true}, optional pane label (shown in the list and pane chrome).
  • godseye_preview_swap: tracks the last desktop preview URL this plugin opened and closes it before opening the next. desktop_preview remains a Hermes core tool (no native swap action); when the desktop emitter is unavailable the tool returns desktop_preview_steps for the agent.
  • Brief captions carry a data source and a count scope (queried extent / in view), never "worldwide".
  • View state now returns pitch, heading, look-at target and range (pane-side shim).
  • fly_to_location takes framing: street|rooftop|district (150 m/-15°, 450 m/-30°, 2500 m/-45°; rangeM overrides, minimum 100 m). It waits for arrival, then sets the pitch exactly, and returns pitchDeg/headingDeg with the camera.
  • Annotations: multi-line labels (newline string or list, 2-3 lines) and a card type (title plus rows [{text, price}], anchored to a point) drawn as callouts over the globe. Partial routes draw the resolvable runs of waypoints and name the missing one(s) in missingWaypoints/failedLabels; they never bridge a gap. flyTo: "all" frames every mark in the call.

Fixed (tours)

  • The final tour stop could end at the flight's default -35° instead of the framing pitch. The cause was an unfinished flight or a running orbit overwriting the exact framing. Framing now cancels any in-flight flight, the orbit is stopped before each next flight, and the pose is verified and re-framed (up to 3 tries) until the pitch holds.

Fixed

  • Resizing the window could crash the globe, ending in "Error constructing CesiumWidget: The browser supports WebGL, but initialization failed". The cause was the pane being remounted when the layout changed. Each remount started a new Cesium viewer while the old frame's WebGL context was freed only at GC, so contexts leaked until the browser refused new ones. v0.1.0 had the same problem. The pane is now lifecycleKeepAlive, the panel document is cached across remounts, and the frame releases its context on pagehide/dispose (WEBGL_lose_context + viewer.destroy()). Context loss and Cesium's error dialog now show a "click to reload the globe" card instead of a dead dialog.

Changed

  • The live relay no longer hands a command to whichever pane polls first.
  • Version 0.2.0. Every new Hermes API is optional: older builds skip the command, skill or state and still register the tools.