Skip to content

v2.55.3

Latest

Choose a tag to compare

@bigsk1 bigsk1 released this 06 Aug 06:03
· 10 commits to main since this release

v2.55.3

Compare: v2.55.0...v2.55.3

Highlights

SerpApi, Search, And Live Data

  • Expanded Jarvis's focused SerpApi family with Tripadvisor, Search Index,
    Google Trends, Trending Now, News Light, Local, Local Services, Images Light,
    Shopping Light, and Google Sports tools. The former generic SerpApi search is
    now clearly named Amazon Search.
  • Added structured Web UI cards, bounded LLM and follow-up projections, exact
    source identifiers, timeout handling, and SerpApi outage diagnostics across
    the new result types. Settings now shows the active mode's SerpApi quota only
    when a configured key is available.
  • Standardized SerpApi proxy policies while preserving direct-by-default
    operation. Google Images adds strict raster validation, safe optional Stash
    downloads, durable source provenance, and untrusted-content handling.
  • Added Google Flights discovery with a pinned fast-flights fallback, improved
    hotel reliability, and added Yelp and other structured-result previews.
  • Google Sports now supports current-centered schedules, scores, standings,
    direct-game line or period scoring, box scores, viewing options, and official
    recap links instead of exposing only generic team results.

Workflows, Knowledge, And Canvas Briefs

  • Added /buying_brief, /vacation_reconnaissance,
    /local_services_compare, and /game_brief recipes that combine bounded
    structured sources into dated Canvas reports without requiring heavy page
    crawling.
  • Added PDF knowledge ingest and topic knowledge snapshot workflows, plus direct
    PDF attachments in Jarvis Web and standardized Intelligence filenames.
  • Optional workflow tools no longer hide or fail an otherwise runnable recipe;
    required tools remain strict. Recipes can also opt out of autonomous Jarvis
    selection while remaining available through explicit slash commands,
    scheduled tasks, and APIs.
  • Enriched Amazon value workflows and synchronized the shared workflow catalogs,
    authoring guidance, and availability behavior.

Music, Media, And Canvas

  • Added provider-ready music generation for ElevenLabs and Gemini, including a
    rate-limited FastAPI surface, reusable workflows, saved-track metadata, and a
    dedicated generated-audio catalog.
  • Added a responsive Canvas audio gallery with search, filters, favorites,
    downloads, confirmed deletion, range-capable playback, and a live audio
    visualizer.
  • Canvas now shows image and video provider/model badges, permits clearing all
    page tags, constrains large Markdown images, and keeps wide tables and source
    links usable on smaller screens.
  • Video-to-OGG conversion now uses the compatible Vorbis codec, and generated
    music is documented separately from transient microphone/TTS audio cleanup.

Web UI, Follow-Ups, And Runtime Reliability

  • Hardened tool-result follow-up context so structured identifiers and useful
    result rows survive preview limits without repeatedly calling the same tool.
  • Added richer structured-result adapters and improved detailed-mode summaries,
    tooltips, chat controls, scheduled-task controls, and source-link rendering.
  • Updated the Web runtime to python-engineio>=4.13.4 and the upstream teardown
    path to prevent Engine.IO/WebSocket shutdown errors.
  • Fixed the Web vision path to honor the selected provider and improved Ollama
    Cloud payment-error explanations.

Providers, Speech, Spotify, And Profiles

  • Added Claude Opus 5 to the Anthropic catalog and a tracked OpenAI-primary
    one-key tool profile for simpler first-time configuration.
  • Added configurable OpenAI-compatible speech-to-text with an independent URL,
    key, model, timeout, and explicit opt-in fallback; updated the documented xAI
    TTS voice catalog.
  • Aligned Spotify OAuth helper scopes with the live tool, added followed-artist
    browsing, and hardened podcast playback follow-ups and revoked-token recovery.

Scheduling, APIs, Proxy Safety, And Configuration

  • Made price alerts a first-class data API and kept scheduled tasks and run
    history mode-local. A configurable restart grace window runs slightly late
    tasks while skipping stale occurrences.
  • Added shared proxy policies and route logging for native and MCP tools. The
    credential-free DuckDuckGo MCP server is included but remains disabled by
    default with strict container and SafeSearch settings.
  • Expanded the OpenAI-primary env example, added missing Intelligence and
    feedback settings, documented new STT/music/search options, and changed the
    example router default to compact prompt v2.
  • System-wide automatic correction appends to the Git-tracked learned-lessons
    file now remain off by default; manual reflection and explicit intelligence
    workflows are unchanged.

Upgrade Notes

Native installs

cd ~/jarvis-voice
git fetch --tags
git pull --ff-only
git checkout v2.55.3   # optional if you want the exact release tag
source ~/jarvis-venv/bin/activate
uv sync --active --no-install-project
./bin/start --stop && ./bin/start

The dependency refresh is required for the new fast-flights integration and
the WebSocket/Engine.IO runtime fix.

Docker installs

Rebuild containers when shared UI assets, dependencies, env examples, or entrypoint behavior changed.

cd ~/jarvis-voice
git fetch --tags
git pull
docker compose down
docker compose build --pull
docker compose --profile extras up -d --force-recreate

The base Compose configuration now seeds mutable price-alert settings from the
tracked example while keeping the runtime file outside the image.

Review env examples before copying

git diff v2.55.0..v2.55.3 -- \
  config/cloud.env.example \
  config/local.env.example \
  config/cloud.openai.env.example \
  docker.env.example

Do not replace an existing runtime env file wholesale. Review the new router-v2,
scheduled-task grace, compatible STT, music-provider, Intelligence/feedback,
SerpApi, and OpenAI-primary profile settings and copy only what you intend to
enable.

Optional cleanup previews

./bin/cleanup-all --dry-run
./bin/cleanup-web-conversations --days 90 --dry-run
./bin/cleanup-generated-images --days 120 --dry-run

Change Summary

  • Commits: 71
  • Files changed: 355
  • Insertions: 44,065
  • Deletions: 3,058

Full Commit List

  • dbef393 fix(web): honor selected vision provider
  • caf7f39 Add Claude Opus 5 to the Anthropic model catalog.
  • aa7b3f4 feat: add DuckDuckGo MCP web tools
  • c85e344 update mcp docs
  • aa362a6 Polish scheduled task and chat UI controls
  • 46e5a77 fix(convert-file): encode video-to-OGG audio as Vorbis
  • 77fb290 update bug ledger and jarvis lessons learned
  • f7c436f feat(canvas): add responsive audio gallery
  • a8388da docs(cleanup): distinguish runtime audio from gallery music
  • e6a83de fix(canvas): compact audio nav on mobile
  • 0db3da6 feat(api): add provider-ready music generation
  • a38adab fix(api): rate limit generated music
  • 86a7b9c docs(music): add generate music tool guide
  • 3b3ec29 feat: add multi-provider music generation and audio workflows
  • 99e1c42 feat(canvas): show image and video model badges
  • 249d902 feat: add proxy policies and MCP route logging
  • 0b4884f disable duckduckgo mcp by default
  • 1582bc3 Add live Canvas audio visualization
  • ace0b20 Restore audio visualizer bass headroom
  • e4ac02a add audio to canvas system doc
  • 76a504b refactor: make price alerts a first-class data API
  • 82ed8fe docs: sync workflow example lists
  • 76c32dc docs: clarify native and MCP proxy policies
  • 11929c5 feat: allow workflows to opt out of Jarvis selection
  • 1b1bfeb disable workflow tool defaults for certain workflows
  • f95f8f4 feat: enrich Amazon value search workflows
  • 213bcc6 fix(canvas): allow clearing all page tags
  • 83d2337 fix(scheduler): keep schedules mode-local
  • 239166a fix(spotify): align OAuth helper scopes
  • f289784 update bug ledger
  • c8c8916 feat(spotify): add followed artist browsing
  • 513b1f6 fix(spotify): harden podcast playback follow-ups
  • 3ae0910 fix(ollama): explain cloud payment errors
  • 63963ec update test for ollama
  • 6c90397 Harden Web tool follow-up context for v2.55.2
  • d53e08c remove old talking head idea
  • 251c02f remove unused prompts
  • 12eabd4 feat(web): support PDF attachments
  • 5ef6e1a feat(workflows): add PDF knowledge ingest
  • 1c60422 feat(intel): standardize knowledge filenames
  • a590ff3 feat(config): add OpenAI one-key tool profile
  • 31ac96f remove old prompt from doc
  • 07a6138 feat(workflows): add topic knowledge snapshot
  • 94285df update debug prompt
  • 26702bf fix(web): use upstream Engine.IO teardown fix
  • a6f79d2 feat(stt): add configurable compatible transcription
  • 5a71ba5 docs(xai): update available TTS voices
  • 577b50d feat(tools): add Google Flights search
  • f3f0e3f feat(tools): make hotel search reliable
  • 81c39bd feat(search): add Yelp and structured result previews
  • dab7d61 feat(tools): improve result previews and outage diagnostics
  • 0642c0c feat: add SerpApi TripAdvisor tool
  • 17f4826 refactor: standardize SerpApi proxy policies
  • 7a7f07a test: cover TripAdvisor status incidents
  • c351c2d feat(tools): add Search Index and rename Amazon search
  • 0525264 feat(serpapi): show quota and extend Amazon timeout
  • b2cf02d feat(tools): add SerpApi Google Trends
  • beef767 feat(tools): add SerpApi Google Trending Now
  • 6ab98ca fix(config): align intelligence env examples
  • 6339a74 feat(tools): add SerpApi Google News Light
  • 27c9b11 feat(tools): add SerpApi Google Local
  • de506c9 feat(tools): add SerpApi Google Local Services
  • 877d574 feat(tools): add secure SerpApi Google Images search
  • 676236b update readme
  • b111b2f feat(tools): add SerpApi Google Shopping Light
  • 70f6e05 feat(workflows): add SerpApi shopping and travel recipes
  • 57966b4 feat(workflows): compare local service providers
  • 0f2b45b feat(workflows): allow unavailable optional tools
  • a6b5abe fix(web): keep tool details above chat
  • f4ffa77 Add SerpApi Google Sports and game brief workflow
  • 4541366 v2.55.3

Files Added Or Notable New Paths

  • api/routes/generated_music.py
  • bin/cleanup-all
  • bin/cleanup-audio
  • bin/question-mic-local.sh
  • bin/question-mic.sh
  • bin/question-orchestrator-local.sh
  • bin/question-orchestrator.sh
  • bin/reconcile-profile
  • bin/spotify-auth
  • bin/spotify-reauth
  • bin/stt-local.py
  • bin/stt.py
  • bin/sync-memory-db.py
  • bin/test-mcp
  • data/workflows/buying_brief.json
  • data/workflows/game_brief.json
  • data/workflows/knowledge_snapshot.json
  • data/workflows/local_services_compare.json
  • data/workflows/pdf_ingest.json
  • data/workflows/serpapi_amazon_search.json
  • data/workflows/vacation_reconnaissance.json
  • docs/SPEECH_TO_TEXT.md
  • docs/api/GENERATED_MUSIC.md
  • docs/images/jarvis-audio.jpg
  • docs/tools/flight-search-tool/README.md
  • docs/tools/generate-music-tool/README.md
  • jarvis-canvas/client/static/css/audio-gallery.css
  • jarvis-canvas/client/static/js/audio-gallery.js
  • jarvis-canvas/client/templates/audio-gallery.html
  • jarvis-canvas/server/routes/audio_gallery.py
  • jarvis-web/client/js/structured-results.js
  • jarvis-web/server/services/pdf_upload.py
  • lib/audio_catalog.py
  • lib/http_client.py
  • lib/image_catalog.py
  • lib/intel_filename.py
  • lib/llm_provider.py
  • lib/mcp_client.py
  • lib/memory_db.py
  • lib/model_catalog.py
  • lib/price_alert_config.py
  • lib/provider_errors.py
  • lib/rate_limiter.py
  • lib/self_play.py
  • lib/serpapi_client.py
  • lib/stash_helper.py
  • lib/stt_client.py
  • lib/tool_logger.py
  • lib/tool_profiles.py
  • lib/tool_schema.py
  • lib/user_profile.py
  • lib/video_catalog.py
  • skills/flight_search.py
  • skills/flight_search.tool.json
  • skills/profiles/openai_only.json
  • skills/serpapi_google_images_light.py
  • skills/serpapi_google_images_light.tool.json
  • skills/serpapi_google_local.py
  • skills/serpapi_google_local.tool.json
  • skills/serpapi_google_local_services.py
  • skills/serpapi_google_local_services.tool.json
  • skills/serpapi_google_news_light.py
  • skills/serpapi_google_news_light.tool.json
  • skills/serpapi_google_shopping_light.py
  • skills/serpapi_google_shopping_light.tool.json
  • skills/serpapi_google_sports.py
  • skills/serpapi_google_sports.tool.json
  • skills/serpapi_google_trending_now.py
  • skills/serpapi_google_trending_now.tool.json
  • skills/serpapi_google_trends.py
  • skills/serpapi_google_trends.tool.json
  • skills/serpapi_search_index.py
  • skills/serpapi_search_index.tool.json
  • skills/serpapi_tripadvisor.py
  • skills/serpapi_tripadvisor.tool.json
  • tests/test_canvas_audio_embed.py
  • tests/test_canvas_audio_gallery.py
  • tests/test_canvas_table_scroll.py
  • tests/test_canvas_video_model_badge.py
  • tests/test_chat_followup_spotify.py
  • ...and 43 more notable path(s).

Links