Skip to content

sgrep v2.0.0

Choose a tag to compare

@github-actions github-actions released this 08 Dec 21:00

sgrep v2.0.0

🚀 What's New

Modal GPU Offload

Offload embeddings to Modal.dev A10G GPUs for faster indexing and search on large codebases:

  • sgrep index --offload - Index using cloud GPUs
  • sgrep search --offload - Search using cloud embeddings
  • Concurrent embedding requests with keep-alive connections
  • Configurable batch size (default: 128) and concurrency
  • Auto-deploy Modal service on first use

⚡ Performance Improvements

  • Parallel embedding batches with progress-safe ordering
  • Keep-alive tuned HTTP agent for Modal requests
  • Optional gzip compression for payloads
  • Improved embedding progress tracking

🔧 Configuration

  • New [modal] config section for token and endpoint settings
  • Batch size and concurrency configurable via config or env vars
  • Simplified GPU config: A10G used for all Modal workloads
  • Enhanced logging with consistent formatting

🐛 Bug Fixes & Improvements

  • Handle missing namespaces on delete operations
  • Truncate Modal embeddings to model limits
  • Increase Modal startup timeout to prevent initialization failures
  • Use Jina embeddings on Modal for index/search compatibility

📦 Build & Release

  • Switch from bun publish to npm publish
  • Fix npm publish workflow authentication
  • Add manual workflow trigger for publishing

What's Changed

Full Changelog: v1.5.5...v2.0.0