Skip to content

spider_agent v0.4.0

Choose a tag to compare

@j-mendez j-mendez released this 03 Feb 14:34
· 743 commits to main since this release

Spider Agent v0.4.0

Performance Optimizations

This release adds several performance optimizations for automation workflows:

Smart Caching

  • SmartCache: Size-aware LRU cache with automatic cleanup
    • Bounded memory usage with configurable limits
    • TTL-based expiration
    • Automatic cleanup on memory pressure
    • Statistics tracking (hits, misses, evictions)

High-Performance Execution

  • ChainExecutor: Parallel step execution for automation chains

    • Analyzes dependencies for optimal parallelization
    • Response caching with TTL
    • Configurable concurrency limits
    • Step timeout support
  • BatchExecutor: Efficient batch processing

    • Process multiple items with configurable batch sizes
    • Parallel execution within batches
    • Index-aware processing option
  • PrefetchManager: Predictive page loading

    • Prefetch URLs in the background
    • Automatic cache management
    • Concurrent prefetch limits

Smart Model Routing

  • ModelRouter: Intelligent model selection based on task complexity
    • Task analysis for complexity scoring
    • User-configurable model policies
    • Cost tier constraints (Low/Medium/High)
    • Latency-aware routing

Other Changes

  • Added MessageContent helper methods: as_text(), full_text(), is_text(), has_images()
  • Default ModelPolicy now allows High tier routing
  • Fixed compilation warnings

Full Changelog

spider_agent-v0.3.0...spider_agent-v0.4.0