Skip to content

v2.4.3 - πŸ€– Nova & πŸ›‘ Stop Sequences

Choose a tag to compare

@jparkerweb jparkerweb released this 31 Jul 19:24
· 57 commits to main since this release
1176e09

2.4.0 - AWS Nova Models

✨ Added

  • Support for AWS Nova models
    • Nova-Pro (300K context, multimodal, 5K output tokens)
    • Nova-Lite (300K context, multimodal, optimized for speed)
    • Nova-Micro (128K context, text-only, lowest latency)
  • Nova-specific API format handling with schemaVersion "messages-v1"
  • Proper inferenceConfig parameter structure for Nova models
  • Automatic content array formatting for Nova message compatibility

2.4.2 - Stop Sequences Support

✨ Added

  • Stop sequences support for all models
    • OpenAI-compatible stop and stop_sequences parameters
    • Automatic string-to-array conversion for compatibility
    • Model-specific parameter mapping (stop_sequences for Claude, stopSequences for Nova, stop for Llama/Mistral)
  • Enhanced request building logic to include stop sequences in appropriate API formats
  • Comprehensive stop sequences testing and validation

Technical Details

  • Added stop_sequences_param_name configuration to all 26+ model definitions
  • Updated request construction for both messages API and prompt-based models
  • Supports both single string and array formats for stop sequences
  • Maintains full backward compatibility with existing API usage

2.4.3 - Stop Sequences Fixes

πŸ› Fixed

  • Critical Discovery: Removed stop sequences support from Llama models
    • AWS Bedrock does not support stop sequences for Llama models (confirmed via official AWS documentation)
    • Llama models only support: prompt, temperature, top_p, max_gen_len, images
    • This is an AWS Bedrock limitation, not a wrapper limitation
  • Fixed Nova model configuration conflicts that were causing stop sequence inconsistencies
    • Removed conflicting empty inferenceConfig: {} from Nova model configurations
  • Improved error handling for empty responses when stop sequences trigger early

πŸ“¦ Updated

  • Documentation corrections
    • Corrected stop sequences support claims (removed "all models support" language)
    • Added accurate model-specific support matrix with sequence limits
    • Added comprehensive stop sequences support table with AWS documentation references
  • Model Support Matrix now clearly documented:
    • βœ… Claude models: Full support (up to 8,191 sequences)
    • βœ… Nova models: Full support (up to 4 sequences)
    • βœ… Mistral models: Full support (up to 10 sequences)
    • ❌ Llama models: Not supported (AWS Bedrock limitation)

πŸ“ƒ Technical Details

  • Based on comprehensive research of official AWS Bedrock documentation
  • All changes maintain full backward compatibility
  • Test results show significant improvements in stop sequences reliability for supported models
  • Added detailed explanations to help users understand AWS Bedrock's actual capabilities