Skip to content

v1.1.2 - Venice Large 128k Context Documentation Update

Choose a tag to compare

View all tags
@sethbang sethbang released this 19 Jun 21:20
· 102 commits to main since this release
v1.1.2
f9884c7

Documentation Updates for Venice Large 128k Context Window

This release updates the SDK documentation to reflect recent Venice.ai API improvements, specifically the Venice Large model's increased context window from 32k to 128k tokens.

📚 Documentation Changes

  • Enhanced README.md: Added Venice Large model examples and context window guidance
  • Updated Client Utilities: Added model capability notes and token management best practices
  • Enhanced Streaming Guide: Added large context window usage examples
  • Comprehensive Examples: Practical demonstrations of leveraging 128k context with max_completion_tokens

🔄 API Compatibility

  • No Breaking Changes: Full backward compatibility maintained
  • Automatic Benefits: Existing functionality automatically benefits from API improvements
  • Venice Large Support: Users can now leverage up to 128k tokens through existing max_completion_tokens parameter
  • Cleaner Responses: Non-streaming chat completions now receive improved responses due to server-side processing enhancements

🚀 What's New

  • Venice Large model now supports 128k token context window (increased from 32k)
  • Server-side "thinking" message processing improvements for cleaner non-streaming responses
  • Enhanced documentation with practical examples and best practices

No SDK code changes were required - the existing functionality seamlessly supports these API improvements.

Assets 2
Loading