Release 3.2.1

What's new

This small patch release primarily focuses on integrating OpenRouter for model pricing/metadata and refining cost calculations.

✨ Features

• Set default models to use OpenRouter ([915699c]).
• Fetch model prices and metadata automatically from OpenRouter, improving reliability ([7f840b7]).

🐛 Fixes & Enhancements

• Much improved price calculation and handling:
  • Reworked computation to account for internal thinking costs ([c0b90d8]).
  • Enhanced method for retrieving model prices, supported parameters and maximum context size ([a17b41c]).
  • Clearer error message when model prices are missing ([2b29a9d]).
• Updated litellm dependency ([179b589]).

🧪 Tests

• API integration tests now fail faster if an underlying API call fails ([9a0c856]).

Commits details since the last release

• [03aeab2] by @thiswillbeyourgithub, 2 minutes ago:
  bump version 3.2.0 -> 3.2.1

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [915699c] by @thiswillbeyourgithub, 6 minutes ago:
  new: set the default models to use openrouter
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md
wdoc/utils/env.py

• [c0b90d8] by @thiswillbeyourgithub, 64 minutes ago:
  fix: reworked how pricing are computed to take internal thinking into account
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py
wdoc/utils/misc.py
wdoc/utils/tasks/summarize.py
wdoc/wdoc.py

• [a17b41c] by @thiswillbeyourgithub, 80 minutes ago:
  enh: better way to get the model prices
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py
wdoc/wdoc.py

• [9a0c856] by @thiswillbeyourgithub, 22 minutes ago:
  test: crash early if one api crash fails
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/run_all_tests.sh

• [7f840b7] by @thiswillbeyourgithub, 2 hours ago:
  feat: automatically fetch the price and metadata from openrouter instead of waiting for litellm
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py
wdoc/wdoc.py

• [2b29a9d] by @thiswillbeyourgithub, 2 hours ago:
  fix: error message on missing model price
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [179b589] by @thiswillbeyourgithub, 2 hours ago:
  bump litellm version
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py