Update dependency litellm to v1.60.8 #2028

renovate · 2025-02-08T18:30:34Z

This PR contains the following updates:

Package	Change	Age	Adoption	Passing	Confidence
litellm	`1.59.7` -> `1.60.8`

Release Notes

BerriAI/litellm (litellm)

`v1.60.8`

What's Changed

UI Updates by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8345
OIDC Scope based model access by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8343
Fix azure max retries error by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8340
Update deepseek API prices for 2025-02-08 by @Winston-503 in https://github.com/BerriAI/litellm/pull/8363
fix(nvidia_nim/embed.py): add 'dimensions' support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8302
fix: dictionary changed size during iteration error (#8327) by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8341
fix: add azure/o1-2024-12-17 to model_prices_and_context_window.json by @byrongrogan in https://github.com/BerriAI/litellm/pull/8371
(Security fix) Mask redis pwd on /cache/ping + add timeout value and elapsed time on azure + http calls by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8377
Handle azure deepseek reasoning response (#8288) by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8366
Anthropic Citations API Support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8382
(Feat) - Add /bedrock/invoke support for all Anthropic models by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8383
O3 mini native streaming support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8387

Full Changelog: BerriAI/litellm@v1.60.6...v1.60.8

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.8

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	170.0	189.56173781509457	6.206468643400922	0.0	1855	0	149.30551800000558	3488.08786699999
Aggregated	Passed ✅	170.0	189.56173781509457	6.206468643400922	0.0	1855	0	149.30551800000558	3488.08786699999

`v1.60.6`

Compare Source

What's Changed

Azure OpenAI improvements - o3 native streaming, improved tool call + response format handling by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8292
Fix edit team on ui by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8295
Improve rpm check on keys by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8301
docs: fix enterprise links by @wagnerjt in https://github.com/BerriAI/litellm/pull/8294
Add gemini-2.0-flash pricing + model info by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8303
Add Arize Cookbook for Turning on LiteLLM Proxy by @exiao in https://github.com/BerriAI/litellm/pull/8336
Add aistudio GEMINI 2.0 to model_prices_and_context_window.json by @dceluis in https://github.com/BerriAI/litellm/pull/8335
Fix pricing for Gemini 2.0 Flash 001 by @elabbarw in https://github.com/BerriAI/litellm/pull/8320
[DOCS] Update local_debugging.md by @rokbenko in https://github.com/BerriAI/litellm/pull/8308
(Bug Fix - Langfuse) - fix for when model response has choices=[] by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8339
Fixed meta llama 3.3 key for Databricks API by @anton164 in https://github.com/BerriAI/litellm/pull/8093
fix(utils.py): handle key error in msg validation by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8325
(bug fix router.py) - safely handle choices=[] on llm responses by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8342
(QA+UI) - e2e flow for adding assembly ai passthrough endpoints by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8337

New Contributors

@exiao made their first contribution in https://github.com/BerriAI/litellm/pull/8336
@dceluis made their first contribution in https://github.com/BerriAI/litellm/pull/8335
@rokbenko made their first contribution in https://github.com/BerriAI/litellm/pull/8308
@anton164 made their first contribution in https://github.com/BerriAI/litellm/pull/8093

Full Changelog: BerriAI/litellm@v1.60.5...v1.60.6

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.6

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	217.05167674521235	6.288425886864887	0.0	1880	0	164.17646499996863	2306.284880000021
Aggregated	Passed ✅	200.0	217.05167674521235	6.288425886864887	0.0	1880	0	164.17646499996863	2306.284880000021

`v1.60.5`

Compare Source

What's Changed

Added a guide for users who want to use LiteLLM with AI/ML API. by @waterstark in https://github.com/BerriAI/litellm/pull/7058
Added compatibility guidance, etc. for xAI Grok model by @zhaohan-dong in https://github.com/BerriAI/litellm/pull/8282
(Security fix) - remove code block that inserts master key hash into DB by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8268
(UI) - Add Assembly AI provider to UI by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8297
(feat) - Add Assembly AI to model cost map by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8298
fixed issues #8126 and #8127 (#8275) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8299
(Refactor) - migrate bedrock invoke to BaseLLMHTTPHandler class by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8290

New Contributors

@waterstark made their first contribution in https://github.com/BerriAI/litellm/pull/7058

Full Changelog: BerriAI/litellm@v1.60.4...v1.60.5

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.5

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	251.44053604962153	6.19421782055854	0.0	1854	0	167.35073600000305	4496.06190000003
Aggregated	Passed ✅	210.0	251.44053604962153	6.19421782055854	0.0	1854	0	167.35073600000305	4496.06190000003

`v1.60.4`

Compare Source

What's Changed

Internal User Endpoint - vulnerability fix + response type fix by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8228
Litellm UI fixes 8123 v2 (#8208) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8245
Update model_prices_and_context_window.json by @superpoussin22 in https://github.com/BerriAI/litellm/pull/8249
Update model_prices_and_context_window.json by @superpoussin22 in https://github.com/BerriAI/litellm/pull/8256
(dependency) - pip loosen httpx version requirement by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8255
Add hyperbolic deepseek v3 model configurations by @lowjiansheng in https://github.com/BerriAI/litellm/pull/8232
fix(prometheus.py): fix setting key budget metrics by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8234
(feat) - add supports tool choice to model cost map by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8265
(feat) - track org_id in SpendLogs by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8253
(Bug fix) - Langfuse / Callback settings stored in DB by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8251
Fix passing top_k parameter for Bedrock Anthropic models (#8131) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8269
(Feat) - Add support for structured output on bedrock/nova models + add util litellm.supports_tool_choice by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8264
[BETA] Support OIDC role based access to proxy by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8260
Fix deepseek calling - refactor to use base_llm_http_handler by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8266
allows dynamic message redaction by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8270

Full Changelog: BerriAI/litellm@v1.60.2...v1.60.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	243.98647747354212	6.187158959524932	0.0033407985742575225	1852	1	94.81396500007122	3976.009301999966
Aggregated	Passed ✅	210.0	243.98647747354212	6.187158959524932	0.0033407985742575225	1852	1	94.81396500007122	3976.009301999966

`v1.60.2`

Compare Source

What's Changed

Control Model Access by IDP 'groups' by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8164
build(schema.prisma): add new sso_user_id to LiteLLM_UserTable by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8167
Litellm dev contributor prs 01 31 2025 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8168
Improved O3 + Azure O3 support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8181
test: add more unit testing for team member endpoints by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8170
Add azure/deepseek-r1 by @Klohto in https://github.com/BerriAI/litellm/pull/8177
[Bug Fix] - /vertex_ai/ was not detected as llm_api_route on pass through but vertex-ai was by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8186
(UI + SpendLogs) - Store SpendLogs in UTC Timezone, Fix filtering logs by start/end time by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8190
Azure AI Foundry - Deepseek R1 by @elabbarw in https://github.com/BerriAI/litellm/pull/8188
fix(main.py): fix passing openrouter specific params by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8184
Complete o3 model support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8183
Easier user onboarding via SSO by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8187
LiteLLM Minor Fixes & Improvements (01/16/2025) - p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7828
Added deprecation date for gemini-1.5 models by @yurchik11 in https://github.com/BerriAI/litellm/pull/8210
docs: Updating the available VoyageAI models in the docs by @fzowl in https://github.com/BerriAI/litellm/pull/8215
build: ui updates by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8206
Fix tokens for deepseek by @SmartManoj in https://github.com/BerriAI/litellm/pull/8207
(UI Fixes for add new model flow) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8216
Update xAI provider and fix some old model config by @zhaohan-dong in https://github.com/BerriAI/litellm/pull/8218
Support guardrails mode as list, fix valid keys error in pydantic, add more testing by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8224
docs: fix typo in lm_studio.md by @foreign-sub in https://github.com/BerriAI/litellm/pull/8222
(Feat) - New pass through add assembly ai passthrough endpoints by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8220
fix(openai/): allows 'reasoning_effort' param to be passed correctly by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8227

New Contributors

@Klohto made their first contribution in https://github.com/BerriAI/litellm/pull/8177
@zhaohan-dong made their first contribution in https://github.com/BerriAI/litellm/pull/8218
@foreign-sub made their first contribution in https://github.com/BerriAI/litellm/pull/8222

Full Changelog: BerriAI/litellm@v1.60.0...v1.60.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	170.0	187.78487681207412	6.365583292626693	0.0	1905	0	135.5453470000043	3644.0179759999864
Aggregated	Passed ✅	170.0	187.78487681207412	6.365583292626693	0.0	1905	0	135.5453470000043	3644.0179759999864

`v1.60.0`

What's Changed

Important Changes between v1.50.xx to 1.60.0

def async_log_stream_event and def log_stream_event no longer supported for CustomLoggers https://docs.litellm.ai/docs/observability/custom_callback. If you want to log stream events use def async_log_success_event and def log_success_event for logging success stream events

Known Issues

🚨 Detected issue with Langfuse Logging when Langfuse credentials are stored in DB

Adding gemini-2.0-flash-thinking-exp-01-21 by @marcoaleixo in https://github.com/BerriAI/litellm/pull/8089
add groq/deepseek-r1-distill-llama-70b by @miraclebakelaser in https://github.com/BerriAI/litellm/pull/8078
(UI) Fix SpendLogs page - truncate bedrock models + show end_user by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8118
UI Fixes - Newly created key does not display on the View Key Page + Updated the validator to allow model editing when keyTeam.team_alias === "Default Team" by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8122
(Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8112
(UI) fix adding Vertex Models by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8129
Fix json_mode parameter propagation in OpenAILikeChatHandler by @miraclebakelaser in https://github.com/BerriAI/litellm/pull/8133
Doc updates - add key rotations to docs by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8136
Enforce default_on guardrails always run + expose new litellm.disable_no_log_param param by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8134
Doc updates + management endpoint fixes by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8138
New stable release - release notes by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8148
FEATURE: OpenAI o3-mini by @ventz in https://github.com/BerriAI/litellm/pull/8151
build: fix model cost map with o3 model pricing by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8153
(Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8156
(UI) Allow adding custom pricing when adding new model by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8165
(Feat) add bedrock/deepseek custom import models by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8132
Adding Azure OpenAI o3-mini costs & specs by @yigitkonur in https://github.com/BerriAI/litellm/pull/8166
Adjust model pricing metadata by @yurchik11 in https://github.com/BerriAI/litellm/pull/8147

New Contributors

@marcoaleixo made their first contribution in https://github.com/BerriAI/litellm/pull/8089
@yigitkonur made their first contribution in https://github.com/BerriAI/litellm/pull/8166

Full Changelog: BerriAI/litellm@v1.59.10...v1.60.0

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.0

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	240.0	281.07272626532927	6.158354312051399	0.0	1843	0	215.79772499995897	3928.489000000013
Aggregated	Passed ✅	240.0	281.07272626532927	6.158354312051399	0.0	1843	0	215.79772499995897	3928.489000000013

`v1.59.10`

Compare Source

What's Changed

(UI) - View Logs Page - Refinement by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8087
(Feat) pass through vertex - allow using credentials defined on litellm router for vertex pass through by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8100
(UI) Allow using a model / credentials for pass through routes by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8099
ui - fix chat ui tab sending model param by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8105
Litellm dev 01 29 2025 p1 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8097
Support new bedrock/converse_like/<model> route by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8102
feat(databricks/chat/transformation.py): add tools and 'tool_choice' param support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8076

Full Changelog: BerriAI/litellm@v1.59.9...v1.59.10

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.10

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	239.24647793068146	6.21745665443628	0.00334092243655899	1861	1	73.25327600000264	3903.3159660000083
Aggregated	Passed ✅	210.0	239.24647793068146	6.21745665443628	0.00334092243655899	1861	1	73.25327600000264	3903.3159660000083

`v1.59.9`

Compare Source

What's Changed

Fix custom pricing - separate provider info from model info by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7990
Litellm dev 01 25 2025 p4 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8006
(UI) - Adding new models enhancement - show provider logo by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8033
(UI enhancement) - allow onboarding wildcard models on UI by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8034
add openrouter/deepseek/deepseek-r1 by @paul-gauthier in https://github.com/BerriAI/litellm/pull/8038
(UI) - allow assigning wildcard models to a team / key by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8041
Add smolagents by @aymeric-roucher in https://github.com/BerriAI/litellm/pull/8026
(UI) fixes to add model flow by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8043
github - run stale issue/pr bot by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8045
(doc) Add nvidia as provider by @raspawar in https://github.com/BerriAI/litellm/pull/8023
feat(handle_jwt.py): initial commit adding custom RBAC support on jwt… by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8037
fix(utils.py): handle failed hf tokenizer request during calls by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8032
Bedrock document processing fixes by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8005
Fix bedrock model pricing + add unit test using bedrock pricing api by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7978
Add openai metadata param preview support + new x-litellm-timeout request header by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8047
(beta ui - spend logs view fixes & Improvements 1) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8062
(fix) - proxy reliability, ensure duplicate callbacks are not added to proxy by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8067
(UI) Fixes for Adding model page - keep existing page as default, have 2nd tab for wildcard models by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8073

New Contributors

@aymeric-roucher made their first contribution in https://github.com/BerriAI/litellm/pull/8026
@raspawar made their first contribution in https://github.com/BerriAI/litellm/pull/8023

Full Changelog: BerriAI/litellm@v1.59.8...v1.59.9

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.9

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Failed ❌	270.0	301.01550717582927	6.14169679840119	0.0	1837	0	234.85362500002793	3027.238808999982
Aggregated	Failed ❌	270.0	301.01550717582927	6.14169679840119	0.0	1837	0	234.85362500002793	3027.238808999982

`v1.59.8`

Compare Source

What's Changed

refactor: cleanup dead codeblock by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7936
add type annotation for litellm.api_base (#7980) by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7994
(QA / testing) - Add unit testing for key model access checks by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7999
(Prometheus) - emit key budget metrics on startup by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8002
(Feat) set guardrails per team by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7993
Supported nested json schema on anthropic calls via proxy + fix langfuse sync sdk issues by @krrishdholakia in https://github.com/BerriAI/litellm/pull/8003
Bug fix - [Bug]: If you create a key tied to a user that does not belong to a team, and then edit the key to add it to a team (the user is still not a part of a team), using that key results in an unexpected error by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8008
(QA / testing) - Add e2e tests for key model access auth checks by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8000
(Fix) langfuse - setting LANGFUSE_FLUSH_INTERVAL by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/8007

Full Changelog: BerriAI/litellm@v1.59.7...v1.59.8

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.8

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Failed ❌	280.0	325.48398318207154	6.003526201462839	0.0	1796	0	234.56590200004257	3690.442290999954
Aggregated	Failed ❌	280.0	325.48398318207154	6.003526201462839	0.0	1796	0	234.56590200004257	3690.442290999954

Configuration

📅 Schedule: Branch creation - "every weekend" in timezone US/Eastern, Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

renovate-approve bot approved these changes Feb 8, 2025

View reviewed changes

renovate bot force-pushed the renovate/litellm-1.x branch 2 times, most recently from a47116d to 8514ac7 Compare February 8, 2025 22:44

Update dependency litellm to v1.60.8

30602c2

renovate bot force-pushed the renovate/litellm-1.x branch from 8514ac7 to 30602c2 Compare February 9, 2025 02:13

renovate bot merged commit 5617b50 into main Feb 9, 2025
11 checks passed

renovate bot deleted the renovate/litellm-1.x branch February 9, 2025 06:26

odlbot mentioned this pull request Feb 10, 2025

Release 0.30.2 #2032

Merged

12 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update dependency litellm to v1.60.8 #2028

Update dependency litellm to v1.60.8 #2028

Uh oh!

renovate bot commented Feb 8, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Update dependency litellm to v1.60.8 #2028

Update dependency litellm to v1.60.8 #2028

Uh oh!

Conversation

renovate bot commented Feb 8, 2025

Release Notes

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Important Changes between v1.50.xx to 1.60.0

Known Issues

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

Configuration

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant