v1.10.0

What's Changed

• provider: add Nscale provider by @tomukmatthews in #1087
• Add panw-prisma-airs plugin with tests and update config/index by @jroberts2600 in #1088
• add link to devin deepwiki by @vrushankportkey in #1109
• New Feature: Background mode param on OpenAI responses API by @siddharthsambharia-portkey in #1111
• Add seed param for Vertex AI and Google Gemini Provider by @siddharthsambharia-portkey in #1115
• support anthropic computer use by @narengogi in #1126
• fix multi turn tool calling for anthropic when arguments to the tool call is an empty object by @narengogi in #1104
• Fix panw-prisma-airs manifest.json to use proper JSON schema format by @jroberts2600 in #1128
• add feat. kluster_ai by @Ajay-Satish-01 in #1082
• provider: added support for Hyperbolic AI by @Utkarsh-0304 in #1108
• fix: support custom-host for azure plugin to support privatelink by @b4s36t4 in #1117
• fix thinking for gemini models by @narengogi in #1113
• feature: inference profiles for bedrock by @narengogi in #1118
• support service tier for groq by @narengogi in #1146
• assumed role support for bedrock application inference profile by @narengogi in #1131
• anthropic prompt caching for tool result and tool use by @narengogi in #1141
• fix: Exa guardrail by @vrushankportkey in #1150
• add featherless provider (access to 7900+ open source models) by @DarinVerheijke in #1138
• Add SUTRA Integration with Portkey – New Cookbook by @Shubhwithai in #1137
• return finish reason in bedrock error chunk by @narengogi in #1143
• feat: add required metadata keys plugin by @VisargD in #1147
• fix: index.html page example by @horochx in #1120
• Add request, response log for the Portkey PII plugin to the main requ… by @roh26it in #1052
• feat: support extra endpoints for azure-ai provider by @b4s36t4 in #1148
• fix: return error response for webhook non-timeout error by @b4s36t4 in #1167
• Chore/Fix-installation-guide-readme by @siddharthsambharia-portkey in #1170
• fix: Rename Model Whitelist to Allowed Models by @vrushankportkey in #1144
• feat: add support for vertex-ai global region endpoints by @VisargD in #1171
• improve strict openai compliance by @narengogi in #1165
• Revert "fix: Exa guardrail" by @VisargD in #1173
• feat: base integration for circuit breaker by @sk-portkey in #1163
• 1.10.0 by @VisargD in #1174

New Contributors

• @tomukmatthews made their first contribution in #1087
• @jroberts2600 made their first contribution in #1088
• @Utkarsh-0304 made their first contribution in #1108
• @DarinVerheijke made their first contribution in #1138
• @Shubhwithai made their first contribution in #1137
• @horochx made their first contribution in #1120

Full Changelog: v1.9.19...v1.10.0

v1.9.19

What's Changed

• patch: remove response_format for bedrock top level by @narengogi in #1083
• feat: add support for mistral function calling by @flipace in #1081
• fix: return tool calls in non streaming openrouter responses by @unsync in #1068
• fix: add is_enabled param mapping for shorthand guardrails by @VisargD in #1094
• encode model in uri to support bedrock inference profile as model by @narengogi in #1093
• multimodal embeddings for vertex by @narengogi in #1086
• feat: jwt guardrails for runtime token validation by @sk-portkey in #1095
• fix vertex video embeddings mode/config by @narengogi in #1097
• fix: handle empty content for bedrock tool role message by @VisargD in #1099
• fix: type errors raised due to multimodal embeddings type by @VisargD in #1100
• 1.9.19 by @VisargD in #1101

New Contributors

• @flipace made their first contribution in #1081

Full Changelog: v1.9.18...v1.9.19

v1.9.18

What's Changed

• Fix/unhandled exception in groq streaming requests by @metinogurlu in #1073
• audio routes for groq and response_format for bedrock by @narengogi in #1049
• feat: support openrouter usage in api by @unsync in #1055
• feat: adds image generation capability to Workers AI API by @unsync in #1064
• integration: Add integration with the Prompt Security GenAI security platform by @lior-ps in #1066
• delete unsupported $schema param from vertex and google by @narengogi in #1071
• Allow hook based logs by @roh26it in #1051
• do not invoke getEndpoint() when proxy route by @narengogi in #1077
• Fix/support provider specific fields for bedrock in snake case by @narengogi in #1070
• support anthropic_beta as a top level parameter for anthropic on bedr… by @narengogi in #1079
• anthropic pdf by @narengogi in #1074
• 1.9.18 by @VisargD in #1080

New Contributors

• @metinogurlu made their first contribution in #1073
• @lior-ps made their first contribution in #1066

Full Changelog: v1.9.17...v1.9.18

v1.9.17

What's Changed

• chore: add anthropic_beta param by @b4s36t4 in #1060
• fix: azure content safety plugin with blocklist by @b4s36t4 in #1061
• feat: support bedrock prompt caching by @b4s36t4 in #1059
• add support for gemini thinking input params by @narengogi in #1058
• 1.9.17 by @VisargD in #1065

Full Changelog: v1.9.16...v1.9.17

v1.9.16

What's Changed

• Handle ping by @francescov1 in #1037
• Add usage to final chunk for deepinfra by @francescov1 in #1041
• fix: replace chat_completion by chat.completion in providers responses by @unsync in #1044
• feat: supports specific openrouter request parameters by @unsync in #1045
• fix: support custom mime type for vertex files by @sk-portkey in #1046
• feat: azure plugin support for pii and content safety by @b4s36t4 in #1048
• feat. add lepton ai by @Ajay-Satish-01 in #1034
• Exa plugin for online search by @roh26it in #1027
• Update pull_request_template.md by @code-crusher in #1032
• feat: passthrough oai embed response without opening body by @VisargD in #1053
• [FIX] remove /v1 from path for azure openai by @narengogi in #1056
• 1.9.16 by @VisargD in #1057

New Contributors

• @francescov1 made their first contribution in #1037

Full Changelog: v1.9.15...v1.9.16

v1.9.15

What's Changed

• fix: give preference to provider error code over hooks failure respon… by @VisargD in #1018
• Updated Markdown Files by @KPCOFGS in #1006
• feature: add openrouter tools support and handle error chunks by @unsync in #1024
• support search recency filter for perplexity by @narengogi in #1025
• Chore/return model in response by @narengogi in #982
• support responses endpoints as part of unified routes by @narengogi in #1021
• fix: handle model check for finetune/batches by @b4s36t4 in #1020
• feat: allow retry based on headers and skip expoential backoff by @b4s36t4 in #1030
• feat: update azure foundry provider by @b4s36t4 in #1029
• 1.9.14 by @VisargD in #1036
• update null check in provider config for bedrock by @narengogi in #1038
• fix: make patch package as part of main dep for docker builds & move … by @b4s36t4 in #1039
• 1.9.15 by @VisargD in #1040

New Contributors

• @KPCOFGS made their first contribution in #1006

Full Changelog: v1.9.13...v1.9.15

v1.9.13

What's Changed

• feat(guardrails): add lasso security guardrails by @raskanskyz-lasso in #971
• chore: add default status codes only when retry attempts are configured by @VisargD in #1010
• feat: add logprobs support for fireworks by @VisargD in #1009
• fix: handle 246 status code for stream responses by @VisargD in #1008
• Feat: anthropic thinking json to stream transform by @VisargD in #1014
• chore: add strict status code checks for mapping 246 response code by @VisargD in #1015
• 1.9.13 by @VisargD in #1016

New Contributors

• @raskanskyz-lasso made their first contribution in #971

Full Changelog: v1.9.12...v1.9.13

v1.9.12

What's Changed

• feat: Add Snowflake Cortex LLM API by @Ajay-Satish-01 in #988
• Feature: Changes for anthropic thinking by @narengogi in #1001
• 1.9.12 by @VisargD in #1004

Full Changelog: v1.9.11...v1.9.12

v1.9.11

What's Changed

• fix: use bedrock job_id and job_arn for response by @b4s36t4 in #958
• docs: add ec2 quicklaunch cloudformation template by @code-crusher in #978
• Add labels parameter in Vertex AI by @elentaure in #984
• fix: logging error with more than 1k characters by @urbanonymous in #970
• fix: bedrock guardrail handling update by @b4s36t4 in #990
• chore: vertex finetune and batches cleanup by @b4s36t4 in #989
• feat: kms key support for put requests in bedrock by @narengogi in #977
• handle thinking messages for anthropic by @narengogi in #987
• fix: remove conditional for bedrock list/get endpoints, date fixes by @b4s36t4 in #993
• Providers/ncompass by @vineye25 in #983
• fix: handle null content for tool use assistant message for bedrock by @VisargD in #992
• fix: add handling to detect all errors in retry handler by @VisargD in #991
• feat: add support for default guardrails by @VisargD in #986
• support passing image url for anthropic and vertex anthropic by @narengogi in #976
• support search mode param from pplx by @narengogi in #998
• changes to support cached streaming in grounding requests by @narengogi in #994
• 1.9.11 by @VisargD in #999

New Contributors

• @code-crusher made their first contribution in #978
• @urbanonymous made their first contribution in #970
• @vineye25 made their first contribution in #983

Full Changelog: v1.9.10...v1.9.11

v1.9.10

What's Changed

• add webm support for vertex prompting with images and videos by @narengogi in #967
• acuvity integration: fix guards and return data. by @abhijitherekar in #966
• chore: map usage object in openrouter stream chunk by @VisargD in #973
• 1.9.10 by @VisargD in #974

Full Changelog: v1.9.9...v1.9.10