0.16.1

What's Changed

• [ROB-2343] added support pull external changes by @Avi-Robusta in #1064
• fix broken links by @RoiGlinik in #1068
• ROB-2405: document stream events by @nherment in #1073
• Remove link from CNCF announcement section by @aantn in #1072
• Add prometheus metric tests based on a fictional electricity bidding market by @Sheeproid in #1069
• ROB-2424: link to www docs at top of README by @nherment in #1076
• Add test imports by @moshemorad in #1077
• ROB-2290 fetch resource issues tool by @RoiGlinik in #1065
• [ROB-2391] removing old tools by @Avi-Robusta in #1071
• Add 4 tools for getting grafana dashboards by @Sheeproid in #1075
• [ROB-1734] Robusta runbook support + better runbook usage by @Avi-Robusta in #1061
• [ROB-2347]improve prompt cacheing by @Avi-Robusta in #1066
• ROB-2290 workload issues testing by @RoiGlinik in #1074
• allow Holmes to read CRDs by @arikalon1 in #1088
• [ROB-2429] added ollama docs for litellm issues with ollama by @Avi-Robusta in #1090
• flatten benchmark results in docs/ to a single menu item by @aantn in #1082
• Show braintrust traces on exceptions by @aantn in #1048
• More doc improvements by @aantn in #1094
• Patch pre_select supabase by @moshemorad in #1098

Full Changelog: 0.16.0...0.16.1

0.16.0

Highlights

• AWS MCP integration - Get information on IAM Roles, security groups, EC2 or costs
• Compaction - Support conversations with more data

What's Changed

• ROB-1933: make sure approved or denied tool call triggers a SSE event by @nherment in #1054
• Organize benchmarks into weekly and special runs by @aantn in #1056
• Evals: Prometheus test with error metric by @Sheeproid in #1058
• Added announcement details by @pavangudiwada in #1057
• ROB-2206 history changes improvements by @RoiGlinik in #1049
• ROB-2125 conversation history compaction by @nherment in #1014
• add ai reasoning logs by @Sheeproid in #1062
• aws mcp addon by @arikalon1 in #1063

Full Changelog: 0.15.0...0.16.0

0.15.0

Highlights

• Major improvements to the NewRelic toolset
• New Cilium and Hubble toolset (thank you @matmerr!)
• Improved truncation and handling of long conversations
• Better Gemini support
• Dozens of small improvements and bugfixes

What's Changed

• Update docs: datadog and modelList by @aantn in #942
• Fix docs for github toolset by @aantn in #979
• ROB-1933 tool approval workflow by @nherment in #919
• better datadog error messages by @aantn in #980
• ROB-2034: Limit evidence size by @nherment in #978
• Freeform newrelic by @Sheeproid in #969
• Addding llm_instructions reference to docs by @pavangudiwada in #901
• Fixes to holmes version by @aantn in #893
• Newrelic traces improvement by @Avi-Robusta in #985
• New Evals for newrelic by @Avi-Robusta in #983
• Fix the httpx dependency to make it compatible with http_proxy by @feiskyer in #991
• mute unncessary info log for console by @mainred in #994
• feat: add initial implementation of feedback command by @mainred in #989
• Support embeds for NR transactions by @mershal in #996
• ROB-2111: limit max output tokens by @nherment in #1005
• log any loaded model by @mainred in #1001
• Fix MCP toolset prerequisites check by @feiskyer in #990
• Publish model benchmarks by @aantn in #897
• make newrelic formatting result is off by default by @Sheeproid in #1008
• ROB-2189 add empty check for str case by @RoiGlinik in #1000
• ROB-2197 Allow passing custom sys prompt param in Holmes chat endpoint by @mershal in #1006
• fix alignment issue in docs banner by @Sheeproid in #1012
• ROB-2196 Add NewRelic instructions regarding traces time filters by @mershal in #1011
• ROB-2141 new relay args test by @RoiGlinik in #982
• Add benchmarks for Claude 4.5 by @aantn in #1017
• Skip test from github action which requires Prometheus by @aantn in #1010
• refactoring newrelic formatting by @Avi-Robusta in #1013
• Updated community meeting details. by @pavangudiwada in #988
• updated new relic docs to match revised toolset by @Sheeproid in #1021
• add extended benchmark by @aantn in #1020
• feat(feedback): add privacy notice by @mainred in #1002
• chore(toolset): add Cilium and Hubble to toolsets by @matmerr in #769
• Skip importing the Prometheus toolset by @arikalon1 in #992
• remove the POST version of tempo as it is not supported by @Sheeproid in #1023
• ROB-2136 link tool limit to global truncation limit by @nherment in #987
• ROB-2136: increase prometheus tool token limit to 5% by @nherment in #1026
• ROB-2136: remove prometheus tool token limit and fallback on global limit by @nherment in #1027
• fixes for gemini by @aantn in #999
• Improve cli experience by making output less spammy by @aantn in #981
• Make benchmarks more prominent in docs by @aantn in #1030
• remove experimental tag from 3 toolsets by @aantn in #1031
• Fix instruction broken into two lines by @Munken in #1032
• no trying bash tools with no env vars by @Sheeproid in #1024
• evals: exclude throttled responses from latency calculation by @aantn in #1033
• Update default models by @aantn in #864
• change default fallback context window size by @aantn in #1034
• Fix issue with env vars like CLASSIFIER_MODEL in benchmarks script by @aantn in #1038
• ROB-2227 avoid env exception when using bedrock with model list by @RoiGlinik in #1022
• Evals: create k8s object in test namespace and use local manifest by @Sheeproid in #1040
• ROB-1933: issues with SaaS approval flow by @nherment in #1037
• fix: allow the user to config api key in config file by @mainred in #1036
• add benchmarks with on-prem models by @aantn in #1042
• ROB-2233: model attributes returned by the new relay models api by @nherment in #1028
• improve ai provider docs by @aantn in #1043
• ROB-2117 add docs and option to use 1m sonnet with cli by @RoiGlinik in #1041
• limit max tool size to hard coded 25K regardless of model size by @aantn in #1045
• Build docker images on every commit by @aantn in #964
• ROB-2269 improve token counting by @nherment in #1046
• log details on context window by @aantn in #1047
• Add google-cloud-aiplatform dependency to allow Vertex AI Claude models by @fahlmant in #1029
• feat: Add experimental AG-UI supported chat endpoint and PPL query assist by @kylehounslow in #1035
• chore: add prerequisites for OpenSearchQueryAssistToolset. by @kylehounslow in #1052
• Recommend models in installation docs by @aantn in #1051
• benchmark with qwen (not optimally configured though) by @Sheeproid in #1053

New Contributors

• @feiskyer made their first contribution in #991
• @mershal made their first contribution in #996
• @matmerr made their first contribution in #769
• @Munken made their first contribution in #1032
• @fahlmant made their first contribution in #1029
• @kylehounslow made their first contribution in #1035

Full Changelog: 0.14.2...0.15.0

0.14.4-alpha

What's Changed

• Update docs: datadog and modelList by @aantn in #942
• Fix docs for github toolset by @aantn in #979
• ROB-1933 tool approval workflow by @nherment in #919
• better datadog error messages by @aantn in #980
• ROB-2034: Limit evidence size by @nherment in #978
• Freeform newrelic by @Sheeproid in #969
• Addding llm_instructions reference to docs by @pavangudiwada in #901
• Fixes to holmes version by @aantn in #893
• Newrelic traces improvement by @Avi-Robusta in #985
• New Evals for newrelic by @Avi-Robusta in #983
• Fix the httpx dependency to make it compatible with http_proxy by @feiskyer in #991
• mute unncessary info log for console by @mainred in #994
• feat: add initial implementation of feedback command by @mainred in #989
• Support embeds for NR transactions by @mershal in #996
• ROB-2111: limit max output tokens by @nherment in #1005
• log any loaded model by @mainred in #1001
• Fix MCP toolset prerequisites check by @feiskyer in #990
• Publish model benchmarks by @aantn in #897
• make newrelic formatting result is off by default by @Sheeproid in #1008
• ROB-2189 add empty check for str case by @RoiGlinik in #1000
• ROB-2197 Allow passing custom sys prompt param in Holmes chat endpoint by @mershal in #1006
• fix alignment issue in docs banner by @Sheeproid in #1012
• ROB-2196 Add NewRelic instructions regarding traces time filters by @mershal in #1011
• ROB-2141 new relay args test by @RoiGlinik in #982
• Add benchmarks for Claude 4.5 by @aantn in #1017
• Skip test from github action which requires Prometheus by @aantn in #1010
• refactoring newrelic formatting by @Avi-Robusta in #1013
• Updated community meeting details. by @pavangudiwada in #988
• updated new relic docs to match revised toolset by @Sheeproid in #1021
• add extended benchmark by @aantn in #1020
• feat(feedback): add privacy notice by @mainred in #1002
• chore(toolset): add Cilium and Hubble to toolsets by @matmerr in #769
• Skip importing the Prometheus toolset by @arikalon1 in #992
• remove the POST version of tempo as it is not supported by @Sheeproid in #1023
• ROB-2136 link tool limit to global truncation limit by @nherment in https://github.com/robusta-dev/holmesgpt/pull/987pull/1027

New Contributors

• @feiskyer made their first contribution in #991
• @mershal made their first contribution in #996
• @matmerr made their first contribution in #769

Full Changelog: 0.14.2...0.14.4-alpha

0.14.3-alpha

What's Changed

• Update docs: datadog and modelList by @aantn in #942
• Fix docs for github toolset by @aantn in #979
• ROB-1933 tool approval workflow by @nherment in #919
• better datadog error messages by @aantn in #980
• ROB-2034: Limit evidence size by @nherment in #978
• Freeform newrelic by @Sheeproid in #969
• Addding llm_instructions reference to docs by @pavangudiwada in #901
• Fixes to holmes version by @aantn in #893
• Newrelic traces improvement by @Avi-Robusta in #985
• New Evals for newrelic by @Avi-Robusta in #983
• Fix the httpx dependency to make it compatible with http_proxy by @feiskyer in #991
• mute unncessary info log for console by @mainred in #994
• feat: add initial implementation of feedback command by @mainred in #989
• Support embeds for NR transactions by @mershal in #996
• ROB-2111: limit max output tokens by @nherment in #1005
• log any loaded model by @mainred in #1001
• Fix MCP toolset prerequisites check by @feiskyer in #990
• Publish model benchmarks by @aantn in #897
• make newrelic formatting result is off by default by @Sheeproid in #1008
• ROB-2189 add empty check for str case by @RoiGlinik in #1000
• ROB-2197 Allow passing custom sys prompt param in Holmes chat endpoint by @mershal in #1006
• fix alignment issue in docs banner by @Sheeproid in #1012
• ROB-2196 Add NewRelic instructions regarding traces time filters by @mershal in #1011
• ROB-2141 new relay args test by @RoiGlinik in #982
• Add benchmarks for Claude 4.5 by @aantn in #1017
• Skip test from github action which requires Prometheus by @aantn in #1010
• refactoring newrelic formatting by @Avi-Robusta in #1013
• Updated community meeting details. by @pavangudiwada in #988
• updated new relic docs to match revised toolset by @Sheeproid in #1021
• add extended benchmark by @aantn in #1020
• feat(feedback): add privacy notice by @mainred in #1002
• chore(toolset): add Cilium and Hubble to toolsets by @matmerr in #769
• Skip importing the Prometheus toolset by @arikalon1 in #992
• remove the POST version of tempo as it is not supported by @Sheeproid in #1023
• ROB-2136 link tool limit to global truncation limit by @nherment in #987

New Contributors

• @feiskyer made their first contribution in #991
• @mershal made their first contribution in #996
• @matmerr made their first contribution in #769

Full Changelog: 0.14.2...0.14.3-alpha

0.14.2

🚀 Release Notes

This release brings four major improvements (and many small improvements):

1. A much improved Tempo integration
2. Many optimizations to context window handling - these are especially impactful when using HolmesGPT with metrics and trace data. They dramatically increase the accuracy of Holmes' answers
3. Improvements to the Datadog integration - we made many small changes to improve overall accuracy.
4. Support for Sonnet 1M token model - we are looking for Robusta SaaS who would like to test it

🌟 Highlight - Improved Tempo Integration

You can now ask HolmesGPT questions like:

• "Why was there an increase in latency?"
• "Find the cause of recent HTTP 500 errors."

What's Changed

• prometheus fixes by @aantn in #977

Full Changelog: 0.14.1...0.14.2

0.14.1

🚀 Release Notes

This release brings four major improvements (and many small improvements):

1. A much improved Tempo integration
2. Many optimizations to context window handling - these are especially impactful when using HolmesGPT with metrics and trace data. They dramatically increase the accuracy of Holmes' answers
3. Improvements to the DataDog integration - we made large number of small changes to improve overall accuracy.
4. Support for Sonnet 1M token model - we are looking for Robusta SaaS who would like to test it

🌟 Highlight - Improved Tempo Integration

You can now ask HolmesGPT questions like:

• "Why was there an increase in latency?"
• "Find the cause of recent HTTP 500 errors."

Please share your feedback on the Tempo integration! We're going to focus more on traces in the next few releases.

What's Changed

• [ROB-2024] fix assume_role eks by @Avi-Robusta in #936
• fix datadog docs and remove experimental tag by @aantn in #939
• tracing tool call result and errors correctly by @Sheeproid in #937
• bump prometrix version by @Avi-Robusta in #940
• Don't fail the evals workflow on regressions by @aantn in #944
• feat: Support llm-based message summarization by introducing Transformer mechanism by @nilo19 in #695
• chore(azure openai): support api_base and api_version in config by @mainred in #881
• don't trigger build on push non-master branch by @mainred in #938
• chore: remove packages not used in holmesgpt by @mainred in #931
• add free form tempo toolset by @Sheeproid in #948
• Load default robusta model from API by @moshemorad in #946
• Docs: Add instructions on choosing model when using HTTP API by @aantn in #891
• updated docs for new tools and configuration by @Sheeproid in #951
• [ROB-1896] fixes edge case prometheus alert start time by @Avi-Robusta in #947
• [ROB-1738] Truncated metadata support by @Avi-Robusta in #841
• Implement LLM Model Registry by @moshemorad in #954
• add docs on robusta ai by @aantn in #943
• Better ollama support by @aantn in #878
• ROB-2005: improve error handling for streaming (slackbot) by @nherment in #935
• ROB-2116: prevent tool calls responses that are too big by @nherment in #956
• Improve prometheus truncation by @aantn in #955
• Sent truncation data to sentry by @moshemorad in #958
• fix: rename long file name to abode by windows limit by @nherment in #959
• chore: reduce max prometheus query chars to 50k by @nherment in #960
• ensure token_count is added to the final message by @nherment in #963
• Small eval improvements + investigation-refusal eval by @aantn in #966
• Fix bug causing massive evals slowdown by @aantn in #968
• Add max tokens to holmes response by @moshemorad in #970
• Add max output tokens to holmes response by @moshemorad in #972
• Respect DEFAULT_LOG_LIMIT in Loki + fix Datadog eval by @aantn in #971
• Improve Prometheus integration by @aantn in #967
• Update ai provider docs by @pavangudiwada in #952
• improve prometheus integration by @aantn in #975
• Minor fixes - mostly to cli output by @aantn in #976
• ROB-2117 allow override context size with model list by @RoiGlinik in #974
• Datadog improvements by @aantn in #973

Full Changelog: 0.13.3...0.14.1

0.14.1-alpha

What's Changed

• [ROB-2024] fix assume_role eks by @Avi-Robusta in #936
• fix datadog docs and remove experimental tag by @aantn in #939
• tracing tool call result and errors correctly by @Sheeproid in #937
• bump prometrix version by @Avi-Robusta in #940
• Don't fail the evals workflow on regressions by @aantn in #944
• feat: Support llm-based message summarization by introducing Transformer mechanism by @nilo19 in #695
• chore(azure openai): support api_base and api_version in config by @mainred in #881
• don't trigger build on push non-master branch by @mainred in #938
• chore: remove packages not used in holmesgpt by @mainred in #931
• add free form tempo toolset by @Sheeproid in #948
• Load default robusta model from API by @moshemorad in #946
• Docs: Add instructions on choosing model when using HTTP API by @aantn in #891
• updated docs for new tools and configuration by @Sheeproid in #951
• [ROB-1896] fixes edge case prometheus alert start time by @Avi-Robusta in #947
• [ROB-1738] Truncated metadata support by @Avi-Robusta in #841
• Implement LLM Model Registry by @moshemorad in #954
• add docs on robusta ai by @aantn in #943
• Better ollama support by @aantn in #878
• ROB-2005: improve error handling for streaming (slackbot) by @nherment in #935
• ROB-2116: prevent tool calls responses that are too big by @nherment in #956
• Improve prometheus truncation by @aantn in #955
• Sent truncation data to sentry by @moshemorad in #958

Full Changelog: 0.13.3...0.14.1-alpha

0.14.0-tempo-freeform-toolset

What's Changed

• [ROB-2024] fix assume_role eks by @Avi-Robusta in #936
• fix datadog docs and remove experimental tag by @aantn in #939
• tracing tool call result and errors correctly by @Sheeproid in #937
• bump prometrix version by @Avi-Robusta in #940

Full Changelog: 0.13.3...0.14.0-tempo-freeform-toolset

Tempo freeform toolset

What's Changed

• [ROB-2024] fix assume_role eks by @Avi-Robusta in #936
• fix datadog docs and remove experimental tag by @aantn in #939
• tracing tool call result and errors correctly by @Sheeproid in #937
• bump prometrix version by @Avi-Robusta in #940

Full Changelog: 0.13.3...0.14.0-alpha