feat(langchain): Broaden AI provider detection beyond OpenAI and Anthropic by ericapisani · Pull Request #5707 · getsentry/sentry-python

ericapisani · 2026-03-19T12:07:07Z

Summary

Extracts a _get_ai_system() helper that generically detects AI providers from LangChain's _type field, replacing hardcoded "anthropic" / "openai" checks.
Adds support for Cohere, Ollama, Mistral, Fireworks, HuggingFace, Groq, NVIDIA, xAI, DeepSeek, Google, and any future LangChain providers without code changes.

Test plan

Parametrized test with coverage for real LangChain _llm_type values from various providers
CI passes

🤖 Generated with Claude Code

…ropic Extract _get_ai_system() to generically detect AI providers from LangChain's _type field instead of hardcoding only "anthropic" and "openai". The function splits on "-" and skips non-provider segments (cloud prefixes like "azure" and descriptors like "chat"/"llm") to return the actual provider name. This adds support for Cohere, Ollama, Mistral, Fireworks, HuggingFace, Groq, NVIDIA, xAI, DeepSeek, Google, and any future LangChain providers. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

ericapisani · 2026-03-19T12:07:53Z

@cursoragent please review this

cursor · 2026-03-19T12:07:58Z

Please finish setting up background agents. Go to Cursor

github-actions · 2026-03-19T12:11:25Z

Codecov Results 📊

✅ 13 passed | Total: 13 | Pass Rate: 100% | Execution Time: 8.60s

All tests are passing successfully.

❌ Patch coverage is 0.00%. Project has 14382 uncovered lines.

Files with missing lines (1)

File	Patch %	Lines
`langchain.py`	3.27%	⚠️ 591 Missing

Generated by Codecov Action

github-actions · 2026-03-19T12:11:25Z

Codecov Results 📊

✅ 9 passed | ⏭️ 1 skipped | Total: 10 | Pass Rate: 90% | Execution Time: 3.63s

All tests are passing successfully.

❌ Patch coverage is 0.00%. Project has 14771 uncovered lines.

Files with missing lines (1)

File	Patch %	Lines
`langchain.py`	3.24%	⚠️ 598 Missing

Generated by Codecov Action

ericapisani · 2026-03-20T09:29:58Z

bugbot run

cursor

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

…s-is Remove string splitting and filtering logic from _get_ai_system. The function now returns the LangChain _type value directly without attempting to extract a provider name from it. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

github-actions · 2026-03-20T10:25:20Z

Semver Impact of This PR

🟡 Minor (new features)

📋 Changelog Preview

This is how your changes will appear in the changelog.
Entries from this PR are highlighted with a left border (blockquote style).

New Features ✨

(asgi) Add option to disable suppressing chained exceptions by alexander-alderman-webb in #5714

(langchain) Broaden AI provider detection beyond OpenAI and Anthropic by ericapisani in #5707

(logging) Separate ignore lists for events/breadcrumbs and sentry logs by sl0thentr0py in #5698

Bug Fixes 🐛

Anthropic

Set exception info on streaming span when applicable by alexander-alderman-webb in #5683
Patch AsyncStream.close() and AsyncMessageStream.close() to finish spans by alexander-alderman-webb in #5675
Patch Stream.close() and MessageStream.close() to finish spans by alexander-alderman-webb in #5674

Other

(starlette) Catch Jinja2Templates ImportError by alexander-alderman-webb in #5741

Documentation 📚

Add note on AI PRs to CONTRIBUTING.md by sentrivana in #5696

Internal Changes 🔧

Pin GitHub Actions to full-length commit SHAs by joshuarli in #5781
Add -latest alias for each integration test suite by sentrivana in #5706
Use date-based branch names for toxgen PRs by sentrivana in #5704
🤖 Update test matrix with new releases (03/19) by github-actions in #5703
Add client report tests for span streaming by sentrivana in #5677

Other

Update CHANGELOG.md by sentrivana in #5685

_{🤖 This preview updates automatically when you update the PR.}

sentry_sdk/integrations/langchain.py

cursor

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix prepared a fix for the issue found in the latest run.

✅ Fixed: Raw _type values break gen_ai.system consistency with other integrations
- Restored normalization of LangChain _type values to return 'openai' and 'anthropic' instead of raw values like 'openai-chat' and 'anthropic-chat', matching the dedicated integrations and maintaining backward compatibility.

Or push these changes by commenting:

@cursor push 98e51d01de

Preview (98e51d01de)

diff --git a/sentry_sdk/integrations/langchain.py b/sentry_sdk/integrations/langchain.py
--- a/sentry_sdk/integrations/langchain.py
+++ b/sentry_sdk/integrations/langchain.py
@@ -114,6 +114,11 @@
     if not ai_type or not isinstance(ai_type, str):
         return None
 
+    if "anthropic" in ai_type:
+        return "anthropic"
+    elif "openai" in ai_type:
+        return "openai"
+
     return ai_type
 
 

diff --git a/tests/integrations/langchain/test_langchain.py b/tests/integrations/langchain/test_langchain.py
--- a/tests/integrations/langchain/test_langchain.py
+++ b/tests/integrations/langchain/test_langchain.py
@@ -2005,13 +2005,13 @@
     [
         # Real LangChain _type values (from _llm_type properties)
         # OpenAI
-        ("openai-chat", "openai-chat"),
+        ("openai-chat", "openai"),
         ("openai", "openai"),
         # Azure OpenAI
-        ("azure-openai-chat", "azure-openai-chat"),
+        ("azure-openai-chat", "openai"),
         ("azure", "azure"),
         # Anthropic
-        ("anthropic-chat", "anthropic-chat"),
+        ("anthropic-chat", "anthropic"),
         # Google
         ("vertexai", "vertexai"),
         ("chat-google-generative-ai", "chat-google-generative-ai"),

_{This Bugbot Autofix run was free. To enable autofix for future PRs, go to the Cursor dashboard.}

cursor · 2026-03-24T08:27:35Z

sentry_sdk/integrations/langchain.py

+    if not ai_type or not isinstance(ai_type, str):
+        return None
+
+    return ai_type


Raw _type values break gen_ai.system consistency with other integrations

Medium Severity

_get_ai_system returns the raw LangChain _type value (e.g. "anthropic-chat", "openai-chat") instead of a normalized provider name. The Anthropic integration sets gen_ai.system to "anthropic" and the OpenAI integration uses "openai", matching OTel semantic conventions. The old code also normalized to these values. Now the same provider gets different gen_ai.system values depending on whether it's called directly or through LangChain, breaking filtering/grouping in the Sentry UI for existing users.

Additional Locations (1)

sentry_sdk/integrations/langchain.py#L392-L395

This is intentional, see #5707 (comment)

alexander-alderman-webb · 2026-03-24T16:08:44Z

tests/integrations/langchain/test_langchain.py

        }


+@pytest.mark.parametrize(


could you add an assertation that gen_ai.system is correctly set in one of the tests that use langchain organically, i.e., like a user would interact with it. In one or all of these 🙏 .

test_langchain_text_completion()

test_langchain_create_agent()

test_tool_execution_span()

ericapisani requested a review from a team as a code owner March 19, 2026 12:07

ericapisani marked this pull request as draft March 19, 2026 12:07

cursor bot reviewed Mar 20, 2026

View reviewed changes

ericapisani marked this pull request as ready for review March 20, 2026 10:26

sentry-warden bot reviewed Mar 20, 2026

View reviewed changes

sentry_sdk/integrations/langchain.py Show resolved Hide resolved

sentry bot reviewed Mar 20, 2026

View reviewed changes

sentry_sdk/integrations/langchain.py Show resolved Hide resolved

Merge branch 'master' into ep/broaden-langgraph-model-support-6d0

1bc78cc

cursor bot reviewed Mar 24, 2026

View reviewed changes

alexander-alderman-webb reviewed Mar 24, 2026

View reviewed changes

		}


		@pytest.mark.parametrize(

Conversation

ericapisani commented Mar 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Uh oh!

ericapisani commented Mar 19, 2026

Uh oh!

cursor bot commented Mar 19, 2026

Uh oh!

github-actions bot commented Mar 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Results 📊

Uh oh!

github-actions bot commented Mar 19, 2026

Codecov Results 📊

Uh oh!

ericapisani commented Mar 20, 2026

Uh oh!

cursor bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Mar 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Semver Impact of This PR

New Features ✨

Bug Fixes 🐛

Anthropic

Other

Documentation 📚

Internal Changes 🔧

Other

Uh oh!

Uh oh!

Uh oh!

cursor bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

cursor bot Mar 24, 2026

Choose a reason for hiding this comment

Raw _type values break gen_ai.system consistency with other integrations

Uh oh!

ericapisani Mar 24, 2026

Choose a reason for hiding this comment

Uh oh!

alexander-alderman-webb Mar 24, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

ericapisani commented Mar 19, 2026 •

edited

Loading

github-actions bot commented Mar 19, 2026 •

edited

Loading

github-actions bot commented Mar 20, 2026 •

edited

Loading

cursor bot left a comment •

edited

Loading

Raw `_type` values break `gen_ai.system` consistency with other integrations