[Python] Evaluate Product Experience

[smeubank]

Description

We should be prepared to address the quality of the Sentry Product Experience for all users considering our new Sentry + OTEL approach

What Major platforms can we ensure it works for?

• Python SDK
  • Django
  • Flask
  • FastAPI
  • Other non-web framework related?

Product Features

• Error Tracking
  • What do users have to do?
  • What works?
    • Issues
      • 'POST /test/12344?test=true'
        • returns an error - should be reflected
      • Stack trace and code link
      • Bread crumbs
    • Related transactions
    • Trace view
    • Performance Issues
      • New and rely on standardized txns and spans
  • What doesn’t work, or doesn’t work quite the same?
• Performance Monitoring
  • What do they have to do?
    • Example: NodeJS: [SDK Docs](https://docs.sentry.io/platforms/node/performance/instrumentation/opentelemetry/)
  • What works?
    • Distributed tracing
    • Transactions and Spans
      - Naming, descriptions, etc
      - Operation: http.server
      - [ ] parameterized transactions
      • GET /?test=true
      • 'POST /test/12344?test=true'
        - [ ] http.method
        - [ ] related issues
        - Operation: queue.task.____
        - Operation: integration.http
        - Operation: db
    • Vitals
      • User Misery
      • [] Backend
  • What doesn’t work or doesn’t work the same?
• Release Management
  • Adoption, Crash related features
  • Source Maps: N/A
• Discover & Dashboards
  • create a stock dashboard for project(s)
    • Dashboard: OTEL Hipster Django
• Ecosystem & Workflow
  • consider product integration dependent upon incoming data
  • alerts for example
• Profiling
  • statement on if it CAN work
• Replays
  • statement on if it CAN work

[smeubank]

Issue to be treated as a check list

Outcomes

• Do we need to add more documentation?
• Do we need to communicate this to other product teams? (create issues)
• Do we need to consider upstream contribution? (only create issues for now)
• Do we need to improve the span transformation and/or trace propagation? (create issues)

[smeubank]

• integration tests for each platform
  • clarify the tests to run on each SDK
• how to convert this into automated functional testing
  • apply per repo
  • apply to hipster shop