Skip to content

v2.0.0 - Stripe integration and storage update

Choose a tag to compare

View all tags
@AlessioCappello2 AlessioCappello2 released this 22 Jan 22:39
· 14 commits to main since this release
v2.0.0
54a9eb8
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

This release introduces the full Stripe integration in the TrStream pipeline, along with key storage and processing updates.

Highlights

  • Stripe Integration stack
    • Fully containerized webhook and event generator services
    • Host-based Stripe CLI event forwarding for real and test events
    • Automated scripts for starting and stopping the stack
  • Storage and processing updates
    • Updated MinIO paths and partitioning logic
    • Event normalization for Stripe and internal producers
    • Introduction of medallion architecture: raw → processed → analytics
  • Service adaptations
    • Partitioner evolved into a processor and compacter slightly adapted to handle the new storage layout
    • Schema- and source-aware processing maintained for query-ready outputs

This release enables local testing of Stripe events, improves data organization and lays the groundwork for further integrations (e.g. Revolut API, Airflow scheduling)

Assets 2
Loading