Skip to content

Wrangles emails from multiple sources in real-time into a centralized file system for easy retrieval and event generation

Notifications You must be signed in to change notification settings

whiskey-platform/email

Repository files navigation

Whiskey Email

Whiskey is an event-based personal automation system. The core entry point for events into the system is email.

This set of infrastructure enables the real-time processing and storage of emails that are sent to *@mattwyskiel.com and mwwyskiel@gmail.com

architecture

Core Infra

Whiskey Email contains the following:

  • an S3 bucket to store emails
/
- raw/
  - gmail/
    - {gmail_id}.json
  - improvmx/
    - {improvmx_id}.json
- messages/
  - {id}/
      - body.html _or_ body.txt
      - attachments/
      - inlines/
      - meta.json
  • an EventBridge Event Schema, as the Whiskey Event Bus will be hydrated with events from Whiskey Email

Roadmap

  • Ingests realtime emails from Gmail, using Google PubSub integration
  • Ingests realtime emails from @mattwyskiel.com address, using ImprovMX webhooks
  • Unifies emails from both sources in common format within S3, deduplicates
  • Sends unified-format event to Event Bus
  • Historical on-demand email ingest, from GMAIL or old email-interceptor S3 bucket
  • CRUD API for messages

About

Wrangles emails from multiple sources in real-time into a centralized file system for easy retrieval and event generation

Resources

Stars

Watchers

Forks