Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use a local directory as an event source #42

Closed
istreeter opened this issue Aug 1, 2021 · 0 comments
Closed

Use a local directory as an event source #42

istreeter opened this issue Aug 1, 2021 · 0 comments
Assignees
@spenes
Milestone
0.3.0

Comments

@istreeter
Copy link
Contributor

Currently the postgres loader has two "sources" which provide a stream of events:

  • Kinesis (AWS)
  • PubSub (GCP)

We should add functionality so the event source can be a local directory containing events in flat files. This will be helpful for code development and debugging, because we can run the application without needing AWS/GCP resources.

Note that our Enrich app has a file system source so we should copy that implementation as much as possible.
spenes added a commit that referenced this issue Aug 5, 2021
@spenes
Use a local directory as an event source (close #42)
3079967
@spenes spenes self-assigned this Aug 11, 2021
@spenes spenes added this to the 0.3.0 milestone Aug 16, 2021
@spenes spenes closed this as completed in 0fbc0c3 Aug 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@spenes spenes

Labels
None yet
Projects
None yet
Milestone
0.3.0
Development

No branches or pull requests
2 participants
@istreeter @spenes