Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add persistent storage to store current state #6

Closed
lalitpagaria opened this issue Dec 26, 2020 · 0 comments · Fixed by #7
Closed

Add persistent storage to store current state #6

lalitpagaria opened this issue Dec 26, 2020 · 0 comments · Fixed by #7
Labels
breaking changes Breaking changes enhancement New feature or request

Comments

@lalitpagaria
Copy link
Collaborator

Problem

Twitter V2 APIs, Play Store Review APIs and etc have capabilities to fetch result after tweet id, review id respectively. So idea is to store intermediate information in persistent store to avoid fetching duplicate data.

Propose solution

sqlalchemy already included in the dependencies so it would easy to add storage layer. sqlalchemy can also enable user to use their choice of data store supported by it's DBAPI.

Persistent layer would be helpful for workflow engine to recover from some failure scenarios.

@lalitpagaria lalitpagaria added the enhancement New feature or request label Dec 26, 2020
@lalitpagaria lalitpagaria linked a pull request Jan 1, 2021 that will close this issue
3 tasks
@lalitpagaria lalitpagaria added the breaking changes Breaking changes label Jan 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking changes Breaking changes enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant