Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] eGo projection #26

Closed
Tochemey opened this issue Sep 22, 2023 · 4 comments
Closed

[feat] eGo projection #26

Tochemey opened this issue Sep 22, 2023 · 4 comments
Assignees
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@Tochemey
Copy link
Owner

Add a better projection engine to consume events persisted in the journal to build a read model

@Tochemey Tochemey added enhancement New feature or request help wanted Extra attention is needed labels Sep 22, 2023
@pablogore
Copy link

I was working to add a middleware, polling database (could be an actor or a cron) looking for the new events and adding the events to the Kafka / nats topic.
After that, we can subscribe to that topic, read the events and store them in a read model table

@Tochemey Tochemey changed the title eGo projection [feat] eGo projection Oct 7, 2023
@Tochemey
Copy link
Owner Author

Hello @pablogore
Thanks for the comment. We can pair on this and discuss the approach if you want. You can also open a PR to implement it.

I have been considering doing this #33 first and then implement the projection. I implemented it sometimes using a db polling mechanism but I abandoned it because I was suspecting some performance issue. The old code base is somewhere d3cd4e3

@Tochemey
Copy link
Owner Author

@pablogore The main reason I abandoned the old implementation is that I am planning to read the data per partition when running in a cluster.

@Tochemey
Copy link
Owner Author

@pablogore I have added the projection implementation. I will be adding a mechanism to run it in a singleton manner in a cluster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants