Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

maxwell CDC with Apache NiFi #150

Closed
xmlking opened this issue Nov 19, 2015 · 3 comments
Closed

maxwell CDC with Apache NiFi #150

xmlking opened this issue Nov 19, 2015 · 3 comments

Comments

@xmlking
Copy link

xmlking commented Nov 19, 2015

I am using maxwell CDC solution along with Apache NiFi and it is working great:
https://github.com/xmlking/nifi-examples/tree/master/oltp-cdc-olap

@wushujames
Copy link
Contributor

Super awesome. Added to my CDC list: https://github.com/wushujames/mysql-cdc-projects/wiki

Can I ask a little about your architecture? You are using the Maxwell to write to Kafka, correct? The part of this that is specific to Nifi is the reading from Kafka and the parsing of the JSON that Maxwell emitted?

@xmlking
Copy link
Author

xmlking commented Nov 20, 2015

yes Maxwell —> Kafka and NiFi connects to Kafka as client.
NiFi DataFlows helps to do custom transformation/aggregation specific to each consumer and target database.
thanks for adding to the CDC list.

On Nov 19, 2015, at 10:53 AM, wushujames notifications@github.com wrote:

Super awesome. Added to my CDC list: https://github.com/wushujames/mysql-cdc-projects/wiki https://github.com/wushujames/mysql-cdc-projects/wiki
Can I ask a little about your architecture? You are using the Maxwell to write to Kafka, correct? The part of this that is specific to Nifi is the reading from Kafka and the parsing of the JSON that Maxwell emitted?


Reply to this email directly or view it on GitHub #150 (comment).

@osheroff
Copy link
Collaborator

good deal. I should do a little ABOUT.md and add some related / consuming projects. Let me know if you have an issues, and of course, PRs welcome.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants