Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a Pulsar IO MongoDB #3561

Merged
merged 3 commits into from
Feb 13, 2019
Merged

Add a Pulsar IO MongoDB #3561

merged 3 commits into from
Feb 13, 2019

Conversation

bbonnin
Copy link
Contributor

@bbonnin bbonnin commented Feb 10, 2019

Motivation

Provides a builtin MongoDB Connector, in order to ease the storage of JSON formated message in MongoDB. It's a sink connector.

Modifications

Add a new sub-module in the pulsar-iomodule.

Verifying this change

  • Make sure that the change passes the CI checks.

This change added tests and can be verified as follows:

  • deploy the connector with configuration file containing the following fields:
configs:
  mongoUri: mongodb://hostname:port
  database: pulsar
  collection: messages
  • start a mongodb instance
  • send messages in the topic declared when deploying the connector
  • check in MongoDB if the messages have been stored in the collection messages

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): no
  • The public API: no
  • The schema: no
  • The default values of configurations: no
  • The wire protocol: no
  • The rest endpoints: no
  • The admin cli options: no
  • Anything that affects deployment: no

Documentation

  • Does this pull request introduce a new feature? yes
    • a new sink connector for storing messages in MongoDB
  • If yes, how is the feature documented? not documented
  • If a feature is not applicable for documentation, explain why?
  • If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

@sijie sijie added the type/feature The PR added a new feature or issue requested a new feature label Feb 11, 2019
@sijie sijie added this to the 2.3.0 milestone Feb 13, 2019
@sijie sijie merged commit 06e911d into apache:master Feb 13, 2019
@sijie
Copy link
Member

sijie commented Feb 13, 2019

@bbonnin great contribution! thank you

@bbonnin
Copy link
Contributor Author

bbonnin commented Feb 14, 2019

@sijie thank you for merging my first PR :) !!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connector type/feature The PR added a new feature or issue requested a new feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants