Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka client Java API wrapper #761

Merged
merged 1 commit into from Sep 17, 2017
Merged

Kafka client Java API wrapper #761

merged 1 commit into from Sep 17, 2017

Conversation

merlimat
Copy link
Contributor

Recreated PR from #753

Motivation

Add a Kafka API wrapper based on Pulsar client library.

This will allow existing application using the Kafka client library to publish or suscbribe to a Pulsar topic without any code change.

This first iteration is targeting the Kafka high-level consumer with managed offsets, with or without auto-commit.

Examples and documentation on the website will follow this PR.

Modifications

  • Add implementation of Kafka Producer and Consumer interfaces that internally use Pulsar client library
  • Use Maven shading plugin to replace KafkaProducer class with PulsarKafkaProducer in the jar

Result

The org.apache.pulsar:pulsar-client-kafka-compact artifact will be a drop-in replacement for org.apache.kafka:kafka-clients.

@merlimat merlimat added the type/feature The PR added a new feature or issue requested a new feature label Sep 16, 2017
@merlimat merlimat added this to the 1.20.0-incubating milestone Sep 16, 2017
@merlimat merlimat self-assigned this Sep 16, 2017
@merlimat
Copy link
Contributor Author

retest this please

@merlimat
Copy link
Contributor Author

Still Jenkins is not working. I've created an INFRA ticket:
https://issues.apache.org/jira/browse/INFRA-15097

@rdhabalia
Copy link
Contributor

retest this please

Copy link
Contributor

@rdhabalia rdhabalia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@merlimat
Copy link
Contributor Author

Ok, there was something that got misconfigured on the Jenkins build.. The log history says it was done by me.. though I swear I didn't touch anything :).

I've reverted the Jenkins config and the build got triggered again: https://builds.apache.org/job/pulsar-pull-request/jobConfigHistory/

@merlimat merlimat merged commit e7f1160 into apache:master Sep 17, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feature The PR added a new feature or issue requested a new feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants