Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added suppport for Kafka partitioner and explicit setting of partition on record #3462

Merged
merged 8 commits into from
Feb 8, 2019

Conversation

merlimat
Copy link
Contributor

Motivation

  • Support setting partition id on records when publishing through Pulsar-Kafka adapter library
  • Support producer config partitioner.class with a custom partitioner

@merlimat merlimat added this to the 2.3.0 milestone Jan 28, 2019
@merlimat merlimat self-assigned this Jan 28, 2019
@jiazhai
Copy link
Member

jiazhai commented Jan 29, 2019

run integration tests

@merlimat
Copy link
Contributor Author

retest this please

Copy link
Contributor

@ivankelly ivankelly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple of minor things.

@@ -129,7 +129,7 @@ Properties:
| Config property | Supported | Notes |
|:----------------------------------------|:----------|:------------------------------------------------------------------------------|
| `acks` | Ignored | Durability and quorum writes are configured at the namespace level |
| `auto.offset.reset` | Yes | Will have a default value of 'latest' if user does not give specific setting. |
| `auto.offset.reset` | Yes | Will have a default value of `latest` if user does not give specific setting. |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added superfluous whitespace.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just fixed the .. and aligned the columns in the source md text structure.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@merlimat
Copy link
Contributor Author

merlimat commented Feb 1, 2019

@ivankelly PTAL again

@@ -18,6 +18,7 @@
*/
package org.apache.kafka.clients.producer;

import java.nio.charset.Charset;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

import static java.nio.charset.StandardCharsets.UTF_8;

@@ -129,7 +129,7 @@ Properties:
| Config property | Supported | Notes |
|:----------------------------------------|:----------|:------------------------------------------------------------------------------|
| `acks` | Ignored | Durability and quorum writes are configured at the namespace level |
| `auto.offset.reset` | Yes | Will have a default value of 'latest' if user does not give specific setting. |
| `auto.offset.reset` | Yes | Will have a default value of `latest` if user does not give specific setting. |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@merlimat
Copy link
Contributor Author

merlimat commented Feb 1, 2019

retest this please

@merlimat
Copy link
Contributor Author

merlimat commented Feb 7, 2019

run cpp tests
run java8 tests

@merlimat
Copy link
Contributor Author

merlimat commented Feb 7, 2019

run integration tests

@merlimat merlimat merged commit c448aaa into apache:master Feb 8, 2019
@merlimat merlimat deleted the kafka-explicit-partition branch February 8, 2019 05:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants