Skip to content

report sys errors when failed to produce successfully#3668

Merged
jerrypeng merged 13 commits intoapache:masterfrom
jerrypeng:python_function_produce_error_reporting
Feb 24, 2019
Merged

report sys errors when failed to produce successfully#3668
jerrypeng merged 13 commits intoapache:masterfrom
jerrypeng:python_function_produce_error_reporting

Conversation

@jerrypeng
Copy link
Contributor

Motivation

For python functions, when there are failures producing messages, the errors are not reported or log which makes it hard to determine if there is a problem

@jerrypeng jerrypeng added this to the 2.3.1 milestone Feb 22, 2019
@jerrypeng jerrypeng self-assigned this Feb 22, 2019
@jerrypeng jerrypeng requested review from merlimat and sijie February 22, 2019 08:43
Copy link
Contributor

@merlimat merlimat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also have a counter of successfull/failed publishes?

@merlimat
Copy link
Contributor

run java8 tests

1 similar comment
@jerrypeng
Copy link
Contributor Author

run java8 tests

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CompletableFuture<MessageId> future = msg.sendAsync();

future.thenAccept(messageId -> record.ack())
      .exceptionally(getPublishErrorHandler(record))
future.join();

@jerrypeng
Copy link
Contributor Author

rerun java8 tests

@merlimat
Copy link
Contributor

run java8 tests

@jerrypeng jerrypeng merged commit 03b06a6 into apache:master Feb 24, 2019
merlimat pushed a commit that referenced this pull request Mar 29, 2019
* report sys errors when failed to produce sucessfully

* enhancing error message

* adding metrics to context publish

* enhancing error logging and adding java error handling

* fixing tests

* cleaning up

* addressing comments and fix bug

* cleaning up

* fix bug

* fix test

* check is none

* fix unit test

* cleaning up
@merlimat
Copy link
Contributor

merlimat commented Apr 1, 2019

Merged in 2.3.1 at
ca070a4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments