New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to get metrics/stats of completed and/or running transactions #199

Open
muga opened this Issue Jun 12, 2015 · 1 comment

Comments

Projects
None yet
2 participants
@muga
Contributor

muga commented Jun 12, 2015

Current Embulk doesn't provide metrics/states of the done BulkLoader when it was finished. For example, almost users want to know how many number of records successfully loaded (or skipped) by Embulk.

To do that, I think that we can use CommitReport. When each input/output plugin finished, it add the information of the number of the loaded (or skipped) records to CommitReport. For example, output plugin's CommitReport is like {"loaded_records": 1000, "skipped_records":1}. Since LoaderState already has the list of CommitReports, it can sum and add the numbers to ExecutionResult.

@muga muga added this to the v0.9 milestone Apr 12, 2016

@frsyuki frsyuki changed the title from How to get metrics/stats of the done BulkLoader to How to get metrics/stats of completed and/or running transactions Apr 29, 2016

@dmikurube

This comment has been minimized.

Show comment
Hide comment
@dmikurube

dmikurube Jan 26, 2018

Contributor

This is to be done in later versions.

Contributor

dmikurube commented Jan 26, 2018

This is to be done in later versions.

@dmikurube dmikurube removed this from the v0.9.0 milestone Jan 26, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment