Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add monitoring operation #121

Open
bergos opened this issue Aug 30, 2021 · 5 comments
Open

Add monitoring operation #121

bergos opened this issue Aug 30, 2021 · 5 comments

Comments

@bergos
Copy link
Contributor

bergos commented Aug 30, 2021

There should be an operation that logs in specific intervals the throughput at a specific point in the pipeline. It should be available as raw and object operation.
@bergos bergos mentioned this issue Aug 30, 2021
Closed
@bergos bergos self-assigned this Sep 27, 2021
@bergos
Copy link
Contributor Author

bergos commented Apr 11, 2022

A similar feature was implemented in an old version of barnard:

@bergos bergos removed their assignment Apr 11, 2022
@cristianvasquez cristianvasquez self-assigned this Apr 20, 2022
@cristianvasquez
Copy link
Contributor

Hi @bergos, to which repository does this need to be added?

cristianvasquez referenced this issue in zazuko/barnard59-base Apr 26, 2022
@cristianvasquez
feat: added monitor operation
6fca634 
https://github.com/zazuko/barnard59-base/issues/23
cristianvasquez referenced this issue in zazuko/barnard59-base Apr 26, 2022
@cristianvasquez
feat: added monitor with two log operations
8d86901 
https://github.com/zazuko/barnard59-base/issues/23
@cristianvasquez
Copy link
Contributor

Pull request at: zazuko/barnard59-base#26

cristianvasquez referenced this issue in zazuko/barnard59-base Apr 26, 2022
@cristianvasquez
refactor: renamed and split into two operations
b7bd14b 
https://github.com/zazuko/barnard59-base/issues/23
cristianvasquez referenced this issue in zazuko/barnard59-base Apr 26, 2022
@cristianvasquez
added count operation
99ef23c 
https://github.com/zazuko/barnard59-base/issues/23
cristianvasquez referenced this issue in zazuko/barnard59-base Apr 26, 2022
@cristianvasquez
fix: size operation should fail with objects.
b91ce85 
https://github.com/zazuko/barnard59-base/issues/23
cristianvasquez referenced this issue in zazuko/barnard59-base May 25, 2022
@cristianvasquez
fix: size operation should fail with objects.
72884b4 
https://github.com/zazuko/barnard59-base/issues/23
cristianvasquez referenced this issue in zazuko/barnard59-base Feb 27, 2023
@cristianvasquez
https://github.com/zazuko/barnard59-base/issues/23
5aece3c 
Operation: throughput

    print the date-time of the first chunk occurrence
    print the total count + chunk per minute or interval
@cristianvasquez
Copy link
Contributor

Smaller pull request at: zazuko/barnard59-base#28

@tpluscode
Copy link
Contributor

As discussed with @cristianvasquez @giacomociti @mchlrch, we propose that instead of implementing specialized monitoring steps, there should be a built-in feature to allow observing existing steps in a pipeline.

@tpluscode tpluscode mentioned this issue Jun 20, 2023
Open
@tpluscode tpluscode transferred this issue from zazuko/barnard59-base Jun 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@cristianvasquez @tpluscode @bergos