Skip to content
This repository has been archived by the owner on Mar 17, 2024. It is now read-only.

Factor out Spark Event Exporter into separate projects #9

Closed
seglo opened this issue Mar 11, 2019 · 2 comments
Closed

Factor out Spark Event Exporter into separate projects #9

seglo opened this issue Mar 11, 2019 · 2 comments
Labels
refactor Refactor of project
Milestone
0.4.0

Comments

@seglo
Copy link
Owner

seglo commented Mar 11, 2019 •
edited
Loading

Split out spark event exporter into potentially twoone separate project

  1. spark-committer - Only commits offsets to a defined group.id. This complements kafka lag exporter, because when used with a Spark app we can report lag the same way we do any other app.
  2. spark-event-exporter - Simplified version of current exporter which only passes thru event data as Spark custom metrics, but does not calculate lag (use spark-committer for that).
@seglo seglo added the refactor Refactor of project label Apr 17, 2019
@seglo seglo added this to the 0.4.0 milestone Apr 17, 2019
@seglo
Copy link
Owner Author

seglo commented Apr 18, 2019

Update logback.xml to reflect new packages for projects.

@seglo seglo added the in progress PR for issue is in progress label Apr 23, 2019
@seglo seglo mentioned this issue Apr 23, 2019
Merged
@seglo
Copy link
Owner Author

seglo commented Apr 24, 2019

Created spark-committer GitHub project.

@seglo seglo removed the in progress PR for issue is in progress label Apr 25, 2019
@seglo seglo closed this as completed Apr 25, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
refactor Refactor of project
Projects
None yet
Milestone
0.4.0
Development

No branches or pull requests
1 participant
@seglo