-
Notifications
You must be signed in to change notification settings - Fork 520
[MINOR] Federated monitoring minor bug fixes and documentation #1698
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Baunsgaard
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall i think the PR looks good, but there is some minor modifications needed.
...org/apache/sysds/runtime/controlprogram/federated/monitoring/services/StatisticsService.java
Show resolved
Hide resolved
...ava/org/apache/sysds/runtime/controlprogram/federated/monitoring/services/WorkerService.java
Show resolved
Hide resolved
...va/org/apache/sysds/test/functions/federated/monitoring/FederatedBackendPerformanceTest.java
Show resolved
Hide resolved
...java/org/apache/sysds/test/functions/federated/monitoring/FederatedWorkerStatisticsTest.java
Show resolved
Hide resolved
...java/org/apache/sysds/test/functions/federated/monitoring/FederatedWorkerStatisticsTest.java
Outdated
Show resolved
Hide resolved
|
Will merge shortly, |
|
Unfortunately, the GitHub actions did not include the monitoring tests, and therefore they were never tested in the cloud on your PR and commits. (edit) Link to failing tests: https://github.com/apache/systemds/actions/runs/3154658721/jobs/5132497493 |
This commit adds extensions and fixes to the federated monitoring tool. And makes it easier to run via documentation and examples. Closes apache#1698
This change fixes issues with multiple threads accessing one derby connection, frontend issues of the dashboard not displaying workers correctly and the event timeline failing completely because of empty event stages.
The change also adds an additional zoom in/out feature for the dashboard, documentation with overview architecture, and how the tool can be started.