Skip to content
This repository was archived by the owner on Jan 29, 2026. It is now read-only.

Fix logging bug and clean up on helm chart#53

Merged
animeshsingh merged 2 commits intomasterfrom
bug-patch
Apr 6, 2018
Merged

Fix logging bug and clean up on helm chart#53
animeshsingh merged 2 commits intomasterfrom
bug-patch

Conversation

@Tomcli
Copy link
Contributor

@Tomcli Tomcli commented Apr 4, 2018

  • Fix FfDL logging issues with Elastic Search #13 Logging bug. (It was caused by insufficient memory and cpu with the log collector)
  • Rename old-tf-model to tf-summary-model.
  • Clean up on some old internal secret dependencies on helm chart.

DCO 1.1 Signed-off-by: Tommy Li tommy.chaoping.li@ibm.com

@Tomcli Tomcli added the bug Something isn't working label Apr 4, 2018
@animeshsingh animeshsingh self-requested a review April 6, 2018 19:23
Copy link
Contributor

@animeshsingh animeshsingh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good - except for the new numbers for cpu et all - how did we come up with those?

logCollectorMemInMB=100
logCollectorMilliCPU=60
logCollectorMemInMB=300
controllerMilliCPU=20
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How did we come up with these numbers?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar to the Load Training Data memory, giving log collector 3x capacity seems to be the right fix. 2x capacity will work on our example but it will be insufficient again with a bigger job. I am working on moving these constants to the helm chart, so in the future users can just customize these number based on their needs.

@animeshsingh animeshsingh merged commit 3545032 into master Apr 6, 2018
@Tomcli Tomcli deleted the bug-patch branch April 6, 2018 21:20
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants