forked from flashlight/flashlight
-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
add flags to set caching memory manager split+recycling size limits
Add flags to set configurable limits of the CachingMemoryManager. These flags allow customization for different workloads. This diff changes the default recycling size limit for training to 256MB. Following investigation of OOM on dynamic batching nd based on past allocation analyses we found that this limit works well. Big thanks for WilliamTambellini@ for his work on improving the memory manager capability in handling flexible workload: flashlight#188
- Loading branch information
Your Name
committed
Jan 14, 2021
1 parent
25102d9
commit 34bcd14
Showing
3 changed files
with
32 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters