Zeus v0.14.0 & Zeus Daemon v0.3.0
·
55 commits
to master
since this release
Distributed Power Streaming
ZeusMonitor and PowerMonitor (well, every monitor we have) are local to a single machine. However, as ML workloads scale out, we frequently need multi-node power & energy monitoring and measurement.
We extended our Zeus daemon to stream real time power measurements to subscribed clients via SSE (Server-Sent Events). The PowerStreamingClient in the Zeus Python library can subscribe to multiple Zeus daemons across multiple nodes and aggregate power samples into a single stream. It doesn't have to be PowerStreamingClient; something as simple as curl -N http://node:port/gpu/stream_power works too.
What's Changed
- [Device] Skip calling APIs when there will be no change, AMDSMI unit fixes by @jaywonchung in #204
- [Docs] Add Troubleshooting section w/ multiprocessing pitfall by @jaywonchung in #205
- [Monitor] Make
PowerMonitorfail when monitoring process fails to spawn by @jaywonchung in #206 - [Feat] Global variable warning for monitors by @jaywonchung in #208
- Add newsletter embeds by @jaywonchung in #209
- [Feat] Zeusd power server and client by @jaywonchung in #210
- [Feat] Zeus daemon major refactor, bump to v0.3.0 by @jaywonchung in #211
- [CI] Switch from
pyrighttotyby @jaywonchung in #212
Full Changelog: zeus-v0.13.1...zeus-v0.14.0