High Power Mode

[TortoiseHam]

Just out of curiosity, are you able to use the 'high power mode' to get around the apparent 40W limit?

https://www.macrumors.com/2021/10/22/high-power-mode-16-inch-macbook-pro-m1-max/

[tlkh]

Will test it soon and update. I am not expecting much of a difference however.

[TortoiseHam]

Awesome, thanks for posting this info :)

[tlkh]

Update: it doesn't seem to affect the measured results, updated the README

[TortoiseHam]

Huh. Bummer. Good to know though. I wonder if this gap can be closed at all by future metal driver updates... the perf/watt is pretty competitive at least

[tlkh]

Actually, this IS pretty good, considering the 3090 has Tensor Core which in theory gives it a much larger performance advantage, while the M1 seems to be using normal shader cores. I do think if we lower the 3090 power limit to a “Max-Q” setting and tune the batch size, we will see better efficient on 3090 as well.