You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We build Pantheon, an open source (Apache-2.0) health and diagnostics suite for GPUs, with a public results database at pantheongpu.com. It runs about fifty targeted workloads, memory fault tests adapted from the DRAM testing literature, power viruses aimed at one subsystem at a time, interconnect tests and AI shaped compute, and records the card's own error counters around every run. The output is a report tied to the GPU's own identity, the UUID, that says what that specific card can and cannot do.
We think this fits a gap that Homenode makes wider. Verifying that a provider has the GPU it claims settles what the hardware is. It does not settle whether it is healthy: whether the memory holds a pattern under heat, whether the card sustains its rated throughput for an hour instead of fifteen minutes, or whether it passes every check while quietly corrupting results. Those are the cards that produce a failed training run three days in, and with consumer cards arriving from individual homes, tenants will be renting exactly the cards nobody has ever tested that way.
What we propose is optional and open: a provider runs Pantheon on a card, the report goes into the public database under the GPU's UUID, and the provider can point to it as an audited attribute, in the same spirit as the existing provider audits. Tenants get a health record for the card they are about to rent. Providers with good hardware get a way to prove it. Nobody has to trust us: the kernels ship as source, anyone can read what runs, and anyone can rerun it.
We would like to pilot this with a handful of providers, Homenode or datacenter, and report back here what it finds. If the community sees value, the next step is a discussion about how a health attestation could become a provider attribute. We are asking for nothing but a few providers willing to run it and share the results.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Hello Akash community,
We build Pantheon, an open source (Apache-2.0) health and diagnostics suite for GPUs, with a public results database at pantheongpu.com. It runs about fifty targeted workloads, memory fault tests adapted from the DRAM testing literature, power viruses aimed at one subsystem at a time, interconnect tests and AI shaped compute, and records the card's own error counters around every run. The output is a report tied to the GPU's own identity, the UUID, that says what that specific card can and cannot do.
We think this fits a gap that Homenode makes wider. Verifying that a provider has the GPU it claims settles what the hardware is. It does not settle whether it is healthy: whether the memory holds a pattern under heat, whether the card sustains its rated throughput for an hour instead of fifteen minutes, or whether it passes every check while quietly corrupting results. Those are the cards that produce a failed training run three days in, and with consumer cards arriving from individual homes, tenants will be renting exactly the cards nobody has ever tested that way.
What we propose is optional and open: a provider runs Pantheon on a card, the report goes into the public database under the GPU's UUID, and the provider can point to it as an audited attribute, in the same spirit as the existing provider audits. Tenants get a health record for the card they are about to rent. Providers with good hardware get a way to prove it. Nobody has to trust us: the kernels ship as source, anyone can read what runs, and anyone can rerun it.
We would like to pilot this with a handful of providers, Homenode or datacenter, and report back here what it finds. If the community sees value, the next step is a discussion about how a health attestation could become a provider attribute. We are asking for nothing but a few providers willing to run it and share the results.
Project: https://github.com/pantheongpu/pantheon
Website and database: https://pantheongpu.com/
Saqib Khan, CEO and Founder, PantheonGPU
All reactions