Skip to content

Conversation

@UsamaKenway
Copy link
Contributor

This pull request updates the hardware.ts file to include the latest GPU specifications for various NVIDIA models

The following GPUs have been added:

  • H200: 241.3 TFLOPS, 141 GB memory
  • L40s: 91.61 TFLOPS, 48 GB memory
  • L20: 59.35 TFLOPS, 48 GB memory
  • L4: 30.29 TFLOPS, 24 GB memory
  • RTX 5090: 104.8 TFLOPS, 32 GB memory
  • RTX 5090 D: 104.8 TFLOPS, 32 GB memory
  • RTX 5080: 56.28 TFLOPS, 16 GB memory
  • RTX 5080 Mobile: 24.58 TFLOPS, 16 GB memory
  • RTX 5070: 30.84 TFLOPS, 12 GB memory
  • RTX 5070 Mobile: 23.22 TFLOPS, 8 GB memory
  • RTX 4090 Mobile: 32.98 TFLOPS, 16 GB memory
  • RTX 4080 Mobile: 24.72 TFLOPS, 12 GB memory
  • RTX 4070 Mobile: 15.62 TFLOPS, 8 GB memory
  • RTX 4060 Mobile: 11.61 TFLOPS, 8 GB memory
  • RTX 3080 Mobile: 18.98 TFLOPS, 8 GB memory
  • GTX 1050 Ti: 2.1 TFLOPS (float32), 4 GB memory
  • P100: 19.05 TFLOPS, 16 GB memory

source: techpowerup.com

Copy link
Member

@pcuenca pcuenca left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

@pcuenca
Copy link
Member

pcuenca commented Feb 24, 2025

Some tests are timing out and seem unrelated, but let's wait a few hours just in case, I'll get back to this in a while. Sorry for the delay @UsamaKenway 🙏

Copy link
Member

@julien-c julien-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice @UsamaKenway 🔥

@pcuenca
Copy link
Member

pcuenca commented Feb 26, 2025

The same tests fail locally for me in main, merging.

@pcuenca pcuenca merged commit 34edae3 into huggingface:main Feb 26, 2025
2 of 4 checks passed
tflops: 21.75,
memory: [8],
},
"RTX 3070 Ti Laptop": {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Btw this broke some users - resulting in 500s on HF due to discrepancy between DB data & code data (not a big deal)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants