Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPUDirect to local SSD #136

Open
Fizzbb opened this issue Jul 27, 2022 · 0 comments
Open

GPUDirect to local SSD #136

Fizzbb opened this issue Jul 27, 2022 · 0 comments
Assignees

Comments

@Fizzbb
Copy link
Collaborator

Fizzbb commented Jul 27, 2022

Issues to investigate

  1. steps to install/enable a NVMe SSD (not plugin and directly visible under Ubuntu)
  2. steps/configurations to make SSD visible to GPU (GPU model requirements)
  3. cuda level code changes to make GPU read/write direct from/to SSD
  4. python level code changes
  5. simple mnist training job completion time comparison before and after

Time Saving Theoretically calculation (?)
E.g. 150MB cifar10 data, CPU read time (from SSD to CPU memory) xx sec (a), GPU copy time fromHtoD xx sec (b). GPU direct SSD read time xx sec (c). read time is calculated by 150MB/theoretical bandwidth
time saving: a + b - c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants