nvsmi

• Version: 0.1-0
• License: BSD 2-Clause
• Author: Drew Schmidt
• Project home: https://github.com/wrathematics/nvsmi
• Bug reports: https://github.com/wrathematics/nvsmi/issues

An nvidia-smi-like interface for R. This works via NVML, and does not actually require the nvidia-smi utility to be installed or in your $PATH (although it probably will be anyway if NVML is installed).

Currently the package has most (all?) of the useful NVML "get" functions available, as well as a few high-level interfaces (see the API section below). More NVML wrappers will be added over time (if you want one, feel free to ask for it, or better yet, submit a PR). At this time I have no plans to add the "set" functions, because these require root and I think it's a monstrously bad idea to give an R process root.

Installation

The development version is maintained on GitHub:

remotes::install_github("wrathematics/nvsmi")

You will need to have NVIDIA's NVML library installed to build the package. NVML is bundled with CUDA, which you can download from the NVIDIA website.

The package needs to be able to find nvml.h and libnvidia-ml.so. We try looking in several locations for these files, but you can manually specify the paths for the header and library with the configure-args --with-nvml-include and --with-nvml-lib, respectively. We also recommend setting /usr/local/cuda/ as a link to your latest CUDA installation, which is an option when you install CUDA via the runfile (and should automatically happen if you use the .deb or .rpm).

If you have trouble building the package, please open an issue with an output of the package configure (what you see when you run ./configure), as well as the locations of nvml.h and libnvidia-ml.so on your system.

I have literally no idea how to get this to work on Windows at this time.

Example Usage

s = nvsmi::smi()
s
## Thu Apr 18 12:49:55 2019 
## +-----------------------------------------------------------------------------+
## |      R-SMI 390.116                  Driver Version: 390.116                 |
## |-------------------------------+----------------------+----------------------+
## | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
## | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
## |===============================+======================+======================|
## |   0  GeForce GTX 107...  Off  | 00000000:08:00.0  On |
## | 39%   32C    P2    42W / 252W |    584MiB /  8116MiB |      0%      Default |
## +-------------------------------+----------------------+----------------------+
## 
## +-----------------------------------------------------------------------------+
## | Processes:                                                       GPU Memory |
## |  GPU       PID   Type   Process name                             Usage      |
## |=============================================================================|
## |    0      1781      G   /usr/lib/xorg/Xorg                           273MiB |
## |    0     21407      C   /usr/lib/R/bin/exec/R                        311MiB |
## +-----------------------------------------------------------------------------+

The default print method mimics the nvidia-smi utility. But there is also a "minimal" print method which I think is much better:

options("nvsmi_printer"="minimal")
s
## +-----------------------------------------------------------------------------+
## | Date: Thu Apr 18 12:44:24 2019       Driver Version: 390.116                |
## |-------------------------------+----------------------+----------------------+
## | GPU Name               | Util  Fan  Temp   Perf        Power         Memory |
## |==========================+==================================================|
## |   0 GeForce GTX 107... |   0%  39%   32C     P2     42W/252W    584/8116MiB |
## +-------------------------------+----------------------+----------------------+
## 
## +-----------------------------------------------------------------------------+
## |  GPU       PID   Type   Process name                               Mem Used |
## |=============================================================================|
## |    0      1781      G   /usr/lib/xorg/Xorg                           273MiB |
## |    0     21407      C   /usr/lib/R/bin/exec/R                        311MiB |
## +-----------------------------------------------------------------------------+

In this example we only have one GPU on the system, but data for all GPUs will be shown. Each GPU is a row in a dataframe, and each process is listed in a separate dataframe:

str(s)
## List of 4
##  $ version  : chr "390.116"
##  $ date     : chr "Thu Apr 18 12:44:24 2019"
##  $ gpus     :'data.frame':	1 obs. of  13 variables:
##   ..$ name            : chr "GeForce GTX 1070 Ti"
##   ..$ busid           : chr "00000000:08:00.0"
##   ..$ persistence_mode: logi FALSE
##   ..$ disp            : logi TRUE
##   ..$ speed           : int 39
##   ..$ temp            : int 32
##   ..$ perf            : int 2
##   ..$ power           : int 42440
##   ..$ power_max       : int 252000
##   ..$ memory_used     : num 6.12e+08
##   ..$ memory_total    : num 8.51e+09
##   ..$ utilization     : int 0
##   ..$ compute_mode    : chr "Default"
##  $ processes:Classes ‘nvidia_processes’ and 'data.frame':	2 obs. of  5 variables:
##   ..$ GPU    : int [1:2] 0 0
##   ..$ PID    : int [1:2] 1781 21407
##   ..$ Type   : chr [1:2] "G" "C"
##   ..$ Process: chr [1:2] "/usr/lib/xorg/Xorg" "/usr/lib/R/bin/exec/R"
##   ..$ Memory : num [1:2] 2.86e+08 3.26e+08
##  - attr(*, "class")= chr "nvidia_smi"

API

Initialization and Shutdown

nvsmi_init()
nvsmi_shutdown()

System Queries

system_get_cuda_driver_version()
system_get_driver_version()
system_get_nvml_version()
system_get_process_name(pid)

Device Queries

device_get_board_part_number(device)
device_get_brand(device)
device_get_compute_mode(device)
device_get_compute_running_processes(device)
device_get_count()
device_get_cuda_compute_capability(device)
device_get_curr_pcie_link_generation(device)
device_get_curr_pcie_link_width(device)
device_get_display_active(device)
device_get_fan_speed(device)
device_get_graphics_running_processes(device)
device_get_handle_by_index(index)
device_get_index(device)
device_get_memory_info(device)
device_get_name(device)
device_get_performance_state(device)
device_get_persistence_mode(device)
device_get_power_max(device)
device_get_power_usage(device)
device_get_serial(device)
device_get_temperature(device)
device_get_utilization(device)
device_get_uuid(device)

High-level interface:

gpu_processes(type="both")
smi(processes=TRUE)

Using the Low Level API

• call nvsmi_init() before you do anything
• call nvsmi_shutdown() when you're done
• device pointers become invalid (but will not obviously be so) after calling nvsmi_shutdown()

Quick example:

library(nvsmi)
nvsmi_init()

system_get_nvml_version()
## [1] "9.390.116"

device_get_count()
## [1] 1

d = device_get_handle_by_index(0)
d
## A device pointer to GPU 0 of 1 

device_get_name(d)
## [1] "GeForce GTX 1070 Ti"

nvsmi_shutdown()

The function gpu_processes() is build from the low-level API, so you can look at its source code for another example.