Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to override nvidia profile #26

Closed
happysj2202 opened this issue Jan 8, 2023 · 2 comments
Closed

Failed to override nvidia profile #26

happysj2202 opened this issue Jan 8, 2023 · 2 comments

Comments

@happysj2202
Copy link

happysj2202 commented Jan 8, 2023 •
edited by mbilker
Loading

  1. Machine infomations:
    OS: archlinux
    Kernel: archlinux 5.12.15-arch1-1
    NVIDIA Driver Version: 460.73.01
    GPU: RTX 1660 SUPPER

  2. Override profile:

➜  vgpu_unlock-rs cat /etc/vgpu_unlock/profile_override.toml
[profile.nvidia-258]
num_displays = 1
display_width = 1920 
display_height = 1280 
max_pixels = 2457600 
cuda_enabled = 1

  1. Problem:
    Failed override nvidia profile. The error message "Parameters size for NVA082_CTRL_CMD_HOST_VGPU_DEVICE_GET_VGPU_TYPE_INFO was 1840 bytes, expected 1848 bytes" is reported.

  2. Logs:
    4.1 nvidia-vgpu-mgr logs:

➜  vgpu_unlock-rs journalctl -u nvidia-vgpu-mgr.service
Jan 09 00:01:47 archlinux systemd[1]: Starting NVIDIA vGPU Manager Daemon...
Jan 09 00:01:47 archlinux systemd[1]: Started NVIDIA vGPU Manager Daemon.
Jan 09 00:01:48 archlinux nvidia-vgpu-mgr[487]: notice: vmiop_env_log: nvidia-vgpu-mgr daemon started
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[487]: Nv0000CtrlVgpuGetStartDataParams {
                                                    mdev_uuid: {2b7bc7e4-8784-4933-8613-9bc92bbc718c},
                                                    config_params: "vgpu_type_id=258",
                                                    qemu_pid: 3091,
                                                    gpu_pci_id: 0x100,
                                                    vgpu_id: 2,
                                                    gpu_pci_bdf: 256,
                                                }
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_env_log: vmiop-env: guest_max_gpfn:0x0
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_env_log: (0x0): Received start call from nvidia-vgpu-vfio module: mdev uuid 2b7bc7e4-8784-4933-8613-9bc92bbc718c GPU PCI id 00:01:00.0 config params vgpu_type_id=258
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_env_log: (0x0): pluginconfig: vgpu_type_id=258
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_env_log: Successfully updated env symbols!
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: cmd: 0x20801322 failed.
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: cmd: 0x2080014b failed.
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: Parameters size for NVA082_CTRL_CMD_HOST_VGPU_DEVICE_GET_VGPU_TYPE_INFO was 1840 bytes, expected 1848 bytes
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): gpu-pci-id : 0x100
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): vgpu_type : Quadro
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): Framebuffer: 0xb0000000
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): Virtual Device Id: 0x1e30:0x1327
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): FRL Value: 60 FPS
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: ######## vGPU Manager Information: ########
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: Driver Version: 460.73.01
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: cmd: 0x2080012f failed.
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): Cannot query ECC status. vGPU ECC support will be disabled.
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): Init frame copy engine: syncing...
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: (0x0): vGPU migration disabled
Jan 09 00:05:10 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: display_init inst: 0 successful
Jan 09 00:05:35 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: ######## Guest NVIDIA Driver Information: ########
Jan 09 00:05:35 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: Driver Version: 462.31
Jan 09 00:05:35 archlinux nvidia-vgpu-mgr[3195]: notice: vmiop_log: vGPU version: 0x90001
......

4.2 nvidia-vgpud logs:

➜  vgpu_unlock-rs journalctl -u nvidia-vgpud   
Jan 09 00:01:47 archlinux systemd[1]: Starting NVIDIA vGPU Daemon...
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Verbose syslog connection opened
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Started (482)
Jan 09 00:01:47 archlinux systemd[1]: Started NVIDIA vGPU Daemon.
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Global settings:
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Size: 16
                                             Version 1
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Homogeneous vGPUs: 1
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: vGPU types: 517
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: pciId of gpu [0]: 0:1:0:0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Physical GPU:
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: PciID: 0x0000 / 0x0001 / 0x0000 / 0x0000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Size: 52
                                             Version 1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: DevID: 0x10de / 0x1e30 / 0x10de / 0x12ba
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Supported vGPUs count: 23
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Supported VGPU 0x100: max 24
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: VGPU Type 0x100: GRID RTX6000-1Q Class: Quadro
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: DevId: 0x10de / 0x1e30 / 0x10de / 0x1325
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer: 0x38000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Mappable video size: 0x400000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer reservation: 0x8000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: FRL configuration: 0x3c
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: CUDA enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: ECC supported: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Multi vGPU supported: 0x0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Encoder Capacity: 0x64
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: BAR1 Length: 0x100
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Frame Rate Limiter enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Number of Displays: 4
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Max pixels: 17694720
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Display: width 5120, height 2880
Jan 09 00:01:47 archlinux systemd[1]: Starting NVIDIA vGPU Daemon...
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Verbose syslog connection opened
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Started (482)
Jan 09 00:01:47 archlinux systemd[1]: Started NVIDIA vGPU Daemon.
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Global settings:
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Size: 16
                                             Version 1
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: Homogeneous vGPUs: 1
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: vGPU types: 517
Jan 09 00:01:47 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: pciId of gpu [0]: 0:1:0:0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Physical GPU:
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: PciID: 0x0000 / 0x0001 / 0x0000 / 0x0000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Size: 52
                                             Version 1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: DevID: 0x10de / 0x1e30 / 0x10de / 0x12ba
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Supported vGPUs count: 23
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Supported VGPU 0x100: max 24
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: VGPU Type 0x100: GRID RTX6000-1Q Class: Quadro
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: DevId: 0x10de / 0x1e30 / 0x10de / 0x1325
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer: 0x38000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Mappable video size: 0x400000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer reservation: 0x8000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: FRL configuration: 0x3c
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: CUDA enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: ECC supported: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Multi vGPU supported: 0x0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Encoder Capacity: 0x64
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: BAR1 Length: 0x100
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Frame Rate Limiter enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Number of Displays: 4
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Max pixels: 17694720
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Display: width 5120, height 2880
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: License: Quadro-Virtual-DWS,5.0;GRID-Virtual-WS,2.0;GRID-Virtual-WS-Ext,2.0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Supported VGPU 0x101: max 12
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: VGPU Type 0x101: GRID RTX6000-2Q Class: Quadro
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: DevId: 0x10de / 0x1e30 / 0x10de / 0x1326
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer: 0x74000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Mappable video size: 0x400000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer reservation: 0xc000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: FRL configuration: 0x3c
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: CUDA enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: ECC supported: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Multi vGPU supported: 0x0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Encoder Capacity: 0x64
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: BAR1 Length: 0x100
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Frame Rate Limiter enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Number of Displays: 4
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Max pixels: 35389440
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Display: width 7680, height 4320
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: License: Quadro-Virtual-DWS,5.0;GRID-Virtual-WS,2.0;GRID-Virtual-WS-Ext,2.0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: 
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Supported VGPU 0x102: max 8
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: VGPU Type 0x102: GRID RTX6000-3Q Class: Quadro
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: DevId: 0x10de / 0x1e30 / 0x10de / 0x1327
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer: 0xb0000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Mappable video size: 0x400000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Framebuffer reservation: 0x10000000
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: FRL configuration: 0x3c
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: CUDA enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: ECC supported: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Multi vGPU supported: 0x0
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Encoder Capacity: 0x64
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: BAR1 Length: 0x100
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Frame Rate Limiter enabled: 0x1
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Number of Displays: 4
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Max pixels: 35389440
Jan 09 00:01:48 archlinux nvidia-vgpud[482]: Display: width 7680, height 4320
......
@mbilker
Copy link
Owner

mbilker commented Jan 14, 2023

Ah, this is because the structure grew larger with driver branch 510 which is why you are seeing this issue with driver branch 460.

@mbilker
Copy link
Owner

mbilker commented Sep 15, 2024

I believe this was fixed in newer commits that use the smaller structure.

@mbilker mbilker closed this as completed Sep 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mbilker @happysj2202