Replies: 14 comments 31 replies
|
@Donalaren Tesla V100 and all NVIDIA datacenter GPUs don't use Resizable BAR they just has a large BAR by default, the issue here is likely with your BIOS configuration. Dell 7920T should be recent enough to not have the weird issues on older motherboards requiring UEFIPatches. All ReBarState does is read/write the ReBarState EFI variable which you could also read yourself but it's going to give the same result as what you're seeing. EDIT: Seems like you aren't running ReBarUEFI modded BIOS even, in that case ReBarState does absolutely nothing. |
|
Thank you very much for your reply; it has given me renewed hope. Do you believe RebarState cannot resolve this compatibility issue with the Tesla V100? Yet I've observed on other websites that they've addressed Tesla GPU problems (including Tesla P100 and Tesla P40). Moreover, they all mention switching the GPU mode to graphics mode via NVFlash. However, NVFlash currently fails to detect my Tesla GPU, I suspect this stems from the absence of Rebar, as per this webpage. Regardless, Rebar is essential, so I intend to give it a try. Thus, we return to the RebarState software. I acknowledge it is an extremely useful tool—thank you for sharing it—but I seem to have yet to grasp how to utilise it properly. Clearly, my understanding of this statement was flawed. I mistakenly believed that , I only needed to run ReBarState without modifying BIOS on the Ubuntu system. |
|
Tesla V100 isn't a rebar GPU it's going to make no difference. |
|
@Donalaren This information is pretty important to me because I am also looking for a V100 for my 7820T, and they have the same chipset and pcie slots configurations. I noticed that someone tried to use V100 on a 7920T with Windows 10, while he came with the error code (12), which said the V100 does not have enough resources to use. So, I am wondering if it is possible to allocate more pcie bus to slot 2 or 4 where the V100 goes on could help. You may try to get into bios setup->advanced configurations->pcie bus->change into option 1 (with more bus allocated to pcie slot 2 and 4), then boot up to see if the problem can be solved. |
|
@Donalaren @Icbears The Dell BIOS is up-to-date (2.46 I think) and I have messed with just about all the BIOS settings I can think of. I have tried the pcie "option 1 & 3" allocations, which assign more resources (AFAI can tell) with the GPU in slot 4 and it makes no difference. The problem is also, I cannot even get the machine to POST with my regular Quadro video card plus the GPU (tried with different slots). This suggests there is some unusual hardware conflict. |
|
-- Did you ever got it to work? I got the same issue here T7920 (dual Xeon Gold, 192 GB and trying to add the tesla v100. windows detects the cad but it won't enable is. the error message says that cant find enough resources, to disable another device. |
|
Hello all, Did anyone ever get this working with the T7920? As fate should have it, I have a T7920 Dual Xeon Silver 4214 lying around and a couple of V100's. I'd love to get this up and running. @xCuri0 if I send you across the bios dump from the dell executable, do you think you could help identify the hidden variables if they exist? Much appreciated, and looking forward to hearing from you all. -A |
|
We have a Dell 7920 with dual xeon processors, and 5820 with single xeon cpu. Dell seemingly refuses to add rebar support into bios for this generation of workstations. I've heard that it can be pretty challenging on these machines because Dell doesn't allow directly loading a modified bios. If anyone has been successful with workstations similar to either of these machines we'd love to hear about it. |
|
Adding another data point: Dell Precision 7920T, dual Xeon Gold (Cascade Lake Refresh 26-core), 384 GB RAM, Tesla V100 32GB PCIe. Same symptoms as @Donalaren and @bwtimmermans — V100 prevents POST entirely in any CPU0 or CPU1 slot. CPU0 actually errors out with 2-4 error code. CPU1 (PCIe 6 and 7) does not error out but they wont POST, I get NUMLOCK light flicker 2-3x and then Darkness washes over....Darker than a black steer's tookus on a moonless prairie night. There was no bottom.... -NVIDIA OEM dongle (030-0571-000), proper EPS power, BIOS 2.50.0, all relevant settings set correctly I'm willing to provide BIOS dumps, diagnostic logs, and test patched BIOSes if @xCuri0 has bandwidth. Currently running production QE calculations (Genuine Condensed matter physics that is for the good of mankind!) on the system without V100 , but available to coordinate testing windows for ReBarUEFI patches if there's any chance this is fixable at firmware level. Wanted to see this thread concluded as I just bought a V100 32GB and don't really want to send it back, we can do this! help me @xCuri0 ....you're my only hope... |
|
Proposed approach — looking for @xCuri0's validation Root cause hypothesis: Proposed fix (ReBarUEFI methodology applied to 7920):
What I have:
What I can contribute back to the community:
Question for @xCuri0:
Happy to test patches you produce, or develop independently and share results. — Steve |
|
SOLVED — Tesla V100 32GB working on Dell Precision 7920T After ~30 hours, got a Tesla V100 PCIe 32GB working on a Dell Precision 7920 Tower. Posting full recipe so others can reproduce. Hardware:
Root cause: The Dell PowerEdge R7920 Rack BIOS exposes an "MMIO Base" menu option (512GB/12TB/56TB). The T7920 Tower BIOS has the same underlying Intel Purley code but Dell stripped the menu. The EFI variable is still consumed by the same DXE driver. Fix — write SocketCommonRcConfig EFI variable via UEFI Shell:
This sets:
Additional requirements that turned out to matter:
Holy Crap I can't believe I figured it out, hopefully this helps.... @GezelligLLC @Donalaren @bwtimmermans Let me know if anyone has questions, happy to help!! Good Luck out there! |
|
@StevieClear - you're the best! Thanks so much for the detailed explanation and instructions. I followed them carefully and only added 2 validation reboots to make sure I hadn't broken anything. The first was right after saving the BIOS edit. Once that worked fine, I edited the GRUB file, and did the second validation reboot. All went well. I shut down, installed the B70 and sha-bam! Booted perfectly into Ubuntu. One additional note - I left an old AMD Radeon Pro WX 2100 installed in slot 5. That card drives my 2 monitors. Works perfectly with that 2 Gb card in alongside the B70. I don't even need to run headless! I couldn't be more excited, nor could I be more grateful to you and the amazing work you did to make this possible. I just finished installing and setting up my Intel Arc Pro B70 in Ubuntu - frankly that was MUCH more difficult to accomplish, but it is getting done. Next, I plan to try installing a 2nd B70 in the other CPU's slot 4. I'll update here to let everyone know if it works. Again, thanks a ton! |
|
can create a bootable stick for using a script to save having to type it all out |
|
Hi everyone, I have a Dell 7820 tower with 128 GB ECC RAM and an NVIDIA GeForce 4060, running BIOS version 2.50 (the latest version currently available). Would it be possible to reduce the boot time ( Windows Loading Delays Keyboard and Mouse not work at Windows Boot (Spinning Dots)) fastboot is on, using the method described above? My computer takes about a minute from the Dell logo to the login screen, whether I’m booting into Windows 11 or Ubuntu 26.04 (I have a dual-boot setup). Please help me modify the EFI parameters in my BIOS—I suspect that memory training or similar hardware initialization is causing this delay at every startup, F12 Dell Diagnose Tool say Everythink is okay on Fast or Full Test. There’s also no setting in the BIOS to bypass this memory training by saving the training data or anything similar. Thanks in advance |
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hello, I am in urgent need of your assistance. I am attempting to use a Tesla V100 16G PCIe graphics card on a Dell Precision 7920T.
System
Motherboard: Dell Precision 7920T
Card: Tesla V100 16G PCIe
System: Ubuntu 22.04
RAM: 64G
Description
I first attempted this on Ubuntu 22.04 using @xCuri0 's ReBarState. Followed this method, after building and running RebarState, set the value to 32. But this approach proved ineffective. After rebooting and reopening the RebarState, I can see
the Current ReBarState 32/Unlimited.nvidia-smistill can't see my Tesla V100 (lspci | grep -i nvidiacorrectly identified the GPU model0000:73:00.0 3D controller: NVIDIA Corporation GV100GL [Tesla V100 PCIe 16GB] (rev a1)).Through
dmesgI can see:This is consistent with the situation without ReBarState. I have only followed this method to build and run ReBarState on the Ubuntu system without making any modifications to the BIOS. My actions were as follows:
So I suspect ReBarState may not be functioning. How to verify if the RebarState is working in this scenario?
Note that I'm not suspecting the software itself; I believe my execution may be incorrect. Any suggestions would be most gratefully received.
All reactions