Dual TPU M.2 Coral Accelerator #988
Replies: 11 comments 46 replies
-
Doesn't work with most setups to get dual tpu. Stock with the single. Read the github issue open for dual tpu on Google corals page. My opinion you're better off getting a dedicated device with tpu integration. |
Beta Was this translation helpful? Give feedback.
-
Following this as I just bought the dual tpu as it is the only thing in stock. I am on unraid, hoping there is a soltuon? |
Beta Was this translation helpful? Give feedback.
-
bought the usb & dual m.2 from arrow about a month ago. their website says 359 parts available for usb (was over 1300 when i ordered) https://www.arrow.com/en/products/g950-06809-01/google-corporation |
Beta Was this translation helpful? Give feedback.
-
I have the m.2 dual TPU working through Proxmox (since that was the only TPU actually available). I spent a couple of days trying to get pcie passthrough working on Frigate with esxi 7.0. There are issues with MSI-X interrupts that I couldn't resolve so I migrated my server and all my VMs to Proxmox (after running esxi for 12 years!). Proxmox is working fine passing the dual TPU through to a KVM virtual machine. I'm using a Fenvi wifi adapter from Amazon - note there is more than one, the one that works is the 'M.2 NGFF A+E key to PCI Express adapter'. Of course only one TPU is recognized. I've seen some suggestions to run Frigate on an LXC container in Proxmox but in order to run Docker (a container inside a container) you need to disable ALL of the security features. Docker runs as root. You need to run the container in privileged mode with apparmor disabled. So Docker root is the same as Proxmox root. It is a hideously insecure setup. I tried it briefly but went with a KVM virtual machine and followed the instructions for passthrough. Performance is OK, inference speed is around 9. I tend to document things so if anyone wants my notes on migrating from esxi to Proxmox and setting up passthrough let me know. |
Beta Was this translation helpful? Give feedback.
-
Also looking at alternatives for the usb coral. Is it easier to set up with the standard M.2 accelerator and/or single mini pcie accelerator? I have no issues wiping proxmox and installing generic linux and frigate. Thanks |
Beta Was this translation helpful? Give feedback.
-
I could not get hte dual tpu to work, when using the config setup like this detectors: frigate would not load properly and terminate so gave up and ran with just the 1, then I thought I would try this detectors: and it worked lol, go figure [2023-01-28 18:10:42] frigate.edgetpu INFO : Attempting to load TPU as pci:0 |
Beta Was this translation helpful? Give feedback.
-
Got my dual TPU working used this adapter: Had to blacklist the apex and gasket drivers in modprobe.d on Proxmox, update initramf, reboot, and manually add the PCI passthru to the VM using the shell command. Once that was done I had zero issue passing through to my VM. Once I went in the VM and added the TPU Runtime and Pycoral I was in business. Currently getting a 11.09 inference speed, but I'm still tweaking my config. I have a USB Coral as well, but I found it was having a lot of connectivity issues with Proxmox passthru. I'm convinced the USB on the Dell r720 I use wasn't supplying sufficient power for the TPU under load. |
Beta Was this translation helpful? Give feedback.
-
At this point in time (Q4 2023), I end up wondering if the Google Coral team ever had a brainstorming session about the M.2 E-key choice for the dual TPU module. There's so few end products (other than the Frigate NVR) that offer enough (populated) lanes on their M.2 expansion slots ! Really, the Coral M.2 dual edge TPU module is a head-scratcher to me. No compatibility whatsoever with the run-of-the-mill iot sbcs the Coral is aimed to supplement ( in terms of power figures ). 🤔 I'm weeping over the fact that I won't ever use this nifty little module. 😭 |
Beta Was this translation helpful? Give feedback.
-
Hi, it is possible to add the M.2 board to WIFI M.2 connector on HP ProDek 600 G4? |
Beta Was this translation helpful? Give feedback.
-
I am using the Dual Edge in Frigate with no issues other than my adapter (made for an M.2 WiFi NIC) is only giving me access to one TPU. The key to getting the Dual Edge to work is by getting the right adapter. This $30 adapter will give you access to both TPUs. https://www.makerfabs.com/dual-edge-tpu-adapter.html |
Beta Was this translation helpful? Give feedback.
-
The Dual Edge TPU is working well for me with my Zima Blade and Zima Board... I'm able to access both TPU's from the Coral Dual PCIe accelerator using the Maker Fab Dual TPU Low Profile adapter on the Zima Blade and Zima Board. Running Also works fine with Frigate just needed to pass both apex devices to the docker container.
config.yml
|
Beta Was this translation helpful? Give feedback.
-
Can't seem to find the USB edge accelerator in stock anywhere. Saw some unraid guys had success using the mini pcie module. Anything conceptually wrong with using the new dual TPU unit with an M.2 -> pcie adapter and passing it all through?
Beta Was this translation helpful? Give feedback.
All reactions