Provide a CUDA hostapp extension so that CUDA applications can run

[alexgg]

Once the hostapp extension support in balena-os/meta-balena#1987 is merged, provide a CUDA specific hostapp extension to include CUDA libraries that cannot be placed on a user application container.

This will allow CUDA applications to be run.

Also relates to balena-os/balena-supervisor#1449

[jellyfish-bot]

[alexgg] This issue has attached support thread https://jel.ly.fish/0e703127-5fdc-4085-9257-38be58f1ffd5

[acostach]

Note: Will need to ensure the libraries in the extension match the L4T version in the OS, as we've just updated master branch from 32.4.2 to 32.4.3 for the following boards: Nano SD-CARD, Nano eMMC, TX2, Xavier AGX, Xavier NX Devkit eMMC, Photon Xavier NX and Photon Nano

[klvnptr]

Can you guys please provide a "Xavier NX Devkit" image without the eMMC? We currently bought two Xavier NX Devkits from Arrow to get started with Balena development, and we realised it only supports old eMMC Devkits, which cannot be bought anymore. Thank you.

[acostach]

Hi @klvnptr, the NX Devkit is on our list to add BalenaOS support.

This ticket is about CUDA host extensions, we will post updates about the SD-CARD version in the Xavier NX ticket here: #61 (comment)

[jellyfish-bot]

[robertgzr] This issue has attached support thread https://jel.ly.fish/754891c7-61f3-48b5-b06a-d0e6d6f92304

[klvnptr]

@acostach may I ask, how is the CUDA hostapp extension coming along? when can we expect some beta release? :) thank you.

[acostach]

@klvnptr my colleagues are actively working on developing this feature, we cannot provide a timeline but will let you know when it becomes available for testing in the staging dashboard.

[klvnptr]

@acostach thanks. at least may I get some estimation, when will you ship this features in staging? 1 month? 3 month? 1 year? because depending on your answer, we might need to take another route how we inject drivers into balena OS. thank you.

[alexgg]

Connects-to: balena-os/meta-balena#2052