|
Hello 👋, I am not an expert in CUDA/HIP porting, so please excuse me if this is a naive question! Is there a straightforward or automated way (e.g., using tools like I am using an AMD Radeon RX 9070 XT (RDNA4) graphics card. It handles general GPU workloads like Ollama LLMs well, so I was wondering if Thanks for your time and for open-sourcing this project! |
Replies: 2 comments 6 replies
|
At the moment, I haven’t tried it myself because AWS does not offer the latest AMD GPUs, but I guess it will need some manual work. We only work on AWS, and we do not have plans to ship for AMD devices simply because we don’t have the need ourselves. If AWS provides AMD options, and if they turn out to be much more reasonable than NVIDIA hardware, we may change our mind. |
@rafrafek Hi AMD (ROCm) now shipped.