Triton backend for https://github.com/OpenNMT/CTranslate2
-
Updated
Aug 20, 2024 - C++
Triton backend for https://github.com/OpenNMT/CTranslate2
Integrates NVIDIA GPUs for HPC and edge computing. Leveraging CUDA, Jetson, and Triton Inference Server, it offers real-time data processing with Kafka and Spark. Scalable microservices with Spring Boot, Docker, Kubernetes, robust security, and CI/CD with Jenkins make it ideal for advanced computational tasks. @NVIDIA
Binary Ninja plugin that can be used to apply Triton's dead store eliminitation pass on basic blocks or functions.
MLModelService wrapping Nvidia's Triton Server
NVIDIA-accelerated, deep learned model support for image space object detection
NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU
Standalone static version of Triton's x86/x64 translator
TensorFlow Lite backend with ArmNN delegate support for Nvidia Triton
Adaptive Callsite-sensitive Control Flow Integrity - EuroS&P'19
COIN Attacks: on Insecurity of Enclave Untrusted Interfaces in SGX - ASPLOS 2020
Sydr benchmark applications
pluggable tool to convert an unrolled TritonAST to LLVM-IR, optimize it and get back to TritonAST
Add a description, image, and links to the triton topic page so that developers can more easily learn about it.
To associate your repository with the triton topic, visit your repo's landing page and select "manage topics."