Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
-
Updated
Dec 4, 2023 - Jupyter Notebook
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
This repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥
Notebook to help setup TensorRT 7 in Google Colab.
A notebook running TensorRT's StableDiffusion demo on Google Colaboratory
jupyter/scipy-notebook with CUDA Toolkit, cuDNN, NCCL, and TensorRT
Notebook with commands to convert a Detectron2 MaskRCNN model to TensorRT
In this repository, you will receive information (notebooks) of TensorFlow model optimization using TensorRT and TF-Lite. You will be able to: Understand the fundamentals of optimization using TF-TRT and TF-Lite, deploy deep learning models by reduced precision (FP32, FP16 and INT8) on the inference stage and calibrate the weights
Add a description, image, and links to the tensorrt topic page so that developers can more easily learn about it.
To associate your repository with the tensorrt topic, visit your repo's landing page and select "manage topics."