Learning Efficient Convolutional Networks through Network Slimming, In ICCV 2017.
-
Updated
May 13, 2019 - Python
#
fast-inference
Here are 10 public repositories matching this topic...
Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.
-
Updated
Oct 12, 2024 - Python
[NeurIPS'23] Speculative Decoding with Big Little Decoder
-
Updated
Feb 6, 2024 - Python
This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
-
Updated
Jul 16, 2024 - Python
Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.
-
Updated
Oct 28, 2024 - Python
Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"
attention-mechanism
fast-inference
sparse-neural-networks
low-rank
vision-transformer
efficient-transformers
sparse-attention
efficient-vision-transformers
-
Updated
Jul 4, 2023 - Python
Fast Forward-Only Deep Neural Network Library for the Nao Robots
-
Updated
Jun 6, 2019 - C++
An implementation of the encoder-decoder transformer for SMILES-to-SMILES translation tasks with inference accelerated by speculative decoding
-
Updated
Oct 23, 2024 - Python
Verification of the effect of speculative decoding in Japanese.
-
Updated
Mar 4, 2024 - Python
Reproducibility Project for [NeurIPS'23] Speculative Decoding with Big Little Decoder
-
Updated
May 30, 2024 - Python
Improve this page
Add a description, image, and links to the fast-inference topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the fast-inference topic, visit your repo's landing page and select "manage topics."