alibaba / BladeDISC Star 816 Code Issues Pull requests BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads. machine-learning deep-learning neural-network compiler tensorflow pytorch inference-optimization mlir Updated Nov 15, 2024 C++
jiazhihao / TASO Star 692 Code Issues Pull requests The Tensor Algebra SuperOptimizer for Deep Learning deep-neural-networks deep-learning inference-optimization Updated Jan 26, 2023 C++
mit-han-lab / inter-operator-scheduler Star 195 Code Issues Pull requests [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration acceleration cnn parallelism inference-optimization Updated Apr 27, 2022 C++
lmaxwell / Armednn Star 13 Code Issues Pull requests cross-platform modular neural network inference library, small and efficient neural-network eigen lstm inference-engine eigen3 inference-optimization conv1d Updated May 15, 2023 C++
grazder / template.cpp Star 6 Code Issues Pull requests [WIP] A template for getting started writing code using GGML deep-learning cpp inference-optimization ggml Updated May 1, 2024 C++
Bisonai / ncnn Star 4 Code Issues Pull requests Modified inference engine for quantized convolution using product quantization quantization product-quantization edge-machine-learning inference-optimization mobile-deep-learning inference-acceleration Updated Jul 1, 2022 C++
ieee820 / ncnn Star 0 Code Issues Pull requests ncnn is a high-performance neural network inference framework optimized for the mobile platform arm-neon mobile-networks ncnn inference-optimization Updated May 29, 2019 C++