Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

A curated list for Efficient Large Language Models

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

A research library for pytorch-based neural network pruning, compression, and more.

Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models

Model optimizer used in Adlik.

[AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models

Caffe/Neon prototxt training file for our Neurocomputing2017 work: Fuzzy Quantitative Deep Compression Network

Hierarchical Ensemble Pruning

This repository has the porpouse of give a solution to the travelling sales man problem

[JCST 2023] "Inductive Lottery Ticket Learning for Graph Neural Networks" by Yongduo Sui, Xiang Wang, Tianlong Chen, Meng Wang, Xiangnan He, Tat-Seng Chua.

This repository contains scripts to prune Wav2vec2 using a neuroevolution-based method. More details about this method can be found in the paper Compressing Wav2vec2 for Embedded Applications.

Play the Othello board game against the algorithm and try to win!

attention pruning

Web based Connect 4 game with an AI opponent.

Experiments for channel-based Structured Pruning Adapters

Study and Implementation of various neural network pruning techniques. Extending the lottery ticket hypothesis to structured pruning for accelerated training while maintaining uncertainty and accuracy. The focus is on simplifying the model's complexity without sacrificing its overall performance or leading to overfitting.

This is the repository of our article published in IJCAI 2024 "EC-SNN: Splitting Deep Spiking Neural Networks on Edge Devices".

[NAACL Findings 2024] Pruning as a Domain-specific LLM Extractor. Support LLaMA2.