Skip to content
@mit-han-lab

MIT HAN Lab

Efficient AI Computing. PI: Song Han

Pinned

  1. streaming-llm streaming-llm Public

    [ICLR 2024] Efficient Streaming Language Models with Attention Sinks

    Python 6.3k 354

  2. smoothquant smoothquant Public

    [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

    Python 1.1k 118

  3. llm-awq llm-awq Public

    [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

    Python 1.9k 137

  4. bevfusion bevfusion Public

    [ICRA'23] BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation

    Python 2.1k 373

  5. once-for-all once-for-all Public

    [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

    Python 1.8k 331

  6. temporal-shift-module temporal-shift-module Public

    [ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

    Python 2k 418

Repositories

Showing 10 of 50 repositories
  • TinyChatEngine Public

    TinyChatEngine: On-Device LLM Inference Library

    C++ 569 MIT 55 24 2 Updated May 28, 2024
  • patch_conv Public

    Patch convolution to avoid large GPU memory usage of Conv2D

    Python 61 MIT 4 1 1 Updated May 26, 2024
  • efficientvit Public

    EfficientViT is a new family of vision models for efficient high-resolution vision.

    Python 1,494 Apache-2.0 132 71 0 Updated May 21, 2024
  • qserve Public

    QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

    Python 256 Apache-2.0 5 12 1 Updated May 15, 2024
  • llm-awq Public

    [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

    Python 1,940 MIT 137 105 6 Updated May 13, 2024
  • lmquant Public
    Python 55 Apache-2.0 0 1 0 Updated May 11, 2024
  • distrifuser Public

    [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

    Python 454 MIT 11 2 0 Updated May 5, 2024
  • spatten-llm Public

    [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

    Scala 51 MIT 3 1 0 Updated May 3, 2024
  • torchquantum Public

    A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.

    Jupyter Notebook 1,209 MIT 170 59 (5 issues need help) 4 Updated Apr 30, 2024
  • smoothquant Public

    [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

    Python 1,059 MIT 118 54 1 Updated Apr 28, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.