Skip to content
@ModelTC

ModelTC

Model Infra

Pinned Loading

  1. MQBench MQBench Public

    Model Quantization Benchmark

    Shell 741 135

  2. United-Perception United-Perception Public

    United Perception

    Python 427 65

  3. NNLQP NNLQP Public

    Python 33 3

  4. Dipoorlet Dipoorlet Public

    Offline Quantization Tools for Deploy.

    Python 108 14

  5. lightllm lightllm Public

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Python 2.1k 182

Repositories

Showing 10 of 35 repositories
  • lightllm Public

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    ModelTC/lightllm’s past year of commit activity
    Python 2,124 Apache-2.0 182 56 4 Updated Jul 25, 2024
  • EasyLLM Public

    Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing usability, it also ensures training efficiency.

    ModelTC/EasyLLM’s past year of commit activity
    Python 32 Apache-2.0 4 1 0 Updated Jul 25, 2024
  • llmc Public

    This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

    ModelTC/llmc’s past year of commit activity
    Python 131 Apache-2.0 15 0 0 Updated Jul 25, 2024
  • TFMQ-DM Public

    [CVPR 2024 Highlight] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".

    ModelTC/TFMQ-DM’s past year of commit activity
    Jupyter Notebook 48 Apache-2.0 3 0 0 Updated Jul 25, 2024
  • general-sam-py Public

    Python bindings for general-sam and some utilities

    ModelTC/general-sam-py’s past year of commit activity
    Python 1 Apache-2.0 0 0 2 Updated Jul 22, 2024
  • mtc-token-healing Public

    Token healing implementation in Rust

    ModelTC/mtc-token-healing’s past year of commit activity
    Rust 2 Apache-2.0 0 0 1 Updated Jul 22, 2024
  • L2_Compression Public
    ModelTC/L2_Compression’s past year of commit activity
    Python 11 Apache-2.0 0 1 0 Updated Jun 16, 2024
  • msbench Public

    A tool for model sparse based on torch.fx

    ModelTC/msbench’s past year of commit activity
    Python 5 Apache-2.0 1 0 0 Updated Jun 3, 2024
  • MQBench Public

    Model Quantization Benchmark

    ModelTC/MQBench’s past year of commit activity
    Shell 741 Apache-2.0 135 3 5 Updated Jun 3, 2024
  • FCPTS Public template
    ModelTC/FCPTS’s past year of commit activity
    Python 2 0 0 0 Updated May 14, 2024
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…