Skip to content
@InfiniTensor

InfiniTensor

Welcome

Hi, welcome to InfiniTensor!

The following repos are deep learning inference frameworks developed by our organization:

Readme Card

Readme Card

Readme Card

Any new ideas to share? Just crate a discussion to tell us!

Popular repositories Loading

  1. InfiniTensor InfiniTensor Public

    C++ 229 57

  2. InfiniLM InfiniLM Public

    Rust 102 29

  3. RefactorGraph RefactorGraph Public

    分层解耦的深度学习推理引擎

    C++ 72 14

  4. ninetoothed ninetoothed Public

    A domain-specific language (DSL) based on Triton but providing higher-level abstractions.

    Python 20 1

  5. operators operators Public

    Forked from YdrMaster/operators

    算子库

    C++ 15 21

  6. gguf gguf Public

    handle gguf files

    Rust 6 3

Repositories

Showing 10 of 37 repositories
  • InfiniTrain Public
    C++ 5 MIT 0 0 0 Updated Mar 25, 2025
  • gguf Public

    handle gguf files

    Rust 6 MIT 3 1 1 Updated Mar 25, 2025
  • ntops Public

    NineToothed operators for LLMs.

    0 Apache-2.0 0 0 0 Updated Mar 25, 2025
  • Python 0 Apache-2.0 0 0 0 Updated Mar 24, 2025
  • ninetoothed Public

    A domain-specific language (DSL) based on Triton but providing higher-level abstractions.

    Python 20 Apache-2.0 1 0 0 Updated Mar 21, 2025
  • PyTorchModels Public
    Python 0 0 0 1 Updated Mar 18, 2025
  • InfiniLM Public
    Rust 102 MIT 29 0 2 Updated Mar 17, 2025
  • tokeneer Public

    another tokenizer crate

    Rust 1 MIT 1 0 0 Updated Mar 17, 2025
  • InfiniBench Public

    A generic end-to-end model and operator testing and profiling framework

    Python 1 MIT 0 0 0 Updated Mar 8, 2025
  • mem-rearrange Public
    Rust 0 MIT 0 0 0 Updated Feb 24, 2025

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…