A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

SGLang is a fast serving framework for large language models and vision language models.

Qwen2.5-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

A lightweight data processing framework built on DuckDB and 3FS.

Apache Spark - A unified analytics engine for large-scale data processing

Apache Spark Website

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

RAPIDS Accelerator JNI For Apache Spark

A C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

Apache Parquet Java

Apache Iceberg

Open, Multi-modal Catalog for Data & AI

Apache Parquet

Apache Flink

uniVocity-parsers is a suite of extremely fast and reliable parsers for Java. It provides a consistent interface for handling different file formats, and a solid framework for the development of ne…

Read SparkSQL parquet file as RDD[Protobuf]