Use PEFT or Full-parameter to finetune 300+ LLMs or 60+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

Efficient Network Traffic Classification via Pre-training Unidirectional Mamba

This repository contains the python package for Helical

[RSS 2024] Learning Manipulation by Predicting Interaction

The official repo for [NeurIPS'23] "SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Model"

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Learning representations of smart contracts!

The official repo for the paper "HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model"

Code for KDD'20 "Generative Pre-Training of Graph Neural Networks"

Official implementation for "UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction" (KDD 2024)

[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen

[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)

Official Repository for The Paper, Adversarial-MidiBERT: Symbolic Music Understanding Model Based on Unbias Pre-training and Mask Fine-tuning

An Open-sourced Knowledgable Large Language Model Framework.

[CVPR 2024 Highlight] Visual Point Cloud Forecasting

Generative AI for Math: MathPile

The official repo for [JSTARS'24] "MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining"

Official code for arxiv paper LRM-Zero: Training Large Reconstruction Models with Synthesized Data