Awesome Python

Hand-picked awesome Python libraries and frameworks, organised by category 🐍

Interactive version: www.awesomepython.org

Updated 14 Apr 2024

Newly Created Repositories

Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here.

xai-org/grok-1 ⭐ 47,201
This repository contains JAX example code for loading and running the Grok-1 open-weights model.
karpathy/llm.c ⭐ 13,635
LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython
karpathy/minbpe ⭐ 7,869
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
skyvern-ai/skyvern ⭐ 3,280
Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows, replacing brittle or unreliable automation solutions.
🔗 www.skyvern.com
databricks/dbrx ⭐ 2,301
Code examples and resources for DBRX, a large language model developed by Databricks
🔗 www.databricks.com
amazon-science/chronos-forecasting ⭐ 1,503
Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
luijait/DarkGPT ⭐ 1,336
DarkGPT is an OSINT assistant based on GPT-4-200K (recommended use) designed to perform queries on leaked databases, thus providing an artificial intelligence assistant that can be useful in your traditional OSINT processes.
time-series-foundation-models/lag-llama ⭐ 913
Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
dagworks-inc/burr ⭐ 371
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
🔗 burr.dagworks.io
lightning-ai/litdata ⭐ 175
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

Code Quality

Code quality tooling: linters, formatters, pre-commit hooks, unused code removal.

psf/black ⭐ 37,325
The uncompromising Python code formatter
🔗 black.readthedocs.io/en/stable
astral-sh/ruff ⭐ 26,071
An extremely fast Python linter and code formatter, written in Rust.
🔗 docs.astral.sh/ruff
google/yapf ⭐ 13,637
A formatter for Python files
pre-commit/pre-commit ⭐ 11,967
A framework for managing and maintaining multi-language pre-commit hooks.
🔗 pre-commit.com
sqlfluff/sqlfluff ⭐ 7,186
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
🔗 www.sqlfluff.com
pycqa/isort ⭐ 6,305
A Python utility / library to sort imports.
🔗 pycqa.github.io/isort
davidhalter/jedi ⭐ 5,650
Awesome autocompletion, static analysis and refactoring library for python
🔗 jedi.readthedocs.io
pycqa/pylint ⭐ 5,096
It's not just a linter that annoys you!
🔗 pylint.readthedocs.io/en/latest
asottile/pyupgrade ⭐ 3,316
A tool (and pre-commit hook) to automatically upgrade syntax for newer versions of the language.
pycqa/flake8 ⭐ 3,248
flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
🔗 flake8.pycqa.org
jendrikseipp/vulture ⭐ 2,996
Find dead Python code
wemake-services/wemake-python-styleguide ⭐ 2,413
The strictest and most opinionated python linter ever!
🔗 wemake-python-styleguide.rtfd.io
python-lsp/python-lsp-server ⭐ 1,643
Fork of the python-language-server project, maintained by the Spyder IDE team and the community
sourcery-ai/sourcery ⭐ 1,475
Instant AI code reviews to speed up your pull requests
🔗 sourcery.ai
akaihola/darker ⭐ 608
Apply black reformatting to Python files only in regions changed since a given commit. For a practical usage example, see the blog post at https://dev.to/akaihola/improving-python-code-incrementally-3f7a
🔗 pypi.org/project/darker
tconbeer/sqlfmt ⭐ 340
sqlfmt formats your dbt SQL files so you don't have to
🔗 sqlfmt.com

Crypto and Blockchain

Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity.

ccxt/ccxt ⭐ 31,218
A JavaScript / TypeScript / Python / C# / PHP cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges
🔗 docs.ccxt.com
freqtrade/freqtrade ⭐ 25,353
Free, open source crypto trading bot
🔗 www.freqtrade.io
crytic/slither ⭐ 4,972
Static Analyzer for Solidity and Vyper
🔗 blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework
ethereum/web3.py ⭐ 4,768
A python interface for interacting with the Ethereum blockchain and ecosystem.
🔗 web3py.readthedocs.io
ethereum/consensus-specs ⭐ 3,401
Ethereum Proof-of-Stake Consensus Specifications
cyberpunkmetalhead/Binance-volatility-trading-bot ⭐ 3,343
This is a fully functioning Binance trading bot that measures the volatility of every coin on Binance and places trades with the highest gaining coins If you like this project consider donating though the Brave browser to allow me to continuously improve the script.
ethereum/py-evm ⭐ 2,180
A Python implementation of the Ethereum Virtual Machine
🔗 py-evm.readthedocs.io/en/latest
bmoscon/cryptofeed ⭐ 2,060
Cryptocurrency Exchange Websocket Data Feed Handler
binance/binance-public-data ⭐ 1,323
Details on how to get Binance public data
ofek/bit ⭐ 1,205
Bitcoin made easy.
🔗 ofek.dev/bit
man-c/pycoingecko ⭐ 1,032
Python wrapper for the CoinGecko API
palkeo/panoramix ⭐ 748
Ethereum decompiler
dylanhogg/awesome-crypto ⭐ 64
A list of awesome crypto and blockchain projects
🔗 www.awesomecrypto.xyz

Data

General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks.

scrapy/scrapy ⭐ 50,773
Scrapy, a fast high-level web crawling & scraping framework for Python.
🔗 scrapy.org
apache/spark ⭐ 38,244
Apache Spark - A unified analytics engine for large-scale data processing
🔗 spark.apache.org
getredash/redash ⭐ 24,885
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
🔗 redash.io
jaidedai/EasyOCR ⭐ 21,780
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
🔗 www.jaided.ai
mindsdb/mindsdb ⭐ 21,145
The platform for customizing AI from enterprise data
🔗 mindsdb.com
qdrant/qdrant ⭐ 17,686
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
🔗 qdrant.tech
joke2k/faker ⭐ 17,070
Faker is a Python package that generates fake data for you.
🔗 faker.readthedocs.io
humansignal/label-studio ⭐ 16,340
Label Studio is an open source data labeling tool. It lets you label data types like audio, text, images, videos, and time series with a simple and straightforward UI and export to various model formats.
🔗 labelstud.io
binux/pyspider ⭐ 16,297
A Powerful Spider(Web Crawler) System in Python.
🔗 docs.pyspider.org
twintproject/twint ⭐ 15,522
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
airbytehq/airbyte ⭐ 13,820
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
🔗 airbyte.com
apache/arrow ⭐ 13,441
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
🔗 arrow.apache.org
tiangolo/sqlmodel ⭐ 12,848
SQL databases in Python, designed for simplicity, compatibility, and robustness.
🔗 sqlmodel.tiangolo.com
redis/redis-py ⭐ 12,213
Redis Python client
chroma-core/chroma ⭐ 12,009
the AI-native open-source embedding database
🔗 www.trychroma.com
coleifer/peewee ⭐ 10,771
a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb
🔗 docs.peewee-orm.com
s0md3v/Photon ⭐ 10,473
Incredibly fast crawler designed for OSINT.
simonw/datasette ⭐ 8,863
An open source multi-tool for exploring and publishing data
🔗 datasette.io
sqlalchemy/sqlalchemy ⭐ 8,708
The Database Toolkit for Python
🔗 www.sqlalchemy.org
bigscience-workshop/petals ⭐ 8,620
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
🔗 petals.dev
avaiga/taipy ⭐ 8,226
Turns Data and AI algorithms into production-ready web applications in no time.
🔗 www.taipy.io
yzhao062/pyod ⭐ 7,922
A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
🔗 pyod.readthedocs.io
gristlabs/grist-core ⭐ 6,160
Grist is the evolution of spreadsheets.
🔗 www.getgrist.com
alirezamika/autoscraper ⭐ 5,913
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
kaggle/kaggle-api ⭐ 5,886
Official Kaggle API
vi3k6i5/flashtext ⭐ 5,528
Extract Keywords from sentence or Replace keywords in sentences.
madmaze/pytesseract ⭐ 5,482
A Python wrapper for Google Tesseract
airbnb/knowledge-repo ⭐ 5,429
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
tobymao/sqlglot ⭐ 5,384
Python SQL Parser and Transpiler
🔗 sqlglot.com
facebookresearch/AugLy ⭐ 4,898
A data augmentations library for audio, image, text, and video.
🔗 ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models
jazzband/tablib ⭐ 4,517
Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c.
🔗 tablib.readthedocs.io
superduperdb/superduperdb ⭐ 4,304
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
🔗 superduperdb.com
lk-geimfari/mimesis ⭐ 4,296
Mimesis is a powerful Python library that empowers developers to generate massive amounts of synthetic data efficiently.
🔗 mimesis.name
amundsen-io/amundsen ⭐ 4,266
Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
🔗 www.amundsen.io/amundsen
mongodb/mongo-python-driver ⭐ 4,041
PyMongo - the Official MongoDB Python driver
🔗 pymongo.readthedocs.io
ibis-project/ibis ⭐ 4,040
Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It helps Python users explore and transform data of any size, stored anywhere.
🔗 ibis-project.org
andialbrecht/sqlparse ⭐ 3,572
A non-validating SQL parser module for Python
jmcnamara/XlsxWriter ⭐ 3,481
A Python module for creating Excel XLSX files.
🔗 xlsxwriter.readthedocs.io
run-llama/llama-hub ⭐ 3,386
A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
🔗 llamahub.ai
deepchecks/deepchecks ⭐ 3,325
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
🔗 docs.deepchecks.com/stable
praw-dev/praw ⭐ 3,307
PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
🔗 praw.readthedocs.io
rom1504/img2dataset ⭐ 3,210
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
pyeve/cerberus ⭐ 3,103
Lightweight, extensible data validation library for Python
🔗 python-cerberus.org
giskard-ai/giskard ⭐ 3,001
🐢 Open-Source Evaluation & Testing framework for LLMs and ML models
🔗 docs.giskard.ai
zoomeranalytics/xlwings ⭐ 2,831
xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows and macOS as well as with Google Sheets and Excel on the web.
🔗 www.xlwings.org
datafold/data-diff ⭐ 2,826
Compare tables within or across databases
🔗 docs.datafold.com
pallets/itsdangerous ⭐ 2,819
Safely pass trusted data to untrusted environments and back.
🔗 itsdangerous.palletsprojects.com
goldsmith/Wikipedia ⭐ 2,808
A Pythonic wrapper for the Wikipedia API
🔗 wikipedia.readthedocs.org
docarray/docarray ⭐ 2,723
Represent, send, store and search multimodal data
🔗 docs.docarray.org
awslabs/amazon-redshift-utils ⭐ 2,706
Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment
lancedb/lancedb ⭐ 2,691
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
🔗 lancedb.github.io/lancedb
sqlalchemy/alembic ⭐ 2,441
A database migrations tool for SQLAlchemy.
pynamodb/PynamoDB ⭐ 2,371
A pythonic interface to Amazon's DynamoDB
🔗 pynamodb.readthedocs.io
kayak/pypika ⭐ 2,362
PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
🔗 pypika.readthedocs.io/en/latest
emirozer/fake2db ⭐ 2,254
Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, couchdb.
uqfoundation/dill ⭐ 2,128
serialize all of Python
🔗 dill.rtfd.io
sdv-dev/SDV ⭐ 2,105
Synthetic data generation for tabular data
🔗 docs.sdv.dev/sdv
accenture/AmpliGraph ⭐ 2,079
Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org
graphistry/pygraphistry ⭐ 2,045
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
rapidai/RapidOCR ⭐ 1,919
Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle.
🔗 rapidai.github.io/rapidocrdocs/docs
samuelcolvin/arq ⭐ 1,901
Fast job queuing and RPC in python with asyncio and redis.
🔗 arq-docs.helpmanual.io
sfu-db/connector-x ⭐ 1,757
Fastest library to load data from DB to DataFrames in Rust and Python
🔗 sfu-db.github.io/connector-x/intro.html
uber/petastorm ⭐ 1,744
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
agronholm/sqlacodegen ⭐ 1,698
Automatic model code generator for SQLAlchemy
aio-libs/aiomysql ⭐ 1,696
aiomysql is a library for accessing a MySQL database from the asyncio
🔗 aiomysql.rtfd.io
pathwaycom/pathway ⭐ 1,689
Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.
🔗 pathway.com
dlt-hub/dlt ⭐ 1,675
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
🔗 dlthub.com/docs
milvus-io/bootcamp ⭐ 1,602
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
🔗 milvus.io
simple-salesforce/simple-salesforce ⭐ 1,591
A very simple Salesforce.com REST API client for Python
collerek/ormar ⭐ 1,565
python async orm with fastapi in mind and pydantic validation
🔗 collerek.github.io/ormar
aminalaee/sqladmin ⭐ 1,558
SQLAlchemy Admin for FastAPI and Starlette
🔗 aminalaee.dev/sqladmin
simonw/sqlite-utils ⭐ 1,486
Python CLI utility and library for manipulating SQLite databases
🔗 sqlite-utils.datasette.io
sdispater/orator ⭐ 1,422
The Orator ORM provides a simple yet beautiful ActiveRecord implementation.
🔗 orator-orm.com
mchong6/JoJoGAN ⭐ 1,403
Official PyTorch repo for JoJoGAN: One Shot Face Stylization
eleutherai/the-pile ⭐ 1,396
The Pile is a large, diverse, open source language modelling data set that consists of many smaller datasets combined together.
aio-libs/aiopg ⭐ 1,372
aiopg is a library for accessing a PostgreSQL database from the asyncio
🔗 aiopg.readthedocs.io
zarr-developers/zarr-python ⭐ 1,326
An implementation of chunked, compressed, N-dimensional arrays for Python.
🔗 zarr.readthedocs.io
google/tensorstore ⭐ 1,279
Library for reading and writing large multi-dimensional arrays.
🔗 google.github.io/tensorstore
ydataai/ydata-synthetic ⭐ 1,277
Synthetic data generators for tabular and time-series data
🔗 docs.synthetic.ydata.ai
huggingface/datatrove ⭐ 1,118
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
pytorch/data ⭐ 1,067
A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
eliasdabbas/advertools ⭐ 1,044
advertools - online marketing productivity and analysis tools
🔗 advertools.readthedocs.io
uber/fiber ⭐ 1,037
Distributed Computing for AI Made Simple
🔗 uber.github.io/fiber
brettkromkamp/contextualise ⭐ 1,034
Contextualise is an effective tool particularly suited for organising information-heavy projects and activities consisting of unstructured and widely diverse data and information resources
🔗 contextualise.dev
aio-libs/aiocache ⭐ 1,021
Asyncio cache manager for redis, memcached and memory
🔗 aiocache.readthedocs.io
intake/intake ⭐ 977
Intake is a lightweight package for finding, investigating, loading and disseminating data.
🔗 intake.readthedocs.io
scikit-hep/awkward ⭐ 792
Manipulate JSON-like data with NumPy-like idioms.
🔗 awkward-array.org
koaning/human-learn ⭐ 772
Natural Intelligence is still a pretty good idea.
🔗 koaning.github.io/human-learn
macbre/sql-metadata ⭐ 725
Uses tokenized query returned by python-sqlparse and generates query metadata
🔗 pypi.python.org/pypi/sql-metadata
hyperqueryhq/whale ⭐ 724
🐳 The stupidly simple CLI workspace for your data warehouse.
🔗 rsyi.gitbook.io/whale
duckdb/dbt-duckdb ⭐ 713
dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)
googleapis/python-bigquery ⭐ 706
Python Client for Google BigQuery
goccy/bigquery-emulator ⭐ 697
BigQuery emulator provides a way to launch a BigQuery server on your local machine for testing and development.
mcfunley/pugsql ⭐ 661
A HugSQL-inspired database library for Python
🔗 pugsql.org
dgarnitz/vectorflow ⭐ 634
VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
🔗 www.getvectorflow.com
kagisearch/vectordb ⭐ 534
A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.
🔗 vectordb.com
koaning/bulk ⭐ 440
Bulk is a quick UI developer tool to apply some bulk labels.

Debugging

Debugging and tracing tools.

cool-rr/PySnooper ⭐ 16,249
Never use print for debugging again
gruns/icecream ⭐ 8,405
🍦 Never use print() to debug again.
shobrook/rebound ⭐ 4,071
Command-line tool that instantly fetches Stack Overflow results when an exception is thrown
inducer/pudb ⭐ 2,860
Full-screen console debugger for Python
🔗 documen.tician.de/pudb
gotcha/ipdb ⭐ 1,809
Integration of IPython pdb
alexmojaki/heartrate ⭐ 1,727
Simple real time visualisation of the execution of a Python program.
alexmojaki/birdseye ⭐ 1,629
Graphical Python debugger which lets you easily view the values of all evaluated expressions
🔗 birdseye.readthedocs.io
alexmojaki/snoop ⭐ 1,194
A powerful set of Python debugging tools, based on PySnooper
samuelcolvin/python-devtools ⭐ 930
Dev tools for python
🔗 python-devtools.helpmanual.io

Diffusion Text to Image

Text-to-image diffusion model libraries, tools and apps for generating images from natural language.

automatic1111/stable-diffusion-webui ⭐ 128,387
Stable Diffusion web UI
compvis/stable-diffusion ⭐ 65,113
A latent text-to-image diffusion model
🔗 ommer-lab.com/research/latent-diffusion-models
stability-ai/stablediffusion ⭐ 35,979
High-Resolution Image Synthesis with Latent Diffusion Models
comfyanonymous/ComfyUI ⭐ 31,762
The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
lllyasviel/ControlNet ⭐ 27,633
Let us control diffusion models!
huggingface/diffusers ⭐ 22,298
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
🔗 huggingface.co/docs/diffusers
invoke-ai/InvokeAI ⭐ 21,171
InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multi...
🔗 invoke-ai.github.io/invokeai
apple/ml-stable-diffusion ⭐ 16,055
Stable Diffusion with Core ML on Apple Silicon
borisdayma/dalle-mini ⭐ 14,623
DALL·E Mini - Generate images from a text prompt
🔗 www.craiyon.com
divamgupta/diffusionbee-stable-diffusion-ui ⭐ 11,879
Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
🔗 diffusionbee.com
lucidrains/DALLE2-pytorch ⭐ 10,795
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
compvis/latent-diffusion ⭐ 10,457
High-Resolution Image Synthesis with Latent Diffusion Models
instantid/InstantID ⭐ 9,597
InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥
🔗 instantid.github.io
ashawkey/stable-dreamfusion ⭐ 7,773
Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.
facebookresearch/dinov2 ⭐ 7,735
PyTorch code and models for the DINOv2 self-supervised learning method.
carson-katri/dream-textures ⭐ 7,570
Stable Diffusion built-in to Blender
xavierxiao/Dreambooth-Stable-Diffusion ⭐ 7,433
Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion
timothybrooks/instruct-pix2pix ⭐ 5,917
PyTorch implementation of InstructPix2Pix, an instruction-based image editing model, based on the original CompVis/stable_diffusion repo.
openai/consistency_models ⭐ 5,909
Official repo for consistency models.
idea-research/GroundingDINO ⭐ 4,842
Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
🔗 arxiv.org/abs/2303.05499
salesforce/BLIP ⭐ 4,220
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
nateraw/stable-diffusion-videos ⭐ 4,194
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
jina-ai/discoart ⭐ 3,839
🪩 Create Disco Diffusion artworks in one line
lkwq007/stablediffusion-infinity ⭐ 3,797
Outpainting with Stable Diffusion on an infinite canvas
openai/glide-text2im ⭐ 3,455
GLIDE: a diffusion-based text-conditional image synthesis model
mlc-ai/web-stable-diffusion ⭐ 3,415
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
🔗 mlc.ai/web-stable-diffusion
openai/improved-diffusion ⭐ 2,767
Release for Improved Denoising Diffusion Probabilistic Models
saharmor/dalle-playground ⭐ 2,763
A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
stability-ai/stability-sdk ⭐ 2,397
SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)
🔗 platform.stability.ai
divamgupta/stable-diffusion-tensorflow ⭐ 1,567
Stable Diffusion in TensorFlow / Keras
coyote-a/ultimate-upscale-for-automatic1111 ⭐ 1,471
Ultimate SD Upscale extension for AUTOMATIC1111 Stable Diffusion web UI
nvlabs/prismer ⭐ 1,284
The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
🔗 shikun.io/projects/prismer
chenyangqiqi/FateZero ⭐ 1,036
[ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"
🔗 fate-zero-edit.github.io
thereforegames/unprompted ⭐ 735
Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.
sharonzhou/long_stable_diffusion ⭐ 672
Long-form text-to-images generation, using a pipeline of deep generative models (GPT-3 and Stable Diffusion)
tanelp/tiny-diffusion ⭐ 526
A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.

Finance

Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives.

openbb-finance/OpenBBTerminal ⭐ 25,968
Investment Research for Everyone, Everywhere.
🔗 openbb.co
quantopian/zipline ⭐ 17,032
Zipline, a Pythonic Algorithmic Trading Library
🔗 www.zipline.io
microsoft/qlib ⭐ 14,096
Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, ...
🔗 qlib.readthedocs.io/en/latest
mementum/backtrader ⭐ 12,921
Python Backtesting library for trading strategies
🔗 www.backtrader.com
ranaroussi/yfinance ⭐ 11,723
Download market data from Yahoo! Finance's API
🔗 aroussi.com/post/python-yahoo-finance
ai4finance-foundation/FinGPT ⭐ 11,320
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
🔗 ai4finance.org
ai4finance-foundation/FinRL ⭐ 8,991
FinRL: Financial Reinforcement Learning. 🔥
🔗 ai4finance.org
ta-lib/ta-lib-python ⭐ 8,957
Python wrapper for TA-Lib (http://ta-lib.org/).
🔗 ta-lib.github.io/ta-lib-python
quantconnect/Lean ⭐ 8,635
Lean Algorithmic Trading Engine by QuantConnect (Python, C#)
🔗 lean.io
quantopian/pyfolio ⭐ 5,412
Portfolio and risk analytics in Python
🔗 quantopian.github.io/pyfolio
kernc/backtesting.py ⭐ 4,787
🔎 📈 🐍 💰 Backtest trading strategies in Python.
🔗 kernc.github.io/backtesting.py
twopirllc/pandas-ta ⭐ 4,699
Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 150+ Indicators
🔗 twopirllc.github.io/pandas-ta
gbeced/pyalgotrade ⭐ 4,286
Python Algorithmic Trading Library
🔗 gbeced.github.io/pyalgotrade
google/tf-quant-finance ⭐ 4,258
High-performance TensorFlow library for quantitative finance.
ranaroussi/quantstats ⭐ 4,218
Portfolio analytics for quants, written in Python
borisbanushev/stockpredictionai ⭐ 3,926
In this noteboook I will create a complete process for predicting stock price movements. Follow along and we will achieve some pretty good results. For that purpose we will use a Generative Adversarial Network (GAN) with LSTM, a type of Recurrent Neural Network, as generator, and a Convolutional Neural Networ...
polakowo/vectorbt ⭐ 3,692
Find your trading edge, using the fastest engine for backtesting, algorithmic trading, and research.
🔗 vectorbt.dev
cuemacro/finmarketpy ⭐ 3,344
Python library for backtesting trading strategies & analyzing financial markets (formerly pythalesians)
🔗 www.cuemacro.com
matplotlib/mplfinance ⭐ 3,333
Financial Markets Data Visualization using Matplotlib
🔗 pypi.org/project/mplfinance
quantopian/alphalens ⭐ 3,067
Performance analysis of predictive (alpha) stock factors
🔗 quantopian.github.io/alphalens
zvtvz/zvt ⭐ 2,972
modular quant framework.
🔗 zvt.readthedocs.io/en/latest
goldmansachs/gs-quant ⭐ 2,443
Python toolkit for quantitative finance
🔗 developer.gs.com/discover/products/gs-quant
robcarver17/pysystemtrade ⭐ 2,369
Systematic Trading in python
quantopian/research_public ⭐ 2,302
Quantitative research and educational materials
🔗 www.quantopian.com/lectures
pmorissette/bt ⭐ 2,006
bt - flexible backtesting for Python
🔗 pmorissette.github.io/bt
blankly-finance/blankly ⭐ 1,963
🚀 💸 Easily build, backtest and deploy your algo in just a few lines of code. Trade stocks, cryptos, and forex across exchanges w/ one package.
🔗 package.blankly.finance
domokane/FinancePy ⭐ 1,888
A Python Finance Library that focuses on the pricing and risk-management of Financial Derivatives, including fixed-income, equity, FX and credit derivatives.
🔗 financepy.com
pmorissette/ffn ⭐ 1,770
ffn - a financial function library for Python
🔗 pmorissette.github.io/ffn
cuemacro/findatapy ⭐ 1,559
Python library to download market data via Bloomberg, Eikon, Quandl, Yahoo etc.
quantopian/empyrical ⭐ 1,214
Common financial risk and performance metrics. Used by zipline and pyfolio.
🔗 quantopian.github.io/empyrical
idanya/algo-trader ⭐ 737
Trading bot with support for realtime trading, backtesting, custom strategies and much more.

Game Development

Game development tools, engines and libraries.

kitao/pyxel ⭐ 13,116
A retro game engine for Python
pygame/pygame ⭐ 6,923
🐍🎮 pygame (the library) is a Free and Open Source python programming language library for making multimedia applications like games built on top of the excellent SDL library. C, Python, Native, OpenGL.
🔗 www.pygame.org
panda3d/panda3d ⭐ 4,254
Powerful, mature open-source cross-platform game engine for Python and C++, developed by Disney and CMU
🔗 www.panda3d.org
pokepetter/ursina ⭐ 2,081
A game engine powered by python and panda3d.
🔗 pokepetter.github.io/ursina
pyglet/pyglet ⭐ 1,738
pyglet is a cross-platform windowing and multimedia library for Python, for developing games and other visually rich applications.
🔗 pyglet.org
pythonarcade/arcade ⭐ 1,604
Easy to use Python library for creating 2D arcade games.
🔗 arcade.academy

GIS

Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections.

domlysz/BlenderGIS ⭐ 7,196
Blender addons to make the bridge between Blender and geographic data
python-visualization/folium ⭐ 6,652
Python Data. Leaflet.js Maps.
🔗 python-visualization.github.io/folium
gboeing/osmnx ⭐ 4,649
OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap.
🔗 osmnx.readthedocs.io
osgeo/gdal ⭐ 4,462
GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
🔗 gdal.org
geopandas/geopandas ⭐ 4,160
Python tools for geographic data
🔗 geopandas.org
shapely/shapely ⭐ 3,652
Manipulation and analysis of geometric objects
🔗 shapely.readthedocs.io/en/stable
holoviz/datashader ⭐ 3,199
Quickly and accurately render even the largest data.
🔗 datashader.org
giswqs/geemap ⭐ 3,166
A Python package for interactive geospatial analysis and visualization with Google Earth Engine.
🔗 geemap.org
opengeos/leafmap ⭐ 2,892
A Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment
🔗 leafmap.org
opengeos/segment-geospatial ⭐ 2,644
A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
🔗 samgeo.gishub.org
google/earthengine-api ⭐ 2,520
Python and JavaScript bindings for calling the Earth Engine API.
microsoft/torchgeo ⭐ 2,208
TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
🔗 www.osgeo.org/projects/torchgeo
rasterio/rasterio ⭐ 2,135
Rasterio reads and writes geospatial raster datasets
🔗 rasterio.readthedocs.io
mcordts/cityscapesScripts ⭐ 2,087
README and scripts for the Cityscapes Dataset
azavea/raster-vision ⭐ 1,987
An open source library and framework for deep learning on satellite and aerial imagery.
🔗 docs.rastervision.io
plant99/felicette ⭐ 1,816
Satellite imagery for dummies.
apache/sedona ⭐ 1,766
A cluster computing framework for processing large-scale geospatial data
🔗 sedona.apache.org
jupyter-widgets/ipyleaflet ⭐ 1,450
A Jupyter - Leaflet.js bridge
🔗 ipyleaflet.readthedocs.io
gboeing/osmnx-examples ⭐ 1,450
Gallery of OSMnx tutorials, usage examples, and feature demonstations.
🔗 osmnx.readthedocs.io
pysal/pysal ⭐ 1,273
PySAL: Python Spatial Analysis Library Meta-Package
🔗 pysal.org/pysal
microsoft/GlobalMLBuildingFootprints ⭐ 1,264
Worldwide building footprints derived from satellite imagery
anitagraser/movingpandas ⭐ 1,135
Movement trajectory classes and functions built on top of GeoPandas
🔗 movingpandas.org
residentmario/geoplot ⭐ 1,115
High-level geospatial data visualization library for Python.
🔗 residentmario.github.io/geoplot/index.html
sentinel-hub/eo-learn ⭐ 1,075
Earth observation processing framework for machine learning in Python
🔗 eo-learn.readthedocs.io/en/latest
makepath/xarray-spatial ⭐ 770
Raster-based Spatial Analytics for Python
🔗 xarray-spatial.org
osgeo/grass ⭐ 762
GRASS GIS - free and open-source geospatial processing engine
🔗 grass.osgeo.org
scikit-mobility/scikit-mobility ⭐ 690
scikit-mobility: mobility analysis in Python
🔗 scikit-mobility.github.io/scikit-mobility
developmentseed/titiler ⭐ 683
Build your own Raster dynamic map tile services
🔗 developmentseed.org/titiler

Graph

Graphs and network libraries: network analysis, graph machine learning, visualisation.

networkx/networkx ⭐ 14,127
Network Analysis in Python
🔗 networkx.org
stellargraph/stellargraph ⭐ 2,885
StellarGraph - Machine Learning on Graphs
🔗 stellargraph.readthedocs.io
westhealth/pyvis ⭐ 908
Python package for creating and visualizing interactive network graphs.
🔗 pyvis.readthedocs.io/en/latest
rampasek/GraphGPS ⭐ 584
Recipe for a General, Powerful, Scalable Graph Transformer
microsoft/graspologic ⭐ 494
graspologic is a package for graph statistical algorithms
🔗 microsoft.github.io/graspologic/latest
dylanhogg/llmgraph ⭐ 80
Create knowledge graphs with LLMs

GUI

Graphical user interface libraries and toolkits.

pysimplegui/PySimpleGUI ⭐ 13,088
Python GUIs for Humans! PySimpleGUI is the top-rated Python application development environment. Launched in 2018 and actively developed, maintained, and supported in 2024. Transforms tkinter, Qt, WxPython, and Remi into a simple, intuitive, and fun experience for both hobbyists and expert users.
🔗 www.pysimplegui.com
hoffstadt/DearPyGui ⭐ 12,187
Dear PyGui: A fast and powerful Graphical User Interface Toolkit for Python with minimal dependencies
🔗 dearpygui.readthedocs.io/en/latest
parthjadhav/Tkinter-Designer ⭐ 8,225
An easy and fast way to create a Python GUI 🐍
samuelcolvin/FastUI ⭐ 7,163
FastUI is a new way to build web application user interfaces defined by declarative Python code.
🔗 fastui-demo.onrender.com
r0x0r/pywebview ⭐ 4,286
Build GUI for your Python program with JavaScript, HTML, and CSS
🔗 pywebview.flowrl.com
beeware/toga ⭐ 4,088
A Python native, OS native GUI toolkit.
🔗 toga.readthedocs.io/en/latest
dddomodossola/remi ⭐ 3,448
Python REMote Interface library. Platform independent. In about 100 Kbytes, perfect for your diet.
wxwidgets/Phoenix ⭐ 2,176
wxPython's Project Phoenix. A new implementation of wxPython, better, stronger, faster than he was before.
🔗 wxpython.org

Jupyter

Jupyter and JupyterLab and Notebook tools, libraries and plugins.

jupyterlab/jupyterlab ⭐ 13,746
JupyterLab computational environment.
🔗 jupyterlab.readthedocs.io
jupyter/notebook ⭐ 11,126
Jupyter Interactive Notebook
🔗 jupyter-notebook.readthedocs.io
mwouts/jupytext ⭐ 6,403
Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
🔗 jupytext.readthedocs.io
nteract/papermill ⭐ 5,615
📚 Parameterize, execute, and analyze notebooks
🔗 papermill.readthedocs.io/en/latest
connorferster/handcalcs ⭐ 5,349
Python library for converting Python calculations into rendered latex.
voila-dashboards/voila ⭐ 5,192
Voilà turns Jupyter notebooks into standalone web applications
🔗 voila.readthedocs.io
executablebooks/jupyter-book ⭐ 3,678
Create beautiful, publication-quality books and documents from computational content.
🔗 jupyterbook.org
jupyterlite/jupyterlite ⭐ 3,644
Wasm powered Jupyter running in the browser 💡
🔗 jupyterlite.rtfd.io/en/stable/try/lab
jupyterlab/jupyterlab-desktop ⭐ 3,341
JupyterLab desktop application, based on Electron.
jupyter-widgets/ipywidgets ⭐ 3,042
Interactive Widgets for the Jupyter Notebook
🔗 ipywidgets.readthedocs.io
quantopian/qgrid ⭐ 3,027
An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks
jupyterlab/jupyter-ai ⭐ 2,821
A generative AI extension for JupyterLab
🔗 jupyter-ai.readthedocs.io
jupyter/nbdime ⭐ 2,593
Tools for diffing and merging of Jupyter notebooks.
🔗 nbdime.readthedocs.io
mito-ds/mito ⭐ 2,205
The mitosheet package, trymito.io, and other public Mito code.
🔗 trymito.io
jupyter/nbviewer ⭐ 2,162
nbconvert as a web service: Render Jupyter Notebooks as static web pages
🔗 nbviewer.jupyter.org
maartenbreddels/ipyvolume ⭐ 1,907
3d plotting for Python in the Jupyter notebook based on IPython widgets using WebGL
jupyter-lsp/jupyterlab-lsp ⭐ 1,723
Coding assistance for JupyterLab (code navigation + hover suggestions + linters + autocompletion + rename) using Language Server Protocol
jupyter/nbconvert ⭐ 1,660
Jupyter Notebook Conversion
🔗 nbconvert.readthedocs.io
jupyter/nbgrader ⭐ 1,256
A system for assigning and grading notebooks
🔗 nbgrader.readthedocs.io
nbqa-dev/nbQA ⭐ 959
Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks
🔗 nbqa.readthedocs.io/en/latest/index.html
vizzuhq/ipyvizzu ⭐ 922
Build animated charts in Jupyter Notebook and similar environments with a simple Python syntax.
🔗 ipyvizzu.vizzuhq.com
koaning/drawdata ⭐ 703
Draw datasets from within Jupyter.
🔗 calmcode.io/labs/drawdata.html
aws/graph-notebook ⭐ 679
Library extending Jupyter notebooks to integrate with Apache TinkerPop, openCypher, and RDF SPARQL.
🔗 github.com/aws/graph-notebook
linealabs/lineapy ⭐ 652
Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
🔗 lineapy.org

LLMs and ChatGPT

Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover.

significant-gravitas/AutoGPT ⭐ 160,768
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
🔗 agpt.co
hwchase17/langchain ⭐ 81,978
🦜🔗 Build context-aware reasoning applications
🔗 python.langchain.com
nomic-ai/gpt4all ⭐ 63,527
gpt4all: run open-source LLMs anywhere
🔗 gpt4all.io
xtekky/gpt4free ⭐ 56,750
The official gpt4free repository | various collection of powerful language models
🔗 g4f.ai
ggerganov/llama.cpp ⭐ 55,086
LLM inference in C/C++
facebookresearch/llama ⭐ 52,234
Inference code for Llama models
imartinez/private-gpt ⭐ 51,363
Interact with your documents using the power of GPT, 100% privately, no data leaks
🔗 docs.privategpt.dev
gpt-engineer-org/gpt-engineer ⭐ 50,301
Specify what you want it to build, the AI asks for clarification, and then builds it.
xai-org/grok-1 ⭐ 47,201
This repository contains JAX example code for loading and running the Grok-1 open-weights model.
killianlucas/open-interpreter ⭐ 47,133
A natural language interface for computers
🔗 openinterpreter.com
thudm/ChatGLM-6B ⭐ 39,042
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
geekan/MetaGPT ⭐ 38,717
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
🔗 deepwisdom.ai
hpcaitech/ColossalAI ⭐ 37,746
Making large AI models cheaper, faster and more accessible
🔗 www.colossalai.org
laion-ai/Open-Assistant ⭐ 36,591
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
🔗 open-assistant.io
oobabooga/text-generation-webui ⭐ 35,572
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
moymix/TaskMatrix ⭐ 34,508
Connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting.
lm-sys/FastChat ⭐ 33,470
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
quivrhq/quivr ⭐ 31,742
Your GenAI Second Brain 🧠 A personal productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented...
🔗 quivr.app
karpathy/nanoGPT ⭐ 31,295
The simplest, fastest repository for training/finetuning medium-sized GPTs.
jerryjliu/llama_index ⭐ 30,544
LlamaIndex is a data framework for your LLM applications
🔗 docs.llamaindex.ai
tatsu-lab/stanford_alpaca ⭐ 28,705
Code and documentation to train Stanford's Alpaca models, and generate the data.
🔗 crfm.stanford.edu/2023/03/13/alpaca.html
pythagora-io/gpt-pilot ⭐ 27,666
The first real AI developer
vision-cair/MiniGPT-4 ⭐ 24,819
Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
🔗 minigpt-4.github.io
microsoft/autogen ⭐ 24,414
A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
🔗 microsoft.github.io/autogen
microsoft/JARVIS ⭐ 22,960
JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
openai/gpt-2 ⭐ 21,044
Code for the paper "Language Models are Unsupervised Multitask Learners"
🔗 openai.com/blog/better-language-models
openai/chatgpt-retrieval-plugin ⭐ 20,813
The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
yoheinakajima/babyagi ⭐ 19,078
GPT-4 powered task-driven autonomous agent
karpathy/minGPT ⭐ 18,673
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
tloen/alpaca-lora ⭐ 18,135
Instruct-tune LLaMA on consumer hardware
microsoft/semantic-kernel ⭐ 17,952
Integrate cutting-edge LLM technology quickly and easily into your apps
🔗 aka.ms/semantic-kernel
rasahq/rasa ⭐ 17,892
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
🔗 rasa.com/docs/rasa
vllm-project/vllm ⭐ 17,597
A high-throughput and memory-efficient inference and serving engine for LLMs
🔗 docs.vllm.ai
guidance-ai/guidance ⭐ 17,114
A guidance language for controlling large language models.
mlc-ai/mlc-llm ⭐ 16,612
Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
🔗 llm.mlc.ai/docs
logspace-ai/langflow ⭐ 16,540
⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.
🔗 www.langflow.org
hiyouga/LLaMA-Factory ⭐ 16,202
Unify Efficient Fine-Tuning of 100+ LLMs
hiyouga/LLaMA-Factory ⭐ 16,202
Unify Efficient Fine-Tuning of 100+ LLMs
haotian-liu/LLaVA ⭐ 15,768
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
🔗 llava.hliu.cc
thudm/ChatGLM2-6B ⭐ 15,433
ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
karpathy/llama2.c ⭐ 15,391
Inference Llama 2 in one file of pure C
mayooear/gpt4-pdf-chatbot-langchain ⭐ 14,488
GPT4 & LangChain Chatbot for large PDF docs
🔗 www.youtube.com/watch?v=ih9pbgvvoo4
transformeroptimus/SuperAGI ⭐ 14,347
<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
🔗 superagi.com
facebookresearch/codellama ⭐ 14,248
Inference code for CodeLlama models
fauxpilot/fauxpilot ⭐ 14,209
FauxPilot - an open-source alternative to GitHub Copilot server
openai/evals ⭐ 13,765
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
karpathy/llm.c ⭐ 13,635
LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython
huggingface/peft ⭐ 13,577
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
🔗 huggingface.co/docs/peft
deepset-ai/haystack ⭐ 13,503
🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conv...
🔗 haystack.deepset.ai
idea-research/Grounded-Segment-Anything ⭐ 13,316
Grounded-SAM: Marrying Grounding-DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
🔗 arxiv.org/abs/2401.14159
openlmlab/MOSS ⭐ 11,804
An open-source tool-augmented conversational language model from Fudan University
🔗 txsun1997.github.io/blogs/moss.html
joaomdmoura/crewAI ⭐ 11,727
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
🔗 crewai.com
smol-ai/developer ⭐ 11,628
the first library to let you embed a developer agent in your own app!
🔗 twitter.com/smolmodels
blinkdl/RWKV-LM ⭐ 11,539
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
paddlepaddle/PaddleNLP ⭐ 11,337
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
🔗 paddlenlp.readthedocs.io
databrickslabs/dolly ⭐ 10,779
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
🔗 www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html
dao-ailab/flash-attention ⭐ 10,565
Fast and memory-efficient exact attention
h2oai/h2ogpt ⭐ 10,295
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
🔗 h2o.ai
shishirpatil/gorilla ⭐ 9,849
Enables LLMs to use tools by invoking APIs. Given a query, Gorilla comes up with the semantically and syntactically correct API.
🔗 gorilla.cs.berkeley.edu
stanfordnlp/dspy ⭐ 9,847
DSPy: The framework for programming—not prompting—foundation models
🔗 dspy-docs.vercel.app
danielmiessler/fabric ⭐ 9,530
fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
🔗 danielmiessler.com/p/fabric-origin-story
artidoro/qlora ⭐ 9,318
QLoRA: Efficient Finetuning of Quantized LLMs
🔗 arxiv.org/abs/2305.14314
blinkdl/ChatRWKV ⭐ 9,262
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
mlc-ai/web-llm ⭐ 8,969
Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.
🔗 mlc.ai/web-llm
microsoft/LoRA ⭐ 8,892
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
🔗 arxiv.org/abs/2106.09685
mistralai/mistral-src ⭐ 8,547
Reference implementation of Mistral AI 7B v0.1 model.
🔗 mistral.ai
nvidia/Megatron-LM ⭐ 8,416
Ongoing research training transformer models at scale
🔗 docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start
embedchain/embedchain ⭐ 8,387
Personalizing LLM Responses
🔗 docs.embedchain.ai
assafelovic/gpt-researcher ⭐ 8,239
GPT based autonomous agent that does online comprehensive research on any given topic
🔗 gptr.dev
facebookresearch/llama-recipes ⭐ 8,197
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcas...
eleutherai/gpt-neo ⭐ 8,136
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
🔗 www.eleuther.ai
mshumer/gpt-prompt-engineer ⭐ 7,975
Simply input a description of your task and some test cases, and the system will generate, test, and rank a multitude of prompts to find the ones that perform the best.
optimalscale/LMFlow ⭐ 7,948
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
🔗 optimalscale.github.io/lmflow
microsoft/promptflow ⭐ 7,947
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
🔗 microsoft.github.io/promptflow
lvwerra/trl ⭐ 7,914
Train transformer language models with reinforcement learning.
🔗 hf.co/docs/trl
karpathy/minbpe ⭐ 7,869
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
berriai/litellm ⭐ 7,800
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
🔗 docs.litellm.ai/docs
thudm/CodeGeeX ⭐ 7,734
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
🔗 codegeex.cn
apple/ml-ferret ⭐ 7,690
Ferret: Refer and Ground Anything Anywhere at Any Granularity
huggingface/text-generation-inference ⭐ 7,689
Large Language Model Text Generation Inference
🔗 hf.co/docs/text-generation-inference
thudm/GLM-130B ⭐ 7,599
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
lianjiatech/BELLE ⭐ 7,486
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
openlm-research/open_llama ⭐ 7,175
OpenLLaMA: An Open Reproduction of LLaMA
plachtaa/VALL-E-X ⭐ 7,107
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io
bigcode-project/starcoder ⭐ 7,085
Home of StarCoder: fine-tuning & inference!
sweepai/sweep ⭐ 7,010
Sweep: AI-powered Junior Developer for small features and bug fixes.
🔗 sweep.dev
sjtu-ipads/PowerInfer ⭐ 6,889
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
jzhang38/TinyLlama ⭐ 6,674
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
bhaskatripathi/pdfGPT ⭐ 6,667
PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
🔗 huggingface.co/spaces/bhaskartripathi/pdfgpt_turbo
eleutherai/gpt-neox ⭐ 6,534
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
zilliztech/GPTCache ⭐ 6,367
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
🔗 gptcache.readthedocs.io
vanna-ai/vanna ⭐ 6,267
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
🔗 vanna.ai/docs
vaibhavs10/insanely-fast-whisper ⭐ 6,261
An opinionated CLI to transcribe Audio files w/ Whisper on-device! Powered by 🤗 Transformers, Optimum & flash-attn
abetlen/llama-cpp-python ⭐ 6,242
Python bindings for llama.cpp
🔗 llama-cpp-python.readthedocs.io
mit-han-lab/streaming-llm ⭐ 6,146
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
🔗 arxiv.org/abs/2309.17453
nat/openplayground ⭐ 6,059
An LLM playground you can run on your laptop
langchain-ai/opengpts ⭐ 6,048
An open source effort to create a similar experience to OpenAI's GPTs and Assistants API.
lightning-ai/litgpt ⭐ 5,899
Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
run-llama/rags ⭐ 5,825
Build ChatGPT over your data, all with natural language
lightning-ai/lit-llama ⭐ 5,761
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
unslothai/unsloth ⭐ 5,576
2-5X faster 80% less memory QLoRA & LoRA finetuning
🔗 unsloth.ai
skypilot-org/skypilot ⭐ 5,558
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
🔗 skypilot.readthedocs.io
dsdanielpark/Bard-API ⭐ 5,392
The unofficial python package that returns response of Google Bard through cookie value.
🔗 pypi.org/project/bardapi
chainlit/chainlit ⭐ 5,252
Build Conversational AI in minutes ⚡️
🔗 docs.chainlit.io
minedojo/Voyager ⭐ 5,122
An Open-Ended Embodied Agent with Large Language Models
🔗 voyager.minedojo.org
pytorch-labs/gpt-fast ⭐ 5,027
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
microsoft/promptbase ⭐ 5,020
promptbase is an evolving collection of resources, best practices, and example scripts for eliciting the best performance from foundation models.
eleutherai/lm-evaluation-harness ⭐ 4,812
A framework for few-shot evaluation of language models.
🔗 www.eleuther.ai
langchain-ai/chat-langchain ⭐ 4,707
Locally hosted chatbot specifically focused on question answering over the LangChain documentation
🔗 chat.langchain.com
jxnl/instructor ⭐ 4,515
Instructor is a Python library that makes it a breeze to work with structured outputs from large language models (LLMs). Built on top of Pydantic, it provides a simple, transparent, and user-friendly API to manage validation, retries, and streaming responses.
🔗 python.useinstructor.com
explodinggradients/ragas ⭐ 4,365
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
🔗 docs.ragas.io
openbmb/ToolBench ⭐ 4,353
[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
🔗 openbmb.github.io/toolbench
togethercomputer/RedPajama-Data ⭐ 4,296
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
microsoft/BioGPT ⭐ 4,231
Implementation of BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
mnotgod96/AppAgent ⭐ 4,086
AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
🔗 appagent-official.github.io
kyegomez/tree-of-thoughts ⭐ 4,013
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
🔗 discord.gg/qutxnk2nmf
instruction-tuning-with-gpt-4/GPT-4-LLM ⭐ 3,940
Instruction Tuning with GPT-4
🔗 instruction-tuning-with-gpt-4.github.io
allenai/OLMo ⭐ 3,871
OLMo is a repository for training and using AI2's state-of-the-art open language models. It is built by scientists, for scientists.
🔗 allenai.org/olmo
ravenscroftj/turbopilot ⭐ 3,832
Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
mshumer/gpt-llm-trainer ⭐ 3,750
Input a description of your task, and the system will generate a dataset, parse it, and fine-tune a LLaMA 2 model for you
1rgs/jsonformer ⭐ 3,745
A Bulletproof Way to Generate Structured JSON from Language Models
yizhongw/self-instruct ⭐ 3,715
Aligning pretrained language models with instruction data generated by themselves.
whitead/paper-qa ⭐ 3,589
LLM Chain for answering questions from documents with citations
microsoft/LLMLingua ⭐ 3,585
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
🔗 llmlingua.com
mmabrouk/llm-workflow-engine ⭐ 3,579
Power CLI and Workflow manager for LLMs (core package)
h2oai/h2o-llmstudio ⭐ 3,532
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
🔗 gpt-gm.h2o.ai
luodian/Otter ⭐ 3,435
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
🔗 otter-ntu.github.io
minimaxir/gpt-2-simple ⭐ 3,377
Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts
minimaxir/simpleaichat ⭐ 3,358
Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
nvidia/NeMo-Guardrails ⭐ 3,303
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
skyvern-ai/skyvern ⭐ 3,280
Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows, replacing brittle or unreliable automation solutions.
🔗 www.skyvern.com
eth-sri/lmql ⭐ 3,261
A language for constraint-guided and efficient LLM programming.
🔗 lmql.ai
guardrails-ai/guardrails ⭐ 3,246
Open-source Python package for specifying structure and type, validating and correcting the outputs of large language models (LLMs)
🔗 www.guardrailsai.com/docs
deep-diver/LLM-As-Chatbot ⭐ 3,224
LLM as a Chatbot Service
cg123/mergekit ⭐ 3,216
Tools for merging pretrained large language models.
microsoft/LMOps ⭐ 3,152
General technology for enabling AI capabilities w/ LLMs and MLLMs
🔗 aka.ms/generalai
llmware-ai/llmware ⭐ 3,056
Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.
🔗 pypi.org/project/llmware
baichuan-inc/Baichuan-13B ⭐ 2,954
A 13B large language model developed by Baichuan Intelligent Technology
🔗 huggingface.co/baichuan-inc/baichuan-13b-chat
iryna-kondr/scikit-llm ⭐ 2,917
Seamlessly integrate LLMs into scikit-learn.
🔗 beastbyte.ai
microsoft/torchscale ⭐ 2,906
Foundation Architecture for (M)LLMs
🔗 aka.ms/generalai
phidatahq/phidata ⭐ 2,876
Phidata is a toolkit for building AI Assistants using function calling.
🔗 docs.phidata.com
freedomintelligence/LLMZoo ⭐ 2,858
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
next-gpt/NExT-GPT ⭐ 2,826
Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
🔗 next-gpt.github.io
simonw/llm ⭐ 2,812
Access large language models from the command-line
🔗 llm.datasette.io
juncongmoo/pyllama ⭐ 2,779
LLaMA: Open and Efficient Foundation Language Models
defog-ai/sqlcoder ⭐ 2,663
SoTA LLM for converting natural language questions to SQL queries
paperswithcode/galai ⭐ 2,637
Model API for GALACTICA
li-plus/chatglm.cpp ⭐ 2,546
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & more LLMs
alpha-vllm/LLaMA2-Accessory ⭐ 2,452
An Open-source Toolkit for LLM Development
🔗 llama2-accessory.readthedocs.io
pathwaycom/llm-app ⭐ 2,444
LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.
🔗 pathway.com/developers/showcases/llm-app-pathway
hegelai/prompttools ⭐ 2,412
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
🔗 prompttools.readthedocs.io
promptfoo/promptfoo ⭐ 2,373
Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
🔗 www.promptfoo.dev
open-compass/opencompass ⭐ 2,371
OpenCompass is an LLM evaluation platform, supporting a wide range of models (InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
🔗 opencompass.org.cn
ofa-sys/OFA ⭐ 2,313
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
databricks/dbrx ⭐ 2,301
Code examples and resources for DBRX, a large language model developed by Databricks
🔗 www.databricks.com
langchain-ai/langgraph ⭐ 2,258
LangGraph is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain.
civitai/sd_civitai_extension ⭐ 2,254
All of the Civitai models inside Automatic 1111 Stable Diffusion Web UI
young-geng/EasyLM ⭐ 2,218
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
sgl-project/sglang ⭐ 2,203
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
weaviate/Verba ⭐ 2,125
Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
openai/finetune-transformer-lm ⭐ 2,070
Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
🔗 s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
bclavie/RAGatouille ⭐ 2,037
Bridging the gap between state-of-the-art research and alchemical RAG pipeline practices.
openai/image-gpt ⭐ 1,999
Archived. Code and models from the paper "Generative Pretraining from Pixels"
huggingface/text-embeddings-inference ⭐ 1,942
A blazing fast inference solution for text embeddings models
🔗 huggingface.co/docs/text-embeddings-inference/quick_tour
intel/neural-compressor ⭐ 1,933
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
🔗 intel.github.io/neural-compressor
noahshinn/reflexion ⭐ 1,919
[NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning
cheshire-cat-ai/core ⭐ 1,916
Production ready AI assistant framework
🔗 cheshirecat.ai
tairov/llama2.mojo ⭐ 1,903
Inference Llama 2 in one file of pure 🔥
🔗 www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov
openai/gpt-2-output-dataset ⭐ 1,879
Dataset of GPT-2 outputs for research in detection, biases, and more
lucidrains/toolformer-pytorch ⭐ 1,877
Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
spcl/graph-of-thoughts ⭐ 1,829
Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
🔗 arxiv.org/pdf/2308.09687.pdf
minimaxir/aitextgen ⭐ 1,826
A robust Python tool for text-based AI training and generation using GPT-2.
🔗 docs.aitextgen.io
neulab/prompt2model ⭐ 1,818
prompt2model - Generate Deployable Models from Natural Language Instructions
openai/gpt-discord-bot ⭐ 1,701
Example Discord bot written in Python that uses the completions API to have conversations with the text-davinci-003 model, and the moderations API to filter the messages.
ist-daslab/gptq ⭐ 1,683
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
🔗 arxiv.org/abs/2210.17323
microsoft/Megatron-DeepSpeed ⭐ 1,573
Ongoing research training transformer language models at scale, including: BERT & GPT-2
truera/trulens ⭐ 1,562
Evaluation and Tracking for LLM Experiments
🔗 www.trulens.org
epfllm/meditron ⭐ 1,518
Meditron is a suite of open-source medical Large Language Models (LLMs).
🔗 huggingface.co/epfl-llm
ray-project/llm-applications ⭐ 1,457
A comprehensive guide to building RAG-based LLM applications for production.
jina-ai/thinkgpt ⭐ 1,457
Agent techniques to augment your LLM and push it beyong its limits
predibase/lorax ⭐ 1,440
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
🔗 loraexchange.ai
cstankonrad/long_llama ⭐ 1,424
LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
farizrahman4u/loopgpt ⭐ 1,385
Re-implementation of Auto-GPT as a python package, written with modularity and extensibility in mind.
akariasai/self-rag ⭐ 1,355
This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
🔗 selfrag.github.io
explosion/spacy-transformers ⭐ 1,312
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
🔗 spacy.io/usage/embeddings-transformers
run-llama/llama-lab ⭐ 1,288
Llama Lab is a repo dedicated to building cutting-edge projects using LlamaIndex
bigscience-workshop/Megatron-DeepSpeed ⭐ 1,228
Ongoing research training transformer language models at scale, including: BERT & GPT-2
chatarena/chatarena ⭐ 1,210
ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
🔗 www.chatarena.org
srush/MiniChain ⭐ 1,169
A tiny library for coding with large language models.
🔗 srush-minichain.hf.space
ray-project/ray-llm ⭐ 1,118
RayLLM - LLMs on Ray
🔗 aviary.anyscale.com
ibm/Dromedary ⭐ 1,085
Dromedary: towards helpful, ethical and reliable LLMs.
nomic-ai/pygpt4all ⭐ 1,022
Official supported Python bindings for llama.cpp + gpt4all
🔗 nomic-ai.github.io/pygpt4all
rlancemartin/auto-evaluator ⭐ 1,014
Evaluation tool for LLM QA chains
🔗 autoevaluator.langchain.com
lupantech/chameleon-llm ⭐ 1,012
Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
🔗 chameleon-llm.github.io
linksoul-ai/AutoAgents ⭐ 999
Generate different roles for GPTs to form a collaborative entity for complex tasks.
🔗 huggingface.co/spaces/linksoul/autoagents
ctlllll/LLM-ToolMaker ⭐ 997
Large Language Models as Tool Makers
meetkai/functionary ⭐ 979
Chat language model that can interpret and execute functions/plugins
microsoft/Llama-2-Onnx ⭐ 978
A Microsoft optimized version of the Llama 2 model, available from Meta
keirp/automatic_prompt_engineer ⭐ 974
Large Language Models Are Human-Level Prompt Engineers
hao-ai-lab/LookaheadDecoding ⭐ 960
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
ajndkr/lanarky ⭐ 937
The web framework for building LLM microservices
🔗 lanarky.ajndkr.com
explosion/spacy-llm ⭐ 917
🦙 Integrating LLMs into structured NLP pipelines
🔗 spacy.io/usage/large-language-models
pinecone-io/canopy ⭐ 865
Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone
🔗 www.pinecone.io
cerebras/modelzoo ⭐ 846
Examples of common deep learning models that can be trained on Cerebras hardware
muennighoff/sgpt ⭐ 806
SGPT: GPT Sentence Embeddings for Semantic Search
🔗 arxiv.org/abs/2202.08904
agenta-ai/agenta ⭐ 799
The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
🔗 www.agenta.ai
huggingface/nanotron ⭐ 748
Minimalistic large language model 3D-parallelism training
oliveirabruno01/babyagi-asi ⭐ 745
BabyAGI: an Autonomous and Self-Improving agent, or BASI
opengenerativeai/GenossGPT ⭐ 726
One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.
🔗 genoss.ai
salesforce/xgen ⭐ 711
Salesforce open-source LLMs with 8k sequence length.
datadreamer-dev/DataDreamer ⭐ 627
DataDreamer is a powerful open-source Python library for prompting, synthetic data generation, and training workflows. It is designed to be simple, extremely efficient, and research-grade.
🔗 datadreamer.dev
langchain-ai/langsmith-cookbook ⭐ 582
LangSmith is a platform for building production-grade LLM applications.
🔗 langsmith-cookbook.vercel.app
squeezeailab/SqueezeLLM ⭐ 556
SqueezeLLM: Dense-and-Sparse Quantization
🔗 arxiv.org/abs/2306.07629
opengvlab/OmniQuant ⭐ 545
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
lupantech/ScienceQA ⭐ 540
Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
hazyresearch/ama_prompting ⭐ 529
Ask Me Anything language model prompting
zhudotexe/kani ⭐ 522
kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
🔗 kani.readthedocs.io
continuum-llms/chatgpt-memory ⭐ 509
Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis datastore.
vahe1994/SpQR ⭐ 507
Quantization algorithm and the model evaluation code for SpQR method for LLM compression
huggingface/lighteval ⭐ 302
LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

Math and Science

Mathematical, numerical and scientific libraries.

numpy/numpy ⭐ 26,239
The fundamental package for scientific computing with Python.
🔗 numpy.org
taichi-dev/taichi ⭐ 24,709
Productive, portable, and performant GPU programming in Python: Taichi Lang is an open-source, imperative, parallel programming language for high-performance numerical computation.
🔗 taichi-lang.org
scipy/scipy ⭐ 12,403
SciPy library main repository
🔗 scipy.org
sympy/sympy ⭐ 12,349
A computer algebra system written in pure Python
🔗 sympy.org
google/or-tools ⭐ 10,396
Google Optimization Tools (a.k.a., OR-Tools) is an open-source, fast and portable software suite for solving combinatorial optimization problems.
🔗 developers.google.com/optimization
z3prover/z3 ⭐ 9,690
Z3 is a theorem prover from Microsoft Research with a Python language binding.
cupy/cupy ⭐ 7,740
NumPy & SciPy for GPU
🔗 cupy.dev
google-deepmind/alphageometry ⭐ 3,603
Solving Olympiad Geometry without Human Demonstrations
mikedh/trimesh ⭐ 2,736
Python library for loading and using triangular meshes.
🔗 trimesh.org
mckinsey/causalnex ⭐ 2,134
A Python library that helps data scientists to infer causation rather than observing correlation.
🔗 causalnex.readthedocs.io
pyomo/pyomo ⭐ 1,830
An object-oriented algebraic modeling language in Python for structured optimization problems.
🔗 www.pyomo.org
facebookresearch/theseus ⭐ 1,590
A library for differentiable nonlinear optimization
google-research/torchsde ⭐ 1,458
Differentiable SDE solvers with GPU support and efficient sensitivity analysis.
dynamicslab/pysindy ⭐ 1,277
A package for the sparse identification of nonlinear dynamical systems from data
🔗 pysindy.readthedocs.io/en/latest
geomstats/geomstats ⭐ 1,145
Computations and statistics on manifolds with geometric structures.
🔗 geomstats.ai
cma-es/pycma ⭐ 1,022
pycma is a Python implementation of CMA-ES and a few related numerical optimization tools.
sj001/AI-Feynman ⭐ 583
Implementation of AI Feynman: a Physics-Inspired Method for Symbolic Regression
willianfuks/tfcausalimpact ⭐ 573
Python Causal Impact Implementation Based on Google's R Package. Built using TensorFlow Probability.
brandondube/prysm ⭐ 233
Prysm is an open-source library for physical and first-order modeling of optical systems and analysis of related data: numerical and physical optics, integrated modeling, phase retrieval, segmented systems, polynomials and fitting, sequential raytracing.
🔗 prysm.readthedocs.io/en/stable
lean-dojo/ReProver ⭐ 158
Retrieval-Augmented Theorem Provers for Lean
🔗 leandojo.org
albahnsen/pycircular ⭐ 86
pycircular is a Python module for circular data analysis
gbillotey/Fractalshades ⭐ 26
Arbitrary-precision fractal explorer - Python package

Machine Learning - General

General and classical machine learning libraries. See below for other sections covering specialised ML areas.

scikit-learn/scikit-learn ⭐ 57,982
scikit-learn: machine learning in Python
🔗 scikit-learn.org
openai/openai-cookbook ⭐ 55,606
Examples and guides for using the OpenAI API
🔗 cookbook.openai.com
tencentarc/GFPGAN ⭐ 34,476
GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.
google-research/google-research ⭐ 32,697
This repository contains code released by Google Research
🔗 research.google
suno-ai/bark ⭐ 32,180
🔊 Text-Prompted Generative Audio Model
facebookresearch/faiss ⭐ 27,913
A library for efficient similarity search and clustering of dense vectors.
🔗 faiss.ai
google/jax ⭐ 27,774
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
🔗 jax.readthedocs.io
open-mmlab/mmdetection ⭐ 27,631
OpenMMLab Detection Toolbox and Benchmark
🔗 mmdetection.readthedocs.io
ageron/handson-ml2 ⭐ 26,834
A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.
lutzroeder/netron ⭐ 25,962
Visualizer for neural network, deep learning and machine learning models
🔗 netron.app
dmlc/xgboost ⭐ 25,529
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
🔗 xgboost.readthedocs.io/en/stable
google/mediapipe ⭐ 25,321
Cross-platform, customizable ML solutions for live and streaming media.
🔗 mediapipe.dev
harisiqbal88/PlotNeuralNet ⭐ 21,002
Latex code for making neural networks diagrams
jina-ai/jina ⭐ 19,876
☁️ Build multimodal AI applications with cloud-native stack
🔗 docs.jina.ai
onnx/onnx ⭐ 16,750
Open standard for machine learning interoperability
🔗 onnx.ai
microsoft/LightGBM ⭐ 16,022
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
🔗 lightgbm.readthedocs.io/en/latest
tensorflow/tensor2tensor ⭐ 14,841
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
ddbourgin/numpy-ml ⭐ 14,533
Machine learning, in numpy
🔗 numpy-ml.readthedocs.io
aleju/imgaug ⭐ 14,113
Image augmentation for machine learning experiments.
🔗 imgaug.readthedocs.io
ml-explore/mlx ⭐ 13,848
MLX is an array framework for machine learning on Apple silicon, brought to you by Apple machine learning research.
🔗 ml-explore.github.io/mlx
roboflow/supervision ⭐ 13,796
We write your reusable computer vision tools. 💜
🔗 supervision.roboflow.com
microsoft/nni ⭐ 13,709
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
🔗 nni.readthedocs.io
microsoft/Swin-Transformer ⭐ 12,869
This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
🔗 arxiv.org/abs/2103.14030
jindongwang/transferlearning ⭐ 12,804
Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习
🔗 transferlearning.xyz
deepmind/deepmind-research ⭐ 12,760
This repository contains implementations and illustrative code to accompany DeepMind publications
spotify/annoy ⭐ 12,640
Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
microsoft/onnxruntime ⭐ 12,556
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
🔗 onnxruntime.ai
neonbjb/tortoise-tts ⭐ 11,635
A multi-voice TTS system trained with an emphasis on quality
deepmind/alphafold ⭐ 11,622
Implementation of the inference pipeline of AlphaFold v2
facebookresearch/AnimatedDrawings ⭐ 10,133
Code to accompany "A Method for Animating Children's Drawings of the Human Figure"
twitter/the-algorithm-ml ⭐ 9,871
Source code for Twitter's Recommendation Algorithm
🔗 blog.twitter.com/engineering/en_us/topics/open-source/2023/twitter-recommendation-algorithm
optuna/optuna ⭐ 9,595
A hyperparameter optimization framework
🔗 optuna.org
ggerganov/ggml ⭐ 9,527
Tensor library for machine learning
statsmodels/statsmodels ⭐ 9,506
Statsmodels: statistical modeling and econometrics in Python
🔗 www.statsmodels.org/devel
epistasislab/tpot ⭐ 9,485
A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
🔗 epistasislab.github.io/tpot
megvii-basedetection/YOLOX ⭐ 8,971
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
cleanlab/cleanlab ⭐ 8,396
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
🔗 cleanlab.ai
pycaret/pycaret ⭐ 8,372
An open-source, low-code machine learning library in Python
🔗 www.pycaret.org
wandb/wandb ⭐ 8,152
🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
🔗 wandb.ai
pymc-devs/pymc ⭐ 8,128
Bayesian Modeling and Probabilistic Programming in Python
🔗 docs.pymc.io
uberi/speech_recognition ⭐ 8,014
Speech recognition module for Python, supporting several engines and APIs, online and offline.
🔗 pypi.python.org/pypi/speechrecognition
catboost/catboost ⭐ 7,719
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
🔗 catboost.ai
facebookresearch/xformers ⭐ 7,471
Hackable and optimized Transformers building blocks, supporting a composable construction.
🔗 facebookresearch.github.io/xformers
automl/auto-sklearn ⭐ 7,389
Automated Machine Learning with scikit-learn
🔗 automl.github.io/auto-sklearn
open-mmlab/mmsegmentation ⭐ 7,339
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
🔗 mmsegmentation.readthedocs.io/en/main
hyperopt/hyperopt ⭐ 7,072
Distributed Asynchronous Hyperparameter Optimization in Python
🔗 hyperopt.github.io/hyperopt
awslabs/autogluon ⭐ 7,045
AutoGluon: Fast and Accurate ML in 3 Lines of Code
🔗 auto.gluon.ai
featurelabs/featuretools ⭐ 7,012
An open source python library for automated feature engineering
🔗 www.featuretools.com
lmcinnes/umap ⭐ 6,920
Uniform Manifold Approximation and Projection
huggingface/accelerate ⭐ 6,881
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
🔗 huggingface.co/docs/accelerate
hips/autograd ⭐ 6,773
Efficiently computes derivatives of numpy code.
py-why/dowhy ⭐ 6,704
DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.
🔗 www.pywhy.org/dowhy
scikit-learn-contrib/imbalanced-learn ⭐ 6,682
A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning
🔗 imbalanced-learn.org
open-mmlab/mmagic ⭐ 6,543
OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.
🔗 mmagic.readthedocs.io/en/latest
probml/pyprobml ⭐ 6,216
Python code for "Probabilistic Machine learning" book by Kevin Murphy
nicolashug/Surprise ⭐ 6,169
A Python scikit for building and analyzing recommender systems
🔗 surpriselib.com
google/automl ⭐ 6,143
Google Brain AutoML
cleverhans-lab/cleverhans ⭐ 6,070
An adversarial example library for constructing attacks, building defenses, and benchmarking both
kevinmusgrave/pytorch-metric-learning ⭐ 5,743
The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.
🔗 kevinmusgrave.github.io/pytorch-metric-learning
open-mmlab/mmcv ⭐ 5,571
OpenMMLab Computer Vision Foundation
🔗 mmcv.readthedocs.io/en/latest
project-monai/MONAI ⭐ 5,258
AI Toolkit for Healthcare Imaging
🔗 monai.io
mdbloice/Augmentor ⭐ 5,018
Image augmentation library in Python for machine learning.
🔗 augmentor.readthedocs.io/en/stable
ml-explore/mlx-examples ⭐ 4,807
Examples in the MLX framework
rasbt/mlxtend ⭐ 4,757
A library of extension and helper modules for Python's data analysis and machine learning libraries.
🔗 rasbt.github.io/mlxtend
online-ml/river ⭐ 4,751
🌊 Online machine learning in Python
🔗 riverml.xyz
uber/causalml ⭐ 4,724
Uplift modeling and causal inference with machine learning algorithms
lucidrains/deep-daze ⭐ 4,387
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
google-deepmind/graphcast ⭐ 4,194
GraphCast: Learning skillful medium-range global weather forecasting
districtdatalabs/yellowbrick ⭐ 4,190
Visual analysis and diagnostic tools to facilitate machine learning model selection.
🔗 www.scikit-yb.org
skvark/opencv-python ⭐ 4,145
Automated CI toolchain to produce precompiled opencv-python, opencv-python-headless, opencv-contrib-python and opencv-contrib-python-headless packages.
🔗 pypi.org/project/opencv-python
nv-tlabs/GET3D ⭐ 4,110
Generative Model of High Quality 3D Textured Shapes Learned from Images
marqo-ai/marqo ⭐ 4,085
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
🔗 www.marqo.ai
sanchit-gandhi/whisper-jax ⭐ 4,046
JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
apple/coremltools ⭐ 4,034
Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.
🔗 coremltools.readme.io
nmslib/hnswlib ⭐ 3,983
Header-only C++/python library for fast approximate nearest neighbors
🔗 github.com/nmslib/hnswlib
cmusphinx/pocketsphinx ⭐ 3,725
A small speech recognizer
microsoft/FLAML ⭐ 3,661
A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
🔗 microsoft.github.io/flaml
ourownstory/neural_prophet ⭐ 3,625
NeuralProphet: A simple forecasting package
🔗 neuralprophet.com
py-why/EconML ⭐ 3,528
ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to brin...
🔗 www.microsoft.com/en-us/research/project/alice
thudm/CogVideo ⭐ 3,477
Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"
huggingface/notebooks ⭐ 3,244
Notebooks using the Hugging Face libraries 🤗
facebookresearch/vissl ⭐ 3,224
VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
🔗 vissl.ai
rucaibox/RecBole ⭐ 3,154
A unified, comprehensive and efficient recommendation library
🔗 recbole.io
yoheinakajima/instagraph ⭐ 3,152
Converts text input or URL into knowledge graph and displays
pytorch/glow ⭐ 3,132
Compiler for Neural Network hardware accelerators
hrnet/HRNet-Semantic-Segmentation ⭐ 3,047
The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919
huggingface/autotrain-advanced ⭐ 3,007
AutoTrain Advanced: faster and easier training and deployments of state-of-the-art machine learning models
🔗 huggingface.co/autotrain
lucidrains/musiclm-pytorch ⭐ 2,999
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
mljar/mljar-supervised ⭐ 2,923
Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation
🔗 mljar.com
zjunlp/DeepKE ⭐ 2,875
[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
🔗 deepke.zjukg.cn
lightly-ai/lightly ⭐ 2,731
A python library for self-supervised learning on images.
🔗 docs.lightly.ai/self-supervised-learning
teamhg-memex/eli5 ⭐ 2,725
A library for debugging/inspecting machine learning classifiers and explaining their predictions
🔗 eli5.readthedocs.io
scikit-optimize/scikit-optimize ⭐ 2,720
Sequential model-based optimization with a scipy.optimize interface
🔗 scikit-optimize.github.io
scikit-learn-contrib/hdbscan ⭐ 2,667
A high performance implementation of HDBSCAN clustering.
🔗 hdbscan.readthedocs.io/en/latest
shankarpandala/lazypredict ⭐ 2,656
Lazy Predict help build a lot of basic models without much code and helps understand which models works better without any parameter tuning
maif/shapash ⭐ 2,639
🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
🔗 maif.github.io/shapash
google-research/t5x ⭐ 2,466
T5X is a modular, composable, research-friendly framework for high-performance, configurable, self-service training, evaluation, and inference of sequence models (starting with language) at many scales.
apple/ml-ane-transformers ⭐ 2,458
Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)
huggingface/safetensors ⭐ 2,400
Implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).
🔗 huggingface.co/docs/safetensors
scikit-learn-contrib/category_encoders ⭐ 2,361
A library of sklearn compatible categorical variable encoders
🔗 contrib.scikit-learn.org/category_encoders
freedmand/semantra ⭐ 2,264
Semantra is a multipurpose tool for semantically searching documents. Query by meaning rather than just by matching text.
huggingface/optimum ⭐ 2,115
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
🔗 huggingface.co/docs/optimum/main
rom1504/clip-retrieval ⭐ 2,102
Easily compute clip embeddings and build a clip retrieval system with them
🔗 rom1504.github.io/clip-retrieval
aws/sagemaker-python-sdk ⭐ 2,036
A library for training and deploying machine learning models on Amazon SageMaker
🔗 sagemaker.readthedocs.io
rentruewang/koila ⭐ 1,817
Prevent PyTorch's CUDA error: out of memory in just 1 line of code.
🔗 rentruewang.github.io/koila
contextlab/hypertools ⭐ 1,797
A Python toolbox for gaining geometric insights into high-dimensional data
🔗 hypertools.readthedocs.io/en/latest
huggingface/evaluate ⭐ 1,795
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
🔗 huggingface.co/docs/evaluate
linkedin/greykite ⭐ 1,789
A flexible, intuitive and fast forecasting library
bmabey/pyLDAvis ⭐ 1,779
Python library for interactive topic model visualization. Port of the R LDAvis package.
scikit-learn-contrib/lightning ⭐ 1,706
Large-scale linear classification, regression and ranking in Python
🔗 contrib.scikit-learn.org/lightning
tensorflow/addons ⭐ 1,680
Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
huggingface/huggingface_hub ⭐ 1,643
The official Python client for the Huggingface Hub.
🔗 huggingface.co/docs/huggingface_hub
microsoft/i-Code ⭐ 1,627
The ambition of the i-Code project is to build integrative and composable multimodal AI. The "i" stands for integrative multimodal learning.
eric-mitchell/direct-preference-optimization ⭐ 1,574
Reference implementation for DPO (Direct Preference Optimization)
castorini/pyserini ⭐ 1,428
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
🔗 pyserini.io
kubeflow/katib ⭐ 1,419
Automated Machine Learning on Kubernetes
🔗 www.kubeflow.org/docs/components/katib
jina-ai/finetuner ⭐ 1,414
🎯 Task-oriented embedding tuning for BERT, CLIP, etc.
🔗 finetuner.jina.ai
visual-layer/fastdup ⭐ 1,395
fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.
scikit-learn-contrib/metric-learn ⭐ 1,375
Metric learning algorithms in Python
🔗 contrib.scikit-learn.org/metric-learn
laekov/fastmoe ⭐ 1,363
A fast MoE impl for PyTorch
🔗 fastmoe.ai
googlecloudplatform/vertex-ai-samples ⭐ 1,328
Sample code and notebooks for Vertex AI, the end-to-end machine learning platform on Google Cloud
🔗 cloud.google.com/vertex-ai
csinva/imodels ⭐ 1,284
Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).
🔗 csinva.io/imodels
borealisai/advertorch ⭐ 1,270
A Toolbox for Adversarial Robustness Research
awslabs/dgl-ke ⭐ 1,231
High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.
🔗 dglke.dgl.ai/doc
microsoft/Olive ⭐ 1,202
Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation.
🔗 microsoft.github.io/olive
google/vizier ⭐ 1,170
Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
🔗 oss-vizier.readthedocs.io
microsoft/Semi-supervised-learning ⭐ 1,169
A Unified Semi-Supervised Learning Codebase (NeurIPS'22)
🔗 usb.readthedocs.io
patchy631/machine-learning ⭐ 1,154
Machine Learning Tutorials Repository
koaning/scikit-lego ⭐ 1,143
Extra blocks for scikit-learn pipelines.
🔗 koaning.github.io/scikit-lego
spotify/voyager ⭐ 1,142
🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.
🔗 spotify.github.io/voyager
automl/TabPFN ⭐ 1,079
Official implementation of the TabPFN paper (https://arxiv.org/abs/2207.01848) and the tabpfn package.
🔗 priorlabs.ai
google-research/deeplab2 ⭐ 982
DeepLab2 is a TensorFlow library for deep labeling, aiming to provide a unified and state-of-the-art TensorFlow codebase for dense pixel labeling tasks.
lmcinnes/pynndescent ⭐ 837
A Python nearest neighbor descent for approximate nearest neighbors
hazyresearch/safari ⭐ 834
Convolutions for Sequence Modeling
davidmrau/mixture-of-experts ⭐ 811
PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
opentensor/bittensor ⭐ 766
Internet-scale Neural Networks
🔗 www.bittensor.com
nvidia/cuda-python ⭐ 766
CUDA Python Low-level Bindings
🔗 nvidia.github.io/cuda-python
oml-team/open-metric-learning ⭐ 755
OML is a PyTorch-based framework to train and validate the models producing high-quality embeddings.
🔗 open-metric-learning.readthedocs.io/en/latest/index.html
qdrant/fastembed ⭐ 741
Fast, Accurate, Lightweight Python library to make State of the Art Embedding
🔗 qdrant.github.io/fastembed
criteo/autofaiss ⭐ 739
Automatically create Faiss knn indices with the most optimal similarity search parameters.
🔗 criteo.github.io/autofaiss
facebookresearch/balance ⭐ 671
The balance python package offers a simple workflow and methods for dealing with biased data samples when looking to infer from them to some target population of interest.
🔗 import-balance.org
awslabs/python-deequ ⭐ 638
Python API for Deequ, a library built on Spark for defining "unit tests for data", which measure data quality in large datasets
nicolas-hbt/pygraft ⭐ 636
Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
🔗 pygraft.readthedocs.io/en/latest
hpcaitech/EnergonAI ⭐ 630
Large-scale model inference.
qdrant/quaterion ⭐ 618
Blazing fast framework for fine-tuning similarity learning models
🔗 quaterion.qdrant.tech
replicate/replicate-python ⭐ 617
Python client for Replicate
🔗 replicate.com
microsoft/Focal-Transformer ⭐ 541
[NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"
nevronai/MetisFL ⭐ 530
The first open Federated Learning framework implemented in C++ and Python.
🔗 metisfl.org
googleapis/python-aiplatform ⭐ 524
A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
huggingface/exporters ⭐ 524
Export Hugging Face models to Core ML and TensorFlow Lite
cvxgrp/pymde ⭐ 516
Minimum-distortion embedding with PyTorch
🔗 pymde.org
lightning-ai/litdata ⭐ 175
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
dylanhogg/gptauthor ⭐ 42
GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.

Machine Learning - Deep Learning

Machine learning libraries that cross over with deep learning in some way.

tensorflow/tensorflow ⭐ 182,186
An Open Source Machine Learning Framework for Everyone
🔗 tensorflow.org
pytorch/pytorch ⭐ 77,461
Tensors and Dynamic neural networks in Python with strong GPU acceleration
🔗 pytorch.org
keras-team/keras ⭐ 60,866
Deep Learning for humans
🔗 keras.io
openai/whisper ⭐ 59,616
Robust Speech Recognition via Large-Scale Weak Supervision
deepfakes/faceswap ⭐ 49,099
Deepfakes Software For All
🔗 www.faceswap.dev
iperov/DeepFaceLab ⭐ 45,194
DeepFaceLab is the leading software for creating deepfakes.
facebookresearch/segment-anything ⭐ 43,735
The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
microsoft/DeepSpeed ⭐ 32,429
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
🔗 www.deepspeed.ai
rwightman/pytorch-image-models ⭐ 29,579
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
🔗 huggingface.co/docs/timm
facebookresearch/detectron2 ⭐ 28,567
Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
🔗 detectron2.readthedocs.io/en/latest
lightning-ai/pytorch-lightning ⭐ 26,740
The deep learning framework to pretrain, finetune and deploy AI models. PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch code to decouple the science from the engineering.
🔗 lightning.ai
facebookresearch/Detectron ⭐ 26,132
FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.
xinntao/Real-ESRGAN ⭐ 25,853
Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.
matterport/Mask_RCNN ⭐ 24,097
Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow
openai/CLIP ⭐ 21,902
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
paddlepaddle/Paddle ⭐ 21,576
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
🔗 www.paddlepaddle.org
apache/mxnet ⭐ 20,705
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
🔗 mxnet.apache.org
pyg-team/pytorch_geometric ⭐ 20,014
Graph Neural Network Library for PyTorch
🔗 pyg.org
lucidrains/vit-pytorch ⭐ 17,781
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
sanster/IOPaint ⭐ 16,803
Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.
🔗 www.iopaint.com
rasbt/deeplearning-models ⭐ 16,280
A collection of various deep learning architectures, models, and tips
danielgatis/rembg ⭐ 14,298
Rembg is a tool to remove images background
albumentations-team/albumentations ⭐ 13,360
Fast image augmentation library and an easy-to-use wrapper around other libraries. Documentation: https://albumentations.ai/docs/ Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
🔗 albumentations.ai
dmlc/dgl ⭐ 12,966
Python package built to ease deep learning on graph, on top of existing DL frameworks.
🔗 dgl.ai
facebookresearch/detr ⭐ 12,786
End-to-End Object Detection with Transformers
nvidia/DeepLearningExamples ⭐ 12,564
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
kornia/kornia ⭐ 9,316
Geometric Computer Vision Library for Spatial AI
🔗 kornia.readthedocs.io
keras-team/autokeras ⭐ 9,061
AutoML library for deep learning
🔗 autokeras.com
pyro-ppl/pyro ⭐ 8,339
Deep universal probabilistic programming with Python and PyTorch
🔗 pyro.ai
mlfoundations/open_clip ⭐ 8,297
An open source implementation of OpenAI's CLIP (Contrastive Language-Image Pre-training)
facebookresearch/pytorch3d ⭐ 8,251
PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
🔗 pytorch3d.org
nvidia/apex ⭐ 8,000
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
google/trax ⭐ 7,947
Trax — Deep Learning with Clear Code and Speed
arogozhnikov/einops ⭐ 7,877
Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
🔗 einops.rocks
facebookresearch/ImageBind ⭐ 7,831
ImageBind One Embedding Space to Bind Them All
lucidrains/imagen-pytorch ⭐ 7,752
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
xpixelgroup/BasicSR ⭐ 6,134
Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.
🔗 basicsr.readthedocs.io/en/latest
skorch-dev/skorch ⭐ 5,609
A scikit-learn compatible neural network library that wraps PyTorch
google/flax ⭐ 5,469
Flax is a neural network library for JAX that is designed for flexibility.
🔗 flax.readthedocs.io
facebookresearch/mmf ⭐ 5,414
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
🔗 mmf.sh
mosaicml/composer ⭐ 4,968
Supercharge Your Model Training
🔗 docs.mosaicml.com
pytorch/ignite ⭐ 4,448
High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
🔗 pytorch-ignite.ai
facebookincubator/AITemplate ⭐ 4,440
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
deci-ai/super-gradients ⭐ 4,312
Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS.
🔗 www.supergradients.com
nvidiagameworks/kaolin ⭐ 4,196
A PyTorch Library for Accelerating 3D Deep Learning Research
williamyang1991/VToonify ⭐ 3,459
[SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer
facebookresearch/PyTorch-BigGraph ⭐ 3,347
Generate embeddings from large-scale graph-structured data.
🔗 torchbiggraph.readthedocs.io
alpa-projects/alpa ⭐ 2,970
Training and serving large-scale neural networks with auto parallelization.
🔗 alpa.ai
pytorch/botorch ⭐ 2,939
Bayesian optimization in PyTorch
🔗 botorch.org
cvg/LightGlue ⭐ 2,927
LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
deepmind/dm-haiku ⭐ 2,799
JAX-based neural network library
🔗 dm-haiku.readthedocs.io
explosion/thinc ⭐ 2,790
🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
🔗 thinc.ai
nerdyrodent/VQGAN-CLIP ⭐ 2,568
Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.
danielegrattarola/spektral ⭐ 2,343
Graph Neural Networks with Keras and Tensorflow 2.
🔗 graphneural.network
google-research/electra ⭐ 2,286
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
neuralmagic/sparseml ⭐ 1,965
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
fepegar/torchio ⭐ 1,949
Medical imaging toolkit for deep learning
🔗 www.torchio.org
pytorch/torchrec ⭐ 1,716
Pytorch domain library for recommendation systems
tensorflow/mesh ⭐ 1,551
Mesh TensorFlow: Model Parallelism Made Easier
vt-vl-lab/FGVC ⭐ 1,544
[ECCV 2020] Flow-edge Guided Video Completion
tensorly/tensorly ⭐ 1,493
TensorLy: Tensor Learning in Python.
🔗 tensorly.org
calculatedcontent/WeightWatcher ⭐ 1,388
The WeightWatcher tool for predicting the accuracy of Deep Neural Networks
hysts/pytorch_image_classification ⭐ 1,309
PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet
jeshraghian/snntorch ⭐ 1,053
Deep and online learning with spiking neural networks in Python
🔗 snntorch.readthedocs.io/en/latest
xl0/lovely-tensors ⭐ 1,045
Tensors, ready for human consumption
🔗 xl0.github.io/lovely-tensors
tensorflow/similarity ⭐ 994
TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
deepmind/android_env ⭐ 949
RL research on Android devices.
keras-team/keras-cv ⭐ 941
Industry-strength Computer Vision workflows with Keras
deepmind/chex ⭐ 709
Chex is a library of utilities for helping to write reliable JAX code
🔗 chex.readthedocs.io
kakaobrain/rq-vae-transformer ⭐ 680
The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)
whitead/dmol-book ⭐ 576
Deep learning for molecules and materials book
🔗 dmol.pub

Machine Learning - Interpretability

Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training.

slundberg/shap ⭐ 21,534
A game theoretic approach to explain the output of any machine learning model.
🔗 shap.readthedocs.io
marcotcr/lime ⭐ 11,257
Lime: Explaining the predictions of any machine learning classifier
interpretml/interpret ⭐ 5,980
Fit interpretable models. Explain blackbox machine learning.
🔗 interpret.ml/docs
tensorflow/lucid ⭐ 4,613
A collection of infrastructure and tools for research in neural network interpretability.
pytorch/captum ⭐ 4,542
Model interpretability and understanding for PyTorch
🔗 captum.ai
pair-code/lit ⭐ 3,374
The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.
🔗 pair-code.github.io/lit
arize-ai/phoenix ⭐ 2,531
AI Observability & Evaluation
🔗 docs.arize.com/phoenix
seldonio/alibi ⭐ 2,283
Algorithms for explaining machine learning models
🔗 docs.seldon.io/projects/alibi/en/stable
oegedijk/explainerdashboard ⭐ 2,221
Quickly build Explainable AI dashboards that show the inner workings of so-called "blackbox" machine learning models.
🔗 explainerdashboard.readthedocs.io
eleutherai/pythia ⭐ 2,011
Interpretability analysis and scaling laws to understand how knowledge develops and evolves during training in autoregressive transformers
jalammar/ecco ⭐ 1,898
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
🔗 ecco.readthedocs.io
cdpierse/transformers-interpret ⭐ 1,199
Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
selfexplainml/PiML-Toolbox ⭐ 866
PiML (Python Interpretable Machine Learning) toolbox for model development & diagnostics
🔗 selfexplainml.github.io/piml-toolbox

Machine Learning - Ops

MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models.

apache/airflow ⭐ 34,334
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
🔗 airflow.apache.org
ray-project/ray ⭐ 30,882
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
🔗 ray.io
spotify/luigi ⭐ 17,285
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
mlflow/mlflow ⭐ 17,178
Open source platform for the machine learning lifecycle
🔗 mlflow.org
prefecthq/prefect ⭐ 14,495
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
🔗 prefect.io
horovod/horovod ⭐ 13,930
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
🔗 horovod.ai
iterative/dvc ⭐ 13,087
🦉 ML Experiments and Data Management with Git
🔗 dvc.org
ludwig-ai/ludwig ⭐ 10,759
Low-code framework for building custom LLMs, neural networks, and other AI models
🔗 ludwig.ai
dagster-io/dagster ⭐ 10,114
An orchestration platform for the development, production, and observation of data assets.
🔗 dagster.io
great-expectations/great_expectations ⭐ 9,418
Always know what to expect from your data.
🔗 docs.greatexpectations.io
kedro-org/kedro ⭐ 9,337
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
🔗 kedro.org
dbt-labs/dbt-core ⭐ 8,832
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
🔗 getdbt.com
bentoml/OpenLLM ⭐ 8,650
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint, locally and in the cloud.
🔗 bentoml.com
activeloopai/deeplake ⭐ 7,673
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
🔗 activeloop.ai
netflix/metaflow ⭐ 7,538
🚀 Build and manage real-life ML, AI, and data science projects with ease!
🔗 metaflow.org
mage-ai/mage-ai ⭐ 6,936
🧙 Build, run, and manage data pipelines for integrating and transforming data.
🔗 www.mage.ai
bentoml/BentoML ⭐ 6,502
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
🔗 bentoml.com
kestra-io/kestra ⭐ 6,209
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
🔗 kestra.io
feast-dev/feast ⭐ 5,239
Feature Store for Machine Learning
🔗 feast.dev
allegroai/clearml ⭐ 5,210
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
🔗 clear.ml/docs
aimhubio/aim ⭐ 4,748
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
🔗 aimstack.io
flyteorg/flyte ⭐ 4,713
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
🔗 flyte.org
evidentlyai/evidently ⭐ 4,598
Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
adap/flower ⭐ 4,104
Flower: A Friendly Federated Learning Framework
🔗 flower.ai
orchest/orchest ⭐ 4,018
Build data pipelines, the easy way 🛠️
🔗 orchest.readthedocs.io/en/stable
zenml-io/zenml ⭐ 3,633
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
🔗 zenml.io
polyaxon/polyaxon ⭐ 3,476
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
🔗 polyaxon.com
kubeflow/pipelines ⭐ 3,431
Machine Learning Pipelines for Kubeflow
🔗 www.kubeflow.org/docs/components/pipelines
ploomber/ploomber ⭐ 3,369
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
🔗 docs.ploomber.io
towhee-io/towhee ⭐ 2,952
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
🔗 towhee.io
determined-ai/determined ⭐ 2,843
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
🔗 determined.ai
leptonai/leptonai ⭐ 2,405
A Pythonic framework to simplify AI service building
🔗 lepton.ai
meltano/meltano ⭐ 1,573
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
🔗 meltano.com
hi-primus/optimus ⭐ 1,441
🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
🔗 hi-optimus.com
kubeflow/examples ⭐ 1,371
A repository to host extended examples and tutorials
dagworks-inc/hamilton ⭐ 1,301
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
🔗 hamilton.dagworks.io/en/latest
azure/PyRIT ⭐ 1,232
The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and ML engineers to red team foundation models and their applications.
dstackai/dstack ⭐ 1,063
dstack is an open-source orchestration engine for cost-effectively running AI workloads in the cloud as well as on-premises. Discord: https://discord.gg/u8SmfwPpMd
🔗 dstack.ai
nccr-itmo/FEDOT ⭐ 602
Automated modeling and machine learning framework FEDOT
🔗 fedot.readthedocs.io
dagworks-inc/burr ⭐ 371
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
🔗 burr.dagworks.io

Machine Learning - Reinforcement

Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF

openai/gym ⭐ 33,819
A toolkit for developing and comparing reinforcement learning algorithms.
🔗 www.gymlibrary.dev
unity-technologies/ml-agents ⭐ 16,279
The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
🔗 unity.com/products/machine-learning-agents
openai/baselines ⭐ 15,309
OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
google/dopamine ⭐ 10,365
Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.
🔗 github.com/google/dopamine
deepmind/pysc2 ⭐ 7,904
StarCraft II Learning Environment
lucidrains/PaLM-rlhf-pytorch ⭐ 7,584
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
thu-ml/tianshou ⭐ 7,353
An elegant PyTorch deep reinforcement learning library.
🔗 tianshou.org
tensorlayer/TensorLayer ⭐ 7,289
Deep Learning and Reinforcement Learning Library for Scientists and Engineers
🔗 tensorlayerx.com
farama-foundation/Gymnasium ⭐ 5,619
An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
🔗 gymnasium.farama.org
keras-rl/keras-rl ⭐ 5,487
Deep Reinforcement Learning for Keras.
🔗 keras-rl.readthedocs.io
deepmind/dm_control ⭐ 3,525
Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
facebookresearch/ReAgent ⭐ 3,524
A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)
🔗 reagent.ai
ai4finance-foundation/ElegantRL ⭐ 3,415
Massively Parallel Deep Reinforcement Learning. 🔥
🔗 ai4finance.org
deepmind/acme ⭐ 3,366
A library of reinforcement learning components and agents
eureka-research/Eureka ⭐ 2,578
Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models"
🔗 eureka-research.github.io
pettingzoo-team/PettingZoo ⭐ 2,351
An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities
🔗 pettingzoo.farama.org
kzl/decision-transformer ⭐ 2,133
Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.
pytorch/rl ⭐ 1,826
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
🔗 pytorch.org/rl
anthropics/hh-rlhf ⭐ 1,427
Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
🔗 arxiv.org/abs/2204.05862
humancompatibleai/imitation ⭐ 1,126
Clean PyTorch implementations of imitation and reward learning algorithms
🔗 imitation.readthedocs.io
arise-initiative/robosuite ⭐ 1,068
robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
🔗 robosuite.ai
denys88/rl_games ⭐ 703
RL Games: High performance RL library

Natural Language Processing

Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover.

huggingface/transformers ⭐ 124,169
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
🔗 huggingface.co/transformers
pytorch/fairseq ⭐ 29,156
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
explosion/spaCy ⭐ 28,658
💫 Industrial-strength Natural Language Processing (NLP) in Python
🔗 spacy.io
huggingface/datasets ⭐ 18,345
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
🔗 huggingface.co/docs/datasets
microsoft/unilm ⭐ 18,231
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
🔗 aka.ms/generalai
myshell-ai/OpenVoice ⭐ 16,993
Instant voice cloning by MyShell.
🔗 research.myshell.ai/open-voice
rare-technologies/gensim ⭐ 15,196
Topic Modelling for Humans
🔗 radimrehurek.com/gensim
gunthercox/ChatterBot ⭐ 13,883
ChatterBot is a machine learning, conversational dialog engine for creating chat bots
🔗 chatterbot.readthedocs.io
ukplab/sentence-transformers ⭐ 13,657
Multilingual Sentence & Image Embeddings with BERT
🔗 www.sbert.net
flairnlp/flair ⭐ 13,539
A very simple framework for state-of-the-art Natural Language Processing (NLP)
🔗 flairnlp.github.io/flair
nltk/nltk ⭐ 12,991
NLTK Source
🔗 www.nltk.org
jina-ai/clip-as-service ⭐ 12,167
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
🔗 clip-as-service.jina.ai
allenai/allennlp ⭐ 11,686
An open-source NLP research library, built on PyTorch.
🔗 www.allennlp.org
facebookresearch/ParlAI ⭐ 10,421
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
🔗 parl.ai
facebookresearch/seamless_communication ⭐ 10,096
Foundational Models for State-of-the-Art Speech and Text Translation
nvidia/NeMo ⭐ 9,948
NeMo: a framework for generative AI
🔗 nvidia.github.io/nemo
openai/tiktoken ⭐ 9,581
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
google/sentencepiece ⭐ 9,397
Unsupervised text tokenizer for Neural Network-based text generation.
togethercomputer/OpenChatKit ⭐ 8,993
OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots
doccano/doccano ⭐ 8,936
Open source annotation tool for machine learning practitioners.
sloria/TextBlob ⭐ 8,913
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
🔗 textblob.readthedocs.io
m-bain/whisperX ⭐ 8,792
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
clips/pattern ⭐ 8,654
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
🔗 github.com/clips/pattern/wiki
facebookresearch/nougat ⭐ 7,937
Implementation of Nougat Neural Optical Understanding for Academic Documents
🔗 facebookresearch.github.io/nougat
espnet/espnet ⭐ 7,827
End-to-End Speech Processing Toolkit
🔗 espnet.github.io/espnet
speechbrain/speechbrain ⭐ 7,819
A PyTorch-based Speech Toolkit
🔗 speechbrain.github.io
vikparuchuri/marker ⭐ 7,767
Marker converts PDF, EPUB, and MOBI to markdown. It's 10x faster than nougat, more accurate on most documents, and has low hallucination risk.
neuml/txtai ⭐ 6,903
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
🔗 neuml.github.io/txtai
deeppavlov/DeepPavlov ⭐ 6,531
An open source library for deep learning end-to-end dialog systems and chatbots.
🔗 deeppavlov.ai
facebookresearch/metaseq ⭐ 6,371
A codebase for working with Open Pre-trained Transformers, originally forked from fairseq.
kingoflolz/mesh-transformer-jax ⭐ 6,213
Model parallel transformers in JAX and Haiku
maartengr/BERTopic ⭐ 5,503
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
🔗 maartengr.github.io/bertopic
vikparuchuri/surya ⭐ 5,500
OCR, layout analysis, and line detection in 90+ languages
minimaxir/textgenrnn ⭐ 4,941
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
salesforce/CodeGen ⭐ 4,750
CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
prefecthq/marvin ⭐ 4,669
✨ Build AI interfaces that spark joy
🔗 askmarvin.ai
aiwaves-cn/agents ⭐ 4,480
An Open-source Framework for Autonomous Language Agents
🔗 www.aiwaves-agents.com
facebookresearch/DrQA ⭐ 4,456
Reading Wikipedia to Answer Open-Domain Questions
layout-parser/layout-parser ⭐ 4,426
A Unified Toolkit for Deep Learning Based Document Image Analysis
🔗 layout-parser.github.io
makcedward/nlpaug ⭐ 4,288
Data augmentation for NLP
🔗 makcedward.github.io
thilinarajapakse/simpletransformers ⭐ 3,971
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
🔗 simpletransformers.ai
life4/textdistance ⭐ 3,295
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
jsvine/markovify ⭐ 3,266
A simple, extensible Markov chain generator.
maartengr/KeyBERT ⭐ 3,199
Minimal keyword extraction with BERT
🔗 maartengr.github.io/keybert
argilla-io/argilla ⭐ 3,082
Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
🔗 docs.argilla.io
bytedance/lightseq ⭐ 3,077
LightSeq: A High Performance Library for Sequence Processing and Generation
errbotio/errbot ⭐ 3,058
Errbot is a chatbot, a daemon that connects to your favorite chat service and bring your tools and some fun into the conversation.
🔗 errbot.io
promptslab/Promptify ⭐ 3,007
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
🔗 discord.gg/m88xfymbk6
huawei-noah/Pretrained-Language-Model ⭐ 2,952
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
jbesomi/texthero ⭐ 2,862
Text preprocessing, representation and visualization from zero to hero.
🔗 texthero.org
neuralmagic/deepsparse ⭐ 2,858
Sparsity-aware deep learning inference runtime for CPUs
🔗 neuralmagic.com/deepsparse
ddangelov/Top2Vec ⭐ 2,834
Top2Vec learns jointly embedded topic, document and word vectors.
huggingface/neuralcoref ⭐ 2,801
✨Fast Coreference Resolution in spaCy with Neural Networks
🔗 huggingface.co/coref
salesforce/CodeT5 ⭐ 2,575
Home of CodeT5: Open Code LLMs for Code Understanding and Generation
🔗 arxiv.org/abs/2305.07922
bigscience-workshop/promptsource ⭐ 2,476
Toolkit for creating, sharing and using natural language prompts.
jamesturk/jellyfish ⭐ 1,987
🪼 a python library for doing approximate and phonetic matching of strings.
🔗 jamesturk.github.io/jellyfish
huggingface/setfit ⭐ 1,939
Efficient few-shot learning with Sentence Transformers
🔗 hf.co/docs/setfit
alibaba/EasyNLP ⭐ 1,934
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
thudm/P-tuning-v2 ⭐ 1,875
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
deepset-ai/FARM ⭐ 1,722
🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
🔗 farm.deepset.ai
marella/ctransformers ⭐ 1,677
Python bindings for the Transformer models implemented in C/C++ using GGML library.
franck-dernoncourt/NeuroNER ⭐ 1,675
Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.
🔗 neuroner.com
featureform/featureform ⭐ 1,672
The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
🔗 www.featureform.com
plasticityai/magnitude ⭐ 1,610
A fast, efficient universal vector embedding utility package.
arxiv-vanity/arxiv-vanity ⭐ 1,594
Renders papers from arXiv as responsive web pages so you don't have to squint at a PDF.
🔗 www.arxiv-vanity.com
google-research/language ⭐ 1,555
Shared repository for open-sourced projects from the Google AI Language team.
🔗 ai.google/research/teams/language
explosion/spacy-models ⭐ 1,501
💫 Models for the spaCy Natural Language Processing (NLP) library
🔗 spacy.io
chrismattmann/tika-python ⭐ 1,405
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
dmmiller612/bert-extractive-summarizer ⭐ 1,344
Easy to use extractive text summarization with BERT
gunthercox/chatterbot-corpus ⭐ 1,339
A multilingual dialog corpus
🔗 chatterbot-corpus.readthedocs.io
jonasgeiping/cramming ⭐ 1,228
Cramming the training of a (BERT-type) language model into limited compute.
abertsch72/unlimiformer ⭐ 1,030
Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
nomic-ai/nomic ⭐ 984
Interact, analyze and structure massive text, image, embedding, audio and video datasets
🔗 atlas.nomic.ai
norskregnesentral/skweak ⭐ 909
skweak: A software toolkit for weak supervision applied to NLP tasks
intellabs/fastRAG ⭐ 873
Efficient Retrieval Augmentation and Generation Framework
pemistahl/lingua-py ⭐ 864
The most accurate natural language detection library for Python, suitable for short text and mixed-language text
openai/grade-school-math ⭐ 861
GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems
explosion/spacy-streamlit ⭐ 761
👑 spaCy building blocks and visualizers for Streamlit apps
🔗 share.streamlit.io/ines/spacy-streamlit-demo/master/app.py
paddlepaddle/RocketQA ⭐ 739
🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.
explosion/spacy-stanza ⭐ 710
💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy
keras-team/keras-nlp ⭐ 689
Modular Natural Language Processing workflows with Keras
urchade/GLiNER ⭐ 543
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 24
🔗 arxiv.org/abs/2311.08526

Packaging

Python packaging, dependency management and bundling.

pyenv/pyenv ⭐ 36,490
pyenv lets you easily switch between multiple versions of Python.
python-poetry/poetry ⭐ 29,335
Python packaging and dependency management made easy
🔗 python-poetry.org
pypa/pipenv ⭐ 24,569
A virtualenv management tool that supports a multitude of systems and nicely bridges the gaps between pip, python and virtualenv.
🔗 pipenv.pypa.io
pyinstaller/pyinstaller ⭐ 11,246
Freeze (package) Python programs into stand-alone executables
🔗 www.pyinstaller.org
mitsuhiko/rye ⭐ 11,159
a Hassle-Free Python Experience
🔗 rye-up.com
astral-sh/uv ⭐ 10,810
An extremely fast Python package installer and resolver, written in Rust. Designed as a drop-in replacement for pip and pip-compile.
🔗 astral.sh
pypa/pipx ⭐ 8,717
Install and Run Python Applications in Isolated Environments
🔗 pipx.pypa.io
jazzband/pip-tools ⭐ 7,453
A set of tools to keep your pinned Python dependencies fresh (pip-compile + pip-sync)
🔗 pip-tools.rtfd.io
pdm-project/pdm ⭐ 6,438
A modern Python package and dependency manager supporting the latest PEP standards
🔗 pdm-project.org
mamba-org/mamba ⭐ 6,198
The Fast Cross-Platform Package Manager: mamba is a reimplementation of the conda package manager in C++
🔗 mamba.readthedocs.io
conda/conda ⭐ 6,069
A system-level, binary package and environment manager running on all major operating systems and platforms.
🔗 docs.conda.io/projects/conda
pypa/hatch ⭐ 5,267
Modern, extensible Python project management
🔗 hatch.pypa.io/latest
conda-forge/miniforge ⭐ 5,204
A conda-forge distribution.
🔗 conda-forge.org/miniforge
indygreg/PyOxidizer ⭐ 5,174
A modern Python application packaging and distribution tool
pypa/virtualenv ⭐ 4,708
A tool to create isolated Python environments. Since Python 3.3, a subset of it has been integrated into the standard lib venv module.
🔗 virtualenv.pypa.io
spack/spack ⭐ 3,933
A flexible package manager that supports multiple versions, configurations, platforms, and compilers.
🔗 spack.io
pantsbuild/pex ⭐ 2,448
A tool for generating .pex (Python EXecutable) files, lock files and venvs.
🔗 docs.pex-tool.org
beeware/briefcase ⭐ 2,312
Tools to support converting a Python project into a standalone native application.
🔗 briefcase.readthedocs.io
pypa/flit ⭐ 2,090
Simplified packaging of Python modules
🔗 flit.pypa.io
prefix-dev/pixi ⭐ 1,833
pixi is a cross-platform, multi-language package manager and workflow tool built on the foundation of the conda ecosystem.
🔗 pixi.sh
linkedin/shiv ⭐ 1,687
shiv is a command line utility for building fully self contained Python zipapps as outlined in PEP 441, but with all their dependencies included.
marcelotduarte/cx_Freeze ⭐ 1,239
Create standalone executables from Python scripts, with the same performance and is cross-platform.
🔗 marcelotduarte.github.io/cx_freeze
ofek/pyapp ⭐ 1,039
Runtime installer for Python applications
🔗 ofek.dev/pyapp
pypa/gh-action-pypi-publish ⭐ 832
The blessed GitHub Action, for publishing your 📦 distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
🔗 packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows
py2exe/py2exe ⭐ 742
Create standalone Windows programs from Python code
🔗 www.py2exe.org
prefix-dev/rip ⭐ 614
RIP is a library that allows the resolving and installing of Python PyPI packages from Rust into a virtual environment. It's based on our experience with building Rattler and aims to provide the same experience but for PyPI instead of Conda.
🔗 prefix.dev
snok/install-poetry ⭐ 526
Github action for installing and configuring Poetry
python-poetry/install.python-poetry.org ⭐ 172
The official Poetry installation script
🔗 install.python-poetry.org

Pandas

Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations.

pandas-dev/pandas ⭐ 41,850
Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
🔗 pandas.pydata.org
pola-rs/polars ⭐ 25,822
Dataframes powered by a multithreaded, vectorized query engine, written in Rust
🔗 docs.pola.rs
duckdb/duckdb ⭐ 16,322
DuckDB is an in-process SQL OLAP Database Management System
🔗 www.duckdb.org
ydataai/ydata-profiling ⭐ 11,992
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
🔗 docs.profiling.ydata.ai
gventuri/pandas-ai ⭐ 10,803
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
🔗 pandas-ai.com
kanaries/pygwalker ⭐ 9,625
PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis
🔗 kanaries.net/pygwalker
rapidsai/cudf ⭐ 7,235
cuDF is a GPU DataFrame library for loading joining, aggregating, filtering, and otherwise manipulating data
🔗 docs.rapids.ai/api/cudf/stable
aws/aws-sdk-pandas ⭐ 3,791
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
🔗 aws-sdk-pandas.readthedocs.io
nalepae/pandarallel ⭐ 3,482
A simple and efficient tool to parallelize Pandas operations on all available CPUs
🔗 nalepae.github.io/pandarallel
blaze/blaze ⭐ 3,182
NumPy and Pandas interface to Big Data
🔗 blaze.pydata.org
adamerose/PandasGUI ⭐ 3,123
A GUI for Pandas DataFrames
unionai-oss/pandera ⭐ 2,976
A light-weight, flexible, and expressive statistical data testing library
🔗 www.union.ai/pandera
pydata/pandas-datareader ⭐ 2,811
Extract data from a wide range of Internet sources into a pandas DataFrame.
🔗 pydata.github.io/pandas-datareader/stable/index.html
scikit-learn-contrib/sklearn-pandas ⭐ 2,785
Pandas integration with sklearn
jmcarpenter2/swifter ⭐ 2,457
A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
fugue-project/fugue ⭐ 1,866
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
🔗 fugue-tutorials.readthedocs.io
delta-io/delta-rs ⭐ 1,797
A native Rust library for Delta Lake, with bindings into Python
🔗 delta-io.github.io/delta-rs
eventual-inc/Daft ⭐ 1,653
Distributed DataFrame for Python designed for the cloud, powered by Rust
🔗 getdaft.io
pyjanitor-devs/pyjanitor ⭐ 1,276
Clean APIs for data cleaning. Python implementation of R package Janitor
🔗 pyjanitor-devs.github.io/pyjanitor
machow/siuba ⭐ 1,099
Python library for using dplyr like syntax with pandas and SQL
🔗 siuba.org
renumics/spotlight ⭐ 1,001
Interactively explore unstructured datasets from your dataframe.
🔗 renumics.com
holoviz/hvplot ⭐ 933
A high-level plotting API for pandas, dask, xarray, and networkx built on HoloViews
🔗 hvplot.holoviz.org
tkrabel/bamboolib ⭐ 933
bamboolib - a GUI for pandas DataFrames
🔗 bamboolib.com

Performance

Performance, parallelisation and low level libraries.

celery/celery ⭐ 23,395
Distributed Task Queue (development branch)
🔗 docs.celeryq.dev
google/flatbuffers ⭐ 21,988
FlatBuffers: Memory Efficient Serialization Library
🔗 flatbuffers.dev
pybind/pybind11 ⭐ 14,701
Seamless operability between C++11 and Python
🔗 pybind11.readthedocs.io
exaloop/codon ⭐ 13,810
A high-performance, zero-overhead, extensible Python compiler using LLVM
🔗 docs.exaloop.io/codon
dask/dask ⭐ 11,965
Parallel computing with task scheduling
🔗 dask.org
modin-project/modin ⭐ 9,454
Modin: Scale your Pandas workflows by changing a single line of code
🔗 modin.readthedocs.io
numba/numba ⭐ 9,401
NumPy aware dynamic Python compiler using LLVM
🔗 numba.pydata.org
nebuly-ai/nebuly ⭐ 8,371
The user analytics platform for LLMs
🔗 www.nebuly.com
vaexio/vaex ⭐ 8,170
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
🔗 vaex.io
mher/flower ⭐ 6,151
Real-time monitor and web admin for Celery distributed task queue
🔗 flower.readthedocs.io
python-trio/trio ⭐ 5,857
Trio – a friendly Python library for async concurrency and I/O
🔗 trio.readthedocs.io
ultrajson/ultrajson ⭐ 4,242
Ultra fast JSON decoder and encoder written in C with Python bindings
🔗 pypi.org/project/ujson
facebookincubator/cinder ⭐ 3,365
Cinder is Meta's internal performance-oriented production version of CPython.
🔗 trycinder.com
tlkh/asitop ⭐ 2,798
Perf monitoring CLI tool for Apple Silicon
🔗 tlkh.github.io/asitop
ipython/ipyparallel ⭐ 2,547
IPython Parallel: Interactive Parallel Computing in Python
🔗 ipyparallel.readthedocs.io
h5py/h5py ⭐ 1,991
HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5 binary data format.
🔗 www.h5py.org
intel/intel-extension-for-transformers ⭐ 1,909
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
airtai/faststream ⭐ 1,742
FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
🔗 faststream.airt.ai/latest
faster-cpython/ideas ⭐ 1,646
Discussion and work tracker for Faster CPython project.
agronholm/anyio ⭐ 1,597
High level asynchronous concurrency and networking framework that works on top of either trio or asyncio
dask/distributed ⭐ 1,539
A distributed task scheduler for Dask
🔗 distributed.dask.org
tiangolo/asyncer ⭐ 1,424
Asyncer, async and await, focused on developer experience.
🔗 asyncer.tiangolo.com
intel/intel-extension-for-pytorch ⭐ 1,317
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
nschloe/perfplot ⭐ 1,292
📈 Performance analysis for Python snippets
intel/scikit-learn-intelex ⭐ 1,152
Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
🔗 intel.github.io/scikit-learn-intelex
markshannon/faster-cpython ⭐ 937
How to make CPython faster.
zerointensity/pointers.py ⭐ 883
Bringing the hell of pointers to Python.
🔗 pointers.zintensity.dev
brandtbucher/specialist ⭐ 609
Visualize CPython's specializing, adaptive interpreter. 🔥

Profiling

Memory and CPU/GPU profiling tools and libraries.

bloomberg/memray ⭐ 12,482
Memray is a memory profiler for Python
🔗 bloomberg.github.io/memray
benfred/py-spy ⭐ 11,797
Sampling profiler for Python programs
plasma-umass/scalene ⭐ 11,074
Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals
joerick/pyinstrument ⭐ 6,090
🚴 Call stack profiler for Python. Shows you why your code is slow!
🔗 pyinstrument.readthedocs.io
gaogaotiantian/viztracer ⭐ 4,304
VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.
🔗 viztracer.readthedocs.io
pythonprofilers/memory_profiler ⭐ 4,201
Monitor Memory usage of Python code
🔗 pypi.python.org/pypi/memory_profiler
reloadware/reloadium ⭐ 2,686
Hot Reloading and Profiling for Python
🔗 reloadium.io
pyutils/line_profiler ⭐ 2,461
Line-by-line profiling for Python
jiffyclub/snakeviz ⭐ 2,222
An in-browser Python profile viewer
🔗 jiffyclub.github.io/snakeviz
p403n1x87/austin ⭐ 1,350
Python frame stack sampler for CPython
🔗 pypi.org/project/austin-dist
pythonspeed/filprofiler ⭐ 810
A Python memory profiler for data processing and scientific computing applications
🔗 pythonspeed.com/products/filmemoryprofiler

Security

Security related libraries: vulnerability discovery, SQL injection, environment auditing.

swisskyrepo/PayloadsAllTheThings ⭐ 56,521
A list of useful payloads and bypass for Web Application Security and Pentest/CTF
🔗 swisskyrepo.github.io/payloadsallthethings
certbot/certbot ⭐ 30,779
Certbot is EFF's tool to obtain certs from Let's Encrypt and (optionally) auto-enable HTTPS on your server. It can also act as a client for any other CA that uses the ACME protocol.
sqlmapproject/sqlmap ⭐ 30,444
Automatic SQL injection and database takeover tool
🔗 sqlmap.org
aquasecurity/trivy ⭐ 21,213
Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
🔗 aquasecurity.github.io/trivy
bridgecrewio/checkov ⭐ 6,490
Checkov is a static code analysis tool for infrastructure as code (IaC) and also a software composition analysis (SCA) tool for images and open source packages.
🔗 www.checkov.io
nccgroup/ScoutSuite ⭐ 6,131
Multi-Cloud Security Auditing Tool
pycqa/bandit ⭐ 5,944
Bandit is a tool designed to find common security issues in Python code.
🔗 bandit.readthedocs.io
stamparm/maltrail ⭐ 5,724
Malicious traffic detection system
rhinosecuritylabs/pacu ⭐ 4,003
The AWS exploitation framework, designed for testing the security of Amazon Web Services environments.
🔗 rhinosecuritylabs.com/aws/pacu-open-source-aws-exploitation-framework
dashingsoft/pyarmor ⭐ 2,868
A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts.
🔗 pyarmor.dashingsoft.com
pyupio/safety ⭐ 1,623
Safety checks Python dependencies for known security vulnerabilities and suggests the proper remediations for vulnerabilities detected.
🔗 safetycli.com/product/safety-cli
luijait/DarkGPT ⭐ 1,336
DarkGPT is an OSINT assistant based on GPT-4-200K (recommended use) designed to perform queries on leaked databases, thus providing an artificial intelligence assistant that can be useful in your traditional OSINT processes.
trailofbits/pip-audit ⭐ 912
Audits Python environments, requirements files and dependency trees for known security vulnerabilities, and can automatically fix them
🔗 pypi.org/project/pip-audit
fadi002/de4py ⭐ 749
toolkit for python reverse engineering
🔗 de4py.000.pe

Simulation

Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover.

atsushisakai/PythonRobotics ⭐ 21,568
Python sample codes for robotics algorithms.
🔗 atsushisakai.github.io/pythonrobotics
bulletphysics/bullet3 ⭐ 11,861
Bullet Physics SDK: real-time collision detection and multi-physics simulation for VR, games, visual effects, robotics, machine learning etc.
🔗 bulletphysics.org
isl-org/Open3D ⭐ 10,415
Open3D: A Modern Library for 3D Data Processing
🔗 www.open3d.org
qiskit/qiskit ⭐ 4,560
Qiskit is an open-source SDK for working with quantum computers at the level of extended quantum circuits, operators, and primitives.
🔗 www.ibm.com/quantum/qiskit
astropy/astropy ⭐ 4,200
Astronomy and astrophysics core library
🔗 www.astropy.org
quantumlib/Cirq ⭐ 4,114
A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.
openai/mujoco-py ⭐ 2,734
MuJoCo is a physics engine for detailed, efficient rigid body simulations with contacts. mujoco-py allows using MuJoCo from Python 3.
rdkit/rdkit ⭐ 2,399
The official sources for the RDKit library
taichi-dev/difftaichi ⭐ 2,384
10 differentiable physical simulators built with Taichi differentiable programming (DiffTaichi, ICLR 2020)
projectmesa/mesa ⭐ 2,204
Mesa is an open-source Python library for agent-based modeling, ideal for simulating complex systems and exploring emergent behaviors.
🔗 mesa.readthedocs.io
google/brax ⭐ 2,047
Massively parallel rigidbody physics simulation on accelerator hardware.
quantecon/QuantEcon.py ⭐ 1,853
A community based Python library for quantitative economics
🔗 quantecon.org/quantecon-py
microsoft/PromptCraft-Robotics ⭐ 1,693
Community for applying LLMs to robotics and a robot simulator with ChatGPT integration
🔗 aka.ms/chatgpt-robotics
facebookresearch/habitat-lab ⭐ 1,692
A modular high-level library to train embodied AI agents across a variety of tasks and environments.
🔗 aihabitat.org
nvidia/warp ⭐ 1,662
A Python framework for high performance GPU simulation and graphics
🔗 nvidia.github.io/warp
nvidia-omniverse/IsaacGymEnvs ⭐ 1,584
Isaac Gym Reinforcement Learning Environments
deepmodeling/deepmd-kit ⭐ 1,352
A deep learning package for many-body potential energy representation and molecular dynamics
🔗 docs.deepmodeling.com/projects/deepmd
sail-sg/envpool ⭐ 1,009
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
🔗 envpool.readthedocs.io
a-r-j/graphein ⭐ 971
Protein Graph Library
🔗 graphein.ai
hardmaru/estool ⭐ 919
Evolution Strategies Tool
viblo/pymunk ⭐ 874
Pymunk is a easy-to-use pythonic 2d physics library that can be used whenever you need 2d rigid body physics from Python
🔗 www.pymunk.org
facebookresearch/fairo ⭐ 829
A modular embodied agent architecture and platform for building embodied agents
bowang-lab/scGPT ⭐ 813
scGPT: Towards Building a Foundation Model for Single-Cell Multi-omics Using Generative AI
🔗 scgpt.readthedocs.io/en/latest
google-deepmind/materials_discovery ⭐ 778
Graph Networks for Materials Science (GNoME) is a project centered around scaling machine learning methods to tackle materials science.
google/evojax ⭐ 776
EvoJAX is a scalable, general purpose, hardware-accelerated neuroevolution toolkit built on the JAX library
nvidia-omniverse/orbit ⭐ 719
Unified framework for robot learning built on NVIDIA Isaac Sim
🔗 isaac-orbit.github.io/orbit
nvidia-omniverse/OmniIsaacGymEnvs ⭐ 658
Reinforcement Learning Environments for Omniverse Isaac Gym

Study

Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials.

thealgorithms/Python ⭐ 177,754
All Algorithms implemented in Python
🔗 the-algorithms.com
jakevdp/PythonDataScienceHandbook ⭐ 41,373
Python Data Science Handbook: full text in Jupyter Notebooks
🔗 jakevdp.github.io/pythondatasciencehandbook
microsoft/generative-ai-for-beginners ⭐ 41,252
18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
🔗 microsoft.github.io/generative-ai-for-beginners
mlabonne/llm-course ⭐ 28,052
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
🔗 mlabonne.github.io/blog
realpython/python-guide ⭐ 27,577
Python best practices guidebook, written for humans.
🔗 docs.python-guide.org
christoschristofidis/awesome-deep-learning ⭐ 22,741
A curated list of awesome Deep Learning tutorials, projects and communities.
d2l-ai/d2l-en ⭐ 21,555
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
🔗 d2l.ai
wesm/pydata-book ⭐ 21,255
Materials and IPython notebooks for "Python for Data Analysis" by Wes McKinney, published by O'Reilly Media
microsoft/recommenders ⭐ 17,892
Best Practices on Recommendation Systems
🔗 recommenders-team.github.io/recommenders/intro.html
fchollet/deep-learning-with-python-notebooks ⭐ 17,735
Jupyter notebooks for the code samples of the book "Deep Learning with Python"
hannibal046/Awesome-LLM ⭐ 13,940
Awesome-LLM: a curated list of Large Language Model
graykode/nlp-tutorial ⭐ 13,649
Natural Language Processing Tutorial for Deep Learning Researchers
🔗 www.reddit.com/r/machinelearning/comments/amfinl/project_nlptutoral_repository_who_is_studying
shangtongzhang/reinforcement-learning-an-introduction ⭐ 13,151
Python Implementation of Reinforcement Learning: An Introduction
karpathy/nn-zero-to-hero ⭐ 10,264
Neural Networks: Zero to Hero
eugeneyan/open-llms ⭐ 10,056
📋 A list of open LLMs available for commercial use.
openai/spinningup ⭐ 9,595
An educational resource to help anyone learn deep reinforcement learning.
🔗 spinningup.openai.com
mooler0410/LLMsPracticalGuide ⭐ 8,428
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
🔗 arxiv.org/abs/2304.13712v2
karpathy/micrograd ⭐ 8,140
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
mrdbourke/pytorch-deep-learning ⭐ 7,818
Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
🔗 learnpytorch.io
nielsrogge/Transformers-Tutorials ⭐ 7,407
This repository contains demos I made with the Transformers library by HuggingFace.
firmai/industry-machine-learning ⭐ 7,008
A curated list of applied machine learning and data science notebooks and libraries across different industries (by @firmai)
🔗 www.linkedin.com/company/firmai
zhanymkanov/fastapi-best-practices ⭐ 6,837
FastAPI Best Practices and Conventions we used at our startup
gkamradt/langchain-tutorials ⭐ 6,186
Overview and tutorial of the LangChain Library
udacity/deep-learning-v2-pytorch ⭐ 5,160
Projects and exercises for the latest Deep Learning ND program https://www.udacity.com/course/deep-learning-nanodegree--nd101
neetcode-gh/leetcode ⭐ 5,029
Leetcode solutions for NeetCode.io
srush/GPU-Puzzles ⭐ 4,973
Teaching beginner GPU programming in a completely interactive fashion
mrdbourke/tensorflow-deep-learning ⭐ 4,832
All course materials for the Zero to Mastery Deep Learning with TensorFlow course.
🔗 dbourke.link/ztmtfcourse
udlbook/udlbook ⭐ 4,707
Understanding Deep Learning - Simon J.D. Prince
timofurrer/awesome-asyncio ⭐ 4,388
A curated list of awesome Python asyncio frameworks, libraries, software and resources
zotroneneis/machine_learning_basics ⭐ 4,194
Plain python implementations of basic machine learning algorithms
roboflow/notebooks ⭐ 4,103
Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.
🔗 roboflow.com/models
huggingface/deep-rl-class ⭐ 3,579
This repo contains the syllabus of the Hugging Face Deep Reinforcement Learning Course.
cosmicpython/book ⭐ 3,243
A Book about Pythonic Application Architecture Patterns for Managing Complexity. Cosmos is the Opposite of Chaos you see. O'R. wouldn't actually let us call it "Cosmic Python" tho.
🔗 www.cosmicpython.com
alirezadir/Machine-Learning-Interviews ⭐ 3,227
This repo is meant to serve as a guide for Machine Learning/AI technical interviews.
huggingface/diffusion-models-class ⭐ 3,195
Materials for the Hugging Face Diffusion Models Course
promptslab/Awesome-Prompt-Engineering ⭐ 3,150
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
🔗 discord.gg/m88xfymbk6
fluentpython/example-code-2e ⭐ 2,893
Example code for Fluent Python, 2nd edition (O'Reilly 2022)
🔗 amzn.to/3j48u2j
rasbt/machine-learning-book ⭐ 2,820
Code Repository for Machine Learning with PyTorch and Scikit-Learn
🔗 sebastianraschka.com/books/#machine-learning-with-pytorch-and-scikit-learn
amanchadha/coursera-deep-learning-specialization ⭐ 2,658
Notes, programming assignments and quizzes from all courses within the Coursera Deep Learning specialization offered by deeplearning.ai: (i) Neural Networks and Deep Learning; (ii) Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization; (iii) Structuring Machine Learning Projects; (iv...
mrdbourke/zero-to-mastery-ml ⭐ 2,555
All course materials for the Zero to Mastery Machine Learning and Data Science course.
🔗 dbourke.link/ztmmlcourse
krzjoa/awesome-python-data-science ⭐ 2,296
Probably the best curated list of data science software in Python.
🔗 krzjoa.github.io/awesome-python-data-science
cgpotts/cs224u ⭐ 2,055
Code for CS224u: Natural Language Understanding
cerlymarco/MEDIUM_NoteBook ⭐ 2,016
Repository containing notebooks of my posts on Medium
trananhkma/fucking-awesome-python ⭐ 1,961
awesome-python with ⭐ and 🍴
gerdm/prml ⭐ 1,796
Repository of notes, code and notebooks in Python for the book Pattern Recognition and Machine Learning by Christopher Bishop
atcold/NYU-DLSP21 ⭐ 1,489
NYU Deep Learning Spring 2021
🔗 atcold.github.io/nyu-dlsp21
chandlerbang/awesome-self-supervised-gnn ⭐ 1,453
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
huggingface/cookbook ⭐ 1,229
Community-driven practical examples of building AI applications and solving various tasks with AI using open-source tools and models.
🔗 huggingface.co/learn/cookbook
patrickloeber/MLfromscratch ⭐ 1,152
Machine Learning algorithm implementations from scratch.
davidadsp/Generative_Deep_Learning_2nd_Edition ⭐ 832
The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.
🔗 www.oreilly.com/library/view/generative-deep-learning/9781098134174
jackhidary/quantumcomputingbook ⭐ 759
Companion site for the textbook Quantum Computing: An Applied Approach
dylanhogg/awesome-python ⭐ 230
🐍 Hand-picked awesome Python libraries and frameworks, organised by category
🔗 www.awesomepython.org

Template

Template tools and libraries: cookiecutter repos, generators, quick-starts.

tiangolo/full-stack-fastapi-template ⭐ 22,548
Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.
cookiecutter/cookiecutter ⭐ 21,520
A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.
🔗 pypi.org/project/cookiecutter
drivendata/cookiecutter-data-science ⭐ 7,546
A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.
🔗 drivendata.github.io/cookiecutter-data-science
buuntu/fastapi-react ⭐ 2,054
🚀 Cookiecutter Template for FastAPI + React Projects. Using PostgreSQL, SQLAlchemy, and Docker
pyscaffold/pyscaffold ⭐ 2,000
🛠 Python project template generator with batteries included
🔗 pyscaffold.org
cjolowicz/cookiecutter-hypermodern-python ⭐ 1,713
Cookiecutter template for a Python package based on the Hypermodern Python article series.
🔗 cookiecutter-hypermodern-python.readthedocs.io
tezromach/python-package-template ⭐ 1,068
🚀 Your next Python package needs a bleeding-edge project structure.
martinheinz/python-project-blueprint ⭐ 941
Blueprint/Boilerplate For Python Projects

Terminal

Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars.

willmcgugan/rich ⭐ 46,911
Rich is a Python library for rich text and beautiful formatting in the terminal.
🔗 rich.readthedocs.io/en/latest
tqdm/tqdm ⭐ 27,353
⚡ A Fast, Extensible Progress Bar for Python and CLI
🔗 tqdm.github.io
google/python-fire ⭐ 26,249
Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
willmcgugan/textual ⭐ 23,403
The lean application framework for Python. Build sophisticated user interfaces with a simple Python API. Run your apps in the terminal and a web browser.
🔗 textual.textualize.io
pallets/click ⭐ 14,977
Python composable command line interface toolkit
🔗 click.palletsprojects.com
tiangolo/typer ⭐ 14,253
Typer, build great CLIs. Easy to code. Based on Python type hints.
🔗 typer.tiangolo.com
saulpw/visidata ⭐ 7,385
A terminal spreadsheet multitool for discovering and arranging data
🔗 visidata.org
manrajgrover/halo ⭐ 2,847
💫 Beautiful spinners for terminal, IPython and Jupyter
urwid/urwid ⭐ 2,718
Console user interface library for Python (official repo)
🔗 urwid.org
tconbeer/harlequin ⭐ 2,414
The SQL IDE for Your Terminal.
🔗 harlequin.sh
textualize/trogon ⭐ 2,331
Easily turn your Click CLI into a powerful terminal application
tmbo/questionary ⭐ 1,405
Python library to build pretty command line user prompts ✨Easy to use multi-select lists, confirmations, free text prompts ...
jazzband/prettytable ⭐ 1,239
Display tabular data in a visually appealing ASCII table format
🔗 pypi.org/project/prettytable
1j01/textual-paint ⭐ 908
🎨 MS Paint in your terminal.
🔗 pypi.org/project/textual-paint

Testing

Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins.

locustio/locust ⭐ 23,561
Write scalable load tests in plain Python 🚗💨
pytest-dev/pytest ⭐ 11,327
The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
🔗 pytest.org
microsoft/playwright-python ⭐ 10,579
Python version of the Playwright testing and automation library.
🔗 playwright.dev/python
robotframework/robotframework ⭐ 9,007
Generic automation framework for acceptance testing and RPA
🔗 robotframework.org
getmoto/moto ⭐ 7,363
A library that allows you to easily mock out tests based on AWS infrastructure.
🔗 docs.getmoto.org/en/latest
hypothesisworks/hypothesis ⭐ 7,247
Hypothesis is a powerful, flexible, and easy to use library for property-based testing.
🔗 hypothesis.works
newsapps/beeswithmachineguns ⭐ 6,388
A utility for arming (creating) many bees (micro EC2 instances) to attack (load test) targets (web applications).
🔗 apps.chicagotribune.com
seleniumbase/SeleniumBase ⭐ 4,157
📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
🔗 seleniumbase.io
getsentry/responses ⭐ 4,039
A utility for mocking out the Python Requests library.
spulec/freezegun ⭐ 3,966
Let your Python tests travel through time
tox-dev/tox ⭐ 3,508
Command line driven CI frontend and development task automation tool.
🔗 tox.wiki
behave/behave ⭐ 3,059
BDD, Python style.
🔗 behave.readthedocs.io/en/latest
nedbat/coveragepy ⭐ 2,818
The code coverage tool for Python
🔗 coverage.readthedocs.io
cobrateam/splinter ⭐ 2,683
splinter - python test framework for web applications
🔗 splinter.readthedocs.org/en/stable/index.html
kevin1024/vcrpy ⭐ 2,602
Automatically mock your HTTP interactions to simplify and speed up testing
pytest-dev/pytest-testinfra ⭐ 2,318
With Testinfra you can write unit tests in Python to test actual state of your servers configured by management tools like Salt, Ansible, Puppet, Chef and so on.
🔗 testinfra.readthedocs.io
pytest-dev/pytest-mock ⭐ 1,753
Thin-wrapper around the mock package for easier use with pytest
🔗 pytest-mock.readthedocs.io/en/latest
pytest-dev/pytest-cov ⭐ 1,655
Coverage plugin for pytest.
confident-ai/deepeval ⭐ 1,629
The LLM Evaluation Framework
🔗 docs.confident-ai.com
pytest-dev/pytest-xdist ⭐ 1,350
pytest plugin for distributed testing and loop-on-failures testing modes.
🔗 pytest-xdist.readthedocs.io
pytest-dev/pytest-asyncio ⭐ 1,313
Asyncio support for pytest
🔗 pytest-asyncio.readthedocs.io
taverntesting/tavern ⭐ 989
A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax
🔗 taverntesting.github.io

Machine Learning - Time Series

Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics.

facebook/prophet ⭐ 17,706
Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
🔗 facebook.github.io/prophet
blue-yonder/tsfresh ⭐ 8,066
Automatic extraction of relevant features from time series:
🔗 tsfresh.readthedocs.io
sktime/sktime ⭐ 7,377
A unified framework for machine learning with time series
🔗 www.sktime.net
unit8co/darts ⭐ 7,213
A python library for user-friendly forecasting and anomaly detection on time series.
🔗 unit8co.github.io/darts
facebookresearch/Kats ⭐ 4,737
Kats, a kit to analyze time series data, a lightweight, easy-to-use, generalizable, and extendable framework to perform time series analysis, from understanding the key statistics and characteristics, detecting change points and anomalies, to forecasting future trends.
awslabs/gluonts ⭐ 4,254
Probabilistic time series modeling in Python
🔗 ts.gluon.ai
nixtla/statsforecast ⭐ 3,512
Lightning ⚡️ fast forecasting with statistical and econometric models.
🔗 nixtlaverse.nixtla.io/statsforecast
salesforce/Merlion ⭐ 3,249
Merlion: A Machine Learning Framework for Time Series Intelligence
tdameritrade/stumpy ⭐ 2,979
STUMPY is a powerful and scalable Python library for modern time series analysis
🔗 stumpy.readthedocs.io/en/latest
rjt1990/pyflux ⭐ 2,085
Open source time series library for Python
aistream-peelout/flow-forecast ⭐ 1,872
Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).
🔗 flow-forecast.atlassian.net/wiki/spaces/ff/overview
uber/orbit ⭐ 1,797
A Python package for Bayesian forecasting with object-oriented design and probabilistic models under the hood.
🔗 orbit-ml.readthedocs.io/en/stable
alkaline-ml/pmdarima ⭐ 1,513
A statistical library designed to fill the void in Python's time series analysis capabilities, including the equivalent of R's auto.arima function.
🔗 www.alkaline-ml.com/pmdarima
amazon-science/chronos-forecasting ⭐ 1,503
Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
winedarksea/AutoTS ⭐ 998
Automated Time Series Forecasting
time-series-foundation-models/lag-llama ⭐ 913
Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
autoviml/Auto_TS ⭐ 670
Automatically build ARIMA, SARIMAX, VAR, FB Prophet and XGBoost Models on Time Series data sets with a Single Line of Code. Created by Ram Seshadri. Collaborators welcome.
google/temporian ⭐ 616
Temporian is an open-source Python library for preprocessing ⚡ and feature engineering 🛠 temporal data 📈 for machine learning applications 🤖
🔗 temporian.readthedocs.io

Typing

Typing libraries: static and run-time type checking, annotations.

python/mypy ⭐ 17,489
Optional static typing for Python
🔗 www.mypy-lang.org
microsoft/pyright ⭐ 11,960
Static Type Checker for Python
facebook/pyre-check ⭐ 6,673
Performant type-checking for python.
🔗 pyre-check.org
python-attrs/attrs ⭐ 5,062
Python Classes Without Boilerplate
🔗 www.attrs.org
google/pytype ⭐ 4,531
A static type analyzer for Python code
🔗 google.github.io/pytype
instagram/MonkeyType ⭐ 4,524
A Python library that generates static type annotations by collecting runtime types
python/typeshed ⭐ 4,048
Collection of library stubs for Python, with static types
microsoft/pylance-release ⭐ 1,651
Fast, feature-rich language support for Python. Documentation and issues for Pylance.
agronholm/typeguard ⭐ 1,428
Run-time type checker for Python
mtshiba/pylyzer ⭐ 1,364
A fast static code analyzer & language server for Python
🔗 mtshiba.github.io/pylyzer
patrick-kidger/torchtyping ⭐ 1,331
Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.
robertcraigie/pyright-python ⭐ 135
Python command line wrapper for pyright, a static type checker
🔗 pypi.org/project/pyright

Utility

General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools.

yt-dlp/yt-dlp ⭐ 69,805
A feature-rich command-line audio/video downloader
🔗 discord.gg/h5mncfw63r
home-assistant/core ⭐ 68,363
🏡 Open source home automation that puts local control and privacy first.
🔗 www.home-assistant.io
python/cpython ⭐ 59,378
The Python programming language
🔗 www.python.org
localstack/localstack ⭐ 51,999
💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
🔗 localstack.cloud
faif/python-patterns ⭐ 39,317
A collection of design patterns/idioms in Python
mingrammer/diagrams ⭐ 34,763
🎨 Diagram as Code for prototyping cloud system architectures
🔗 diagrams.mingrammer.com
ggerganov/whisper.cpp ⭐ 29,528
Port of OpenAI's Whisper model in C/C++
keon/algorithms ⭐ 23,511
Minimal examples of data structures and algorithms in Python
norvig/pytudes ⭐ 22,322
Python programs, usually short, of considerable difficulty, to perfect particular skills.
modularml/mojo ⭐ 20,163
The Mojo Programming Language
🔗 docs.modular.com/mojo
openai/openai-python ⭐ 19,631
The official Python library for the OpenAI API
🔗 pypi.org/project/openai
facebookresearch/audiocraft ⭐ 19,485
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
pydantic/pydantic ⭐ 18,467
Data validation using Python type hints
🔗 docs.pydantic.dev
micropython/micropython ⭐ 18,286
MicroPython - a lean and efficient Python implementation for microcontrollers and constrained systems
🔗 micropython.org
mkdocs/mkdocs ⭐ 18,202
Project documentation with Markdown.
🔗 www.mkdocs.org
squidfunk/mkdocs-material ⭐ 18,127
Documentation that simply works
🔗 squidfunk.github.io/mkdocs-material
delgan/loguru ⭐ 17,968
Python logging made (stupidly) simple
rustpython/RustPython ⭐ 17,483
A Python Interpreter written in Rust
🔗 rustpython.github.io
kivy/kivy ⭐ 16,888
Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
🔗 kivy.org
ipython/ipython ⭐ 16,129
Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.
🔗 ipython.readthedocs.org
alievk/avatarify-python ⭐ 16,091
Avatars for Zoom, Skype and other video-conferencing apps.
blakeblackshear/frigate ⭐ 14,480
NVR with realtime local object detection for IP cameras
🔗 frigate.video
zulko/moviepy ⭐ 11,722
Video editing with Python
🔗 zulko.github.io/moviepy
python-pillow/Pillow ⭐ 11,652
Python Imaging Library (Fork)
🔗 python-pillow.org
dbader/schedule ⭐ 11,463
Python job scheduling for humans.
🔗 schedule.readthedocs.io
pyodide/pyodide ⭐ 11,351
Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
🔗 pyodide.org/en/stable
pyo3/pyo3 ⭐ 10,919
Rust bindings for the Python interpreter
🔗 pyo3.rs
openai/triton ⭐ 10,810
Development repository for the Triton language and compiler
🔗 triton-lang.org
nuitka/Nuitka ⭐ 10,700
Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4, 3.5, 3.6, 3.7, 3.8, 3.9, 3.10, and 3.11. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
🔗 nuitka.net
ninja-build/ninja ⭐ 10,463
Ninja is a small build system with a focus on speed.
🔗 ninja-build.org
caronc/apprise ⭐ 10,337
Apprise - Push Notifications that work with just about every platform!
🔗 hub.docker.com/r/caronc/apprise
pytube/pytube ⭐ 10,228
A lightweight, dependency-free Python library (and command-line utility) for downloading YouTube Videos.
🔗 pytube.io
secdev/scapy ⭐ 10,005
Scapy: the Python-based interactive packet manipulation program & library. Supports Python 2 & Python 3.
🔗 scapy.net
magicstack/uvloop ⭐ 9,978
Ultra fast asyncio event loop.
pallets/jinja ⭐ 9,924
A very fast and expressive template engine.
🔗 jinja.palletsprojects.com
asweigart/pyautogui ⭐ 9,522
A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.
aws/serverless-application-model ⭐ 9,231
The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation templates.
🔗 aws.amazon.com/serverless/sam
cython/cython ⭐ 8,868
The most widely used Python to C compiler
🔗 cython.org
paramiko/paramiko ⭐ 8,804
The leading native Python SSHv2 protocol library.
🔗 paramiko.org
boto/boto3 ⭐ 8,674
AWS SDK for Python
🔗 aws.amazon.com/sdk-for-python
arrow-py/arrow ⭐ 8,545
🏹 Better dates & times for Python
🔗 arrow.readthedocs.io
facebookresearch/hydra ⭐ 8,143
Hydra is a framework for elegantly configuring complex applications
🔗 hydra.cc
xonsh/xonsh ⭐ 7,954
🐚 Python-powered, cross-platform, Unix-gazing shell.
🔗 xon.sh
eternnoir/pyTelegramBotAPI ⭐ 7,654
Python Telegram bot api.
kellyjonbrazil/jc ⭐ 7,497
CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.
googleapis/google-api-python-client ⭐ 7,363
🐍 The official Python client library for Google's discovery based APIs.
🔗 googleapis.github.io/google-api-python-client/docs
py-pdf/pypdf ⭐ 7,330
A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
🔗 pypdf.readthedocs.io/en/latest
theskumar/python-dotenv ⭐ 7,054
Reads key-value pairs from a .env file and can set them as environment variables. It helps in developing applications following the 12-factor principles.
🔗 saurabh-kumar.com/python-dotenv
google/latexify_py ⭐ 6,955
A library to generate LaTeX expression from Python code.
googlecloudplatform/python-docs-samples ⭐ 6,954
Code samples used on cloud.google.com
marshmallow-code/marshmallow ⭐ 6,883
A lightweight library for converting complex objects to and from simple Python datatypes.
🔗 marshmallow.readthedocs.io
hugapi/hug ⭐ 6,816
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
pygithub/PyGithub ⭐ 6,655
Typed interactions with the GitHub API v3
🔗 pygithub.readthedocs.io
openai/point-e ⭐ 6,286
Point cloud diffusion for 3D model synthesis
pyca/cryptography ⭐ 6,266
cryptography is a package designed to expose cryptographic primitives and recipes to Python developers.
🔗 cryptography.io
gorakhargosh/watchdog ⭐ 6,244
Python library and shell utilities to monitor filesystem events.
🔗 packages.python.org/watchdog
sdispater/pendulum ⭐ 6,040
Python datetimes made easy
🔗 pendulum.eustace.io
sphinx-doc/sphinx ⭐ 6,017
The Sphinx documentation generator
🔗 www.sphinx-doc.org
jd/tenacity ⭐ 5,911
Retrying library for Python
🔗 tenacity.readthedocs.io
icloud-photos-downloader/icloud_photos_downloader ⭐ 5,859
A command-line tool to download photos from iCloud
scikit-image/scikit-image ⭐ 5,858
Image processing in Python
🔗 scikit-image.org
wireservice/csvkit ⭐ 5,808
A suite of utilities for converting to and working with CSV, the king of tabular file formats.
🔗 csvkit.readthedocs.io
bndr/pipreqs ⭐ 5,797
pipreqs - Generate pip requirements.txt file based on imports of any project. Looking for maintainers to move this project forward.
agronholm/apscheduler ⭐ 5,675
Task scheduling library for Python
ijl/orjson ⭐ 5,518
Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy
pdfminer/pdfminer.six ⭐ 5,400
Community maintained fork of pdfminer - we fathom PDF
🔗 pdfminersix.readthedocs.io
pytransitions/transitions ⭐ 5,331
A lightweight, object-oriented finite state machine implementation in Python with many extensions
timdettmers/bitsandbytes ⭐ 5,308
Accessible large language models via k-bit quantization for PyTorch.
🔗 huggingface.co/docs/bitsandbytes/main/en/index
buildbot/buildbot ⭐ 5,163
Python-based continuous integration testing framework; your pull requests are more than welcome!
🔗 www.buildbot.net
rsalmei/alive-progress ⭐ 5,084
A new kind of Progress Bar, with real-time throughput, ETA, and very cool animations!
prompt-toolkit/ptpython ⭐ 5,037
A better Python REPL
pycqa/pycodestyle ⭐ 4,969
Simple Python style checker in one Python file
🔗 pycodestyle.pycqa.org
spotify/pedalboard ⭐ 4,823
🎛 🔊 A Python library for audio.
🔗 spotify.github.io/pedalboard
jorgebastida/awslogs ⭐ 4,746
AWS CloudWatch logs for Humans™
pywinauto/pywinauto ⭐ 4,598
Windows GUI Automation with Python (based on text properties)
🔗 pywinauto.github.io
hhatto/autopep8 ⭐ 4,510
A tool that automatically formats Python code to conform to the PEP 8 style guide.
🔗 pypi.org/project/autopep8
tebelorg/RPA-Python ⭐ 4,507
Python package for doing RPA
pytoolz/toolz ⭐ 4,506
A functional standard library for Python.
🔗 toolz.readthedocs.org
pyinvoke/invoke ⭐ 4,238
Pythonic task management & command execution.
🔗 pyinvoke.org
bogdanp/dramatiq ⭐ 4,043
A fast and reliable background task processing library for Python 3.
🔗 dramatiq.io
evhub/coconut ⭐ 3,939
Coconut (coconut-lang.org) is a variant of Python that adds on top of Python syntax new features for simple, elegant, Pythonic functional programming.
🔗 coconut-lang.org
adafruit/circuitpython ⭐ 3,883
CircuitPython - a Python implementation for teaching coding with microcontrollers
🔗 circuitpython.org
miguelgrinberg/python-socketio ⭐ 3,755
Python Socket.IO server and client
rspeer/python-ftfy ⭐ 3,701
Fixes mojibake and other glitches in Unicode text, after the fact.
🔗 ftfy.readthedocs.org
joblib/joblib ⭐ 3,642
Computing with Python functions.
🔗 joblib.readthedocs.org
ashleve/lightning-hydra-template ⭐ 3,641
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
ets-labs/python-dependency-injector ⭐ 3,570
Dependency injection framework for Python
🔗 python-dependency-injector.ets-labs.org
python-markdown/markdown ⭐ 3,562
A Python implementation of John Gruber’s Markdown with Extension support.
🔗 python-markdown.github.io
zeromq/pyzmq ⭐ 3,540
PyZMQ: Python bindings for zeromq
🔗 zguide.zeromq.org/py:all
pypi/warehouse ⭐ 3,459
The Python Package Index
🔗 pypi.org
more-itertools/more-itertools ⭐ 3,416
More routines for operating on iterables, beyond itertools
🔗 more-itertools.rtfd.io
tartley/colorama ⭐ 3,416
Simple cross-platform colored terminal text in Python
pydata/xarray ⭐ 3,392
N-D labeled arrays and datasets in Python
🔗 xarray.dev
osohq/oso ⭐ 3,376
Oso is a batteries-included framework for building authorization in your application.
🔗 docs.osohq.com
jorisschellekens/borb ⭐ 3,277
borb is a library for reading, creating and manipulating PDF files in python.
🔗 borbpdf.com
suor/funcy ⭐ 3,260
A fancy and practical functional tools
pyo3/maturin ⭐ 3,210
Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages
🔗 maturin.rs
pyserial/pyserial ⭐ 3,094
Python serial port access library
spotify/basic-pitch ⭐ 2,889
A lightweight yet powerful audio-to-MIDI converter with pitch bend detection
🔗 basicpitch.io
tox-dev/pipdeptree ⭐ 2,670
A command line utility to display dependency tree of the installed Python packages
🔗 pypi.python.org/pypi/pipdeptree
legrandin/pycryptodome ⭐ 2,652
A self-contained cryptographic library for Python
🔗 www.pycryptodome.org
camelot-dev/camelot ⭐ 2,627
A Python library to extract tabular data from PDFs
🔗 camelot-py.readthedocs.io
pyinfra-dev/pyinfra ⭐ 2,626
pyinfra automates infrastructure using Python. It’s fast and scales from one server to thousands. Great for ad-hoc command execution, service deployment, configuration management and more.
🔗 pyinfra.com
liiight/notifiers ⭐ 2,598
The easy way to send notifications
🔗 notifiers.readthedocs.io
lxml/lxml ⭐ 2,566
The lxml XML toolkit for Python
🔗 lxml.de
whylabs/whylogs ⭐ 2,535
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
🔗 whylogs.readthedocs.io
pexpect/pexpect ⭐ 2,524
A Python module for controlling interactive programs in a pseudo-terminal
🔗 pexpect.readthedocs.io
pyston/pyston ⭐ 2,489
A faster and highly-compatible implementation of the Python programming language.
🔗 www.pyston.org
scrapinghub/dateparser ⭐ 2,458
python parser for human readable dates
dosisod/refurb ⭐ 2,444
A tool for refurbishing and modernizing Python codebases
yaml/pyyaml ⭐ 2,419
Canonical source repository for PyYAML
cdgriffith/Box ⭐ 2,352
Python dictionaries with advanced dot notation access
🔗 github.com/cdgriffith/box/wiki
nschloe/tikzplotlib ⭐ 2,300
📊 Save matplotlib figures as TikZ/PGFplots for smooth integration into LaTeX.
pypa/setuptools ⭐ 2,299
Official project repository for the Setuptools build system
🔗 pypi.org/project/setuptools
hgrecco/pint ⭐ 2,253
Operate and manipulate physical quantities in Python
🔗 pint.readthedocs.org
dateutil/dateutil ⭐ 2,239
Useful extensions to the standard Python datetime features
ianmiell/shutit ⭐ 2,147
Automation framework for programmers
🔗 ianmiell.github.io/shutit
grantjenks/python-diskcache ⭐ 2,144
Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
🔗 www.grantjenks.com/docs/diskcache
pndurette/gTTS ⭐ 2,132
Python library and CLI tool to interface with Google Translate's text-to-speech API
🔗 gtts.readthedocs.org
kiminewt/pyshark ⭐ 2,113
Python wrapper for tshark, allowing python packet parsing using wireshark dissectors
pyparsing/pyparsing ⭐ 2,083
Python library for creating PEG parsers
libaudioflux/audioFlux ⭐ 2,038
A library for audio and music analysis, feature extraction.
🔗 audioflux.top
google/gin-config ⭐ 1,989
Gin provides a lightweight configuration framework for Python
grahamdumpleton/wrapt ⭐ 1,970
A Python module for decorators, wrappers and monkey patching.
astanin/python-tabulate ⭐ 1,958
Pretty-print tabular data in Python, a library and a command-line utility. Repository migrated from bitbucket.org/astanin/python-tabulate.
🔗 pypi.org/project/tabulate
pyfilesystem/pyfilesystem2 ⭐ 1,944
Python's Filesystem abstraction layer
🔗 www.pyfilesystem.org
landscapeio/prospector ⭐ 1,905
Inspects Python source files and provides information about type and location of classes, methods etc
nateshmbhat/pyttsx3 ⭐ 1,892
Offline Text To Speech synthesis for python
julienpalard/Pipe ⭐ 1,852
A Python library to use infix notation in Python
jcrist/msgspec ⭐ 1,839
A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
🔗 jcristharif.com/msgspec
python-rope/rope ⭐ 1,830
a python refactoring library
chaostoolkit/chaostoolkit ⭐ 1,825
Chaos Engineering Toolkit & Orchestration for Developers
🔗 chaostoolkit.org
numba/llvmlite ⭐ 1,818
A lightweight LLVM python binding for writing JIT compilers
🔗 llvmlite.pydata.org
carpedm20/emoji ⭐ 1,811
emoji terminal output for Python
mitmproxy/pdoc ⭐ 1,804
API Documentation for Python Projects
🔗 pdoc.dev
joowani/binarytree ⭐ 1,801
Python Library for Studying Binary Trees
🔗 binarytree.readthedocs.io
omry/omegaconf ⭐ 1,784
Flexible Python configuration system. The last one you will ever need.
pydoit/doit ⭐ 1,780
task management & automation tool
🔗 pydoit.org
pygments/pygments ⭐ 1,699
Pygments is a generic syntax highlighter written in Python
🔗 pygments.org
kalliope-project/kalliope ⭐ 1,693
Kalliope is a framework that will help you to create your own personal assistant.
🔗 kalliope-project.github.io
rhettbull/osxphotos ⭐ 1,672
Python app to export pictures and associated metadata from Apple Photos on macOS. Also includes a package to provide programmatic access to the Photos library, pictures, and metadata.
konradhalas/dacite ⭐ 1,648
Simple creation of data classes from dictionaries.
home-assistant/supervisor ⭐ 1,639
🏡 Home Assistant Supervisor
🔗 home-assistant.io/hassio
rubik/radon ⭐ 1,592
Various code metrics for Python code
🔗 radon.readthedocs.org
open-telemetry/opentelemetry-python ⭐ 1,586
OpenTelemetry Python API and SDK
🔗 opentelemetry.io
samuelcolvin/watchfiles ⭐ 1,581
Simple, modern and fast file watching and code reload in python.
🔗 watchfiles.helpmanual.io
p0dalirius/Coercer ⭐ 1,552
A python script to automatically coerce a Windows server to authenticate on an arbitrary machine through 12 methods.
🔗 podalirius.net
mkdocstrings/mkdocstrings ⭐ 1,549
📘 Automatic documentation from sources, for MkDocs.
🔗 mkdocstrings.github.io
facebookincubator/Bowler ⭐ 1,511
Safe code refactoring for modern Python.
🔗 pybowler.io
hbldh/bleak ⭐ 1,506
A cross platform Bluetooth Low Energy Client for Python using asyncio
nficano/python-lambda ⭐ 1,476
A toolkit for developing and deploying serverless Python code in AWS Lambda.
quodlibet/mutagen ⭐ 1,438
Python module for handling audio metadata
🔗 mutagen.readthedocs.io
instagram/LibCST ⭐ 1,403
A concrete syntax tree parser and serializer library for Python that preserves many aspects of Python's abstract syntax tree
🔗 libcst.readthedocs.io
fabiocaccamo/python-benedict ⭐ 1,400
📘 dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, html, ini, json, pickle, plist, query-string, toml, xls, xml, yaml), s3 support and many utilities.
aws-samples/aws-glue-samples ⭐ 1,389
AWS Glue code samples
pycqa/pyflakes ⭐ 1,337
A simple program which checks Python source files for errors
🔗 pypi.org/project/pyflakes
lidatong/dataclasses-json ⭐ 1,295
Easily serialize Data Classes to and from JSON
lcompilers/lpython ⭐ 1,287
Python compiler
🔗 lpython.org
ossf/criticality_score ⭐ 1,280
Gives criticality score for an open source project
brandon-rhodes/python-patterns ⭐ 1,256
Source code behind the python-patterns.guide site by Brandon Rhodes
aio-libs/yarl ⭐ 1,218
Yet another URL library
🔗 yarl.aio-libs.org
oracle/graalpython ⭐ 1,103
A Python 3 implementation built on GraalVM
pdoc3/pdoc ⭐ 1,087
🐍 ➡️ 📜 Auto-generate API documentation for Python projects
🔗 pdoc3.github.io/pdoc
c4urself/bump2version ⭐ 1,035
Version-bump your software with a single command
🔗 pypi.python.org/pypi/bump2version
metachris/logzero ⭐ 1,030
Robust and effective logging for Python 2 and 3.
🔗 logzero.readthedocs.io
pyo3/rust-numpy ⭐ 1,010
PyO3-based Rust bindings of the NumPy C-API
pyfpdf/fpdf2 ⭐ 929
Simple PDF generation for Python
🔗 py-pdf.github.io/fpdf2
fastai/fastcore ⭐ 897
Python supercharged for the fastai library
🔗 fastcore.fast.ai
anthropics/anthropic-sdk-python ⭐ 870
SDK providing access to Anthropic's safety-first language model APIs
fsspec/filesystem_spec ⭐ 869
A specification that python filesystems should adhere to.
alex-sherman/unsync ⭐ 867
Unsynchronize asyncio
milvus-io/pymilvus ⭐ 858
Python SDK for Milvus.
lastmile-ai/aiconfig ⭐ 825
AIConfig saves prompts, models and model parameters as source control friendly configs. This allows you to iterate on prompts and model parameters separately from your application code.
🔗 aiconfig.lastmileai.dev
samuelcolvin/dirty-equals ⭐ 761
Doing dirty (but extremely useful) things with equals.
🔗 dirty-equals.helpmanual.io
barracuda-fsh/pyobd ⭐ 726
open source obd2 car diagnostics program - reuploaded
pypy/pypy ⭐ 700
PyPy is a very fast and compliant implementation of the Python language.
🔗 pypy.org
pypa/build ⭐ 652
A simple, correct Python build frontend
🔗 build.pypa.io
instagram/Fixit ⭐ 649
Advanced Python linting framework with auto-fixes and hierarchical configuration that makes it easy to write custom in-repo lint rules.
🔗 fixit.rtfd.io/en/latest
gefyrahq/gefyra ⭐ 616
Blazingly-fast 🚀, rock-solid, local application development ➡️ with Kubernetes.
🔗 gefyra.dev
open-telemetry/opentelemetry-python-contrib ⭐ 604
OpenTelemetry instrumentation for Python modules
🔗 opentelemetry.io
qdrant/qdrant-client ⭐ 600
Python client for Qdrant vector search engine
🔗 qdrant.tech
methexis-inc/terminal-copilot ⭐ 563
A smart terminal assistant that helps you find the right command.
fastai/ghapi ⭐ 508
A delightful and complete interface to GitHub's amazing API
🔗 ghapi.fast.ai
steamship-core/steamship-langchain ⭐ 501
steamship-langchain
google/pyglove ⭐ 318
Manipulating Python Programs

Vizualisation

Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL.

apache/superset ⭐ 58,562
Apache Superset is a Data Visualization and Data Exploration Platform
🔗 superset.apache.org
streamlit/streamlit ⭐ 31,332
Streamlit — A faster way to build and share data apps.
🔗 streamlit.io
gradio-app/gradio ⭐ 28,460
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
🔗 www.gradio.app
plotly/dash ⭐ 20,425
Data Apps & Dashboards for Python. No JavaScript Required.
🔗 plotly.com/dash
matplotlib/matplotlib ⭐ 19,177
matplotlib: plotting with Python
🔗 matplotlib.org/stable
bokeh/bokeh ⭐ 18,792
Interactive Data Visualization in the browser, from Python
🔗 bokeh.org
plotly/plotly.py ⭐ 15,188
The interactive graphing library for Python ✨ This project now includes Plotly Express!
🔗 plotly.com/python
mwaskom/seaborn ⭐ 11,909
Statistical data visualization in Python
🔗 seaborn.pydata.org
visgl/deck.gl ⭐ 11,673
WebGL2 powered visualization framework
🔗 deck.gl
marceloprates/prettymaps ⭐ 10,806
A small set of Python functions to draw pretty maps from OpenStreetMap data. Based on osmnx, matplotlib and shapely libraries.
altair-viz/altair ⭐ 8,876
Declarative statistical visualization library for Python
🔗 altair-viz.github.io
nvidia/TensorRT-LLM ⭐ 6,336
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT...
🔗 nvidia.github.io/tensorrt-llm
lux-org/lux ⭐ 4,902
Automatically visualize your pandas dataframe via a single print! 📊 💡
man-group/dtale ⭐ 4,527
Visualizer for pandas data structures
🔗 alphatechadmin.pythonanywhere.com
renpy/renpy ⭐ 4,523
The Ren'Py Visual Novel Engine
🔗 www.renpy.org
holoviz/panel ⭐ 4,154
Panel: The powerful data exploration & web app framework for Python
🔗 panel.holoviz.org
has2k1/plotnine ⭐ 3,803
A Grammar of Graphics for Python
🔗 plotnine.org
residentmario/missingno ⭐ 3,803
missingno provides a small toolset of flexible and easy-to-use missing data visualizations and utilities that allows you to get a quick visual summary of the completeness (or lack thereof) of your dataset.
pyqtgraph/pyqtgraph ⭐ 3,660
Fast data visualization and GUI tools for scientific / engineering applications
🔗 www.pyqtgraph.org
vispy/vispy ⭐ 3,212
Main repository for Vispy
🔗 vispy.org
ml-tooling/opyrator ⭐ 3,011
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
🔗 opyrator-playground.mltooling.org
netflix/flamescope ⭐ 2,984
FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.
facebookresearch/hiplot ⭐ 2,696
HiPlot makes understanding high dimensional data easy
🔗 facebookresearch.github.io/hiplot
holoviz/holoviews ⭐ 2,610
With Holoviews, your data visualizes itself.
🔗 holoviews.org
kozea/pygal ⭐ 2,599
pygal is a dynamic SVG charting library written in python.
🔗 www.pygal.org
mckinsey/vizro ⭐ 2,351
Vizro is a toolkit for creating modular data visualization applications.
🔗 vizro.readthedocs.io/en/stable
pyvista/pyvista ⭐ 2,333
3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)
🔗 docs.pyvista.org
marcomusy/vedo ⭐ 1,904
A python module for scientific analysis of 3D data based on VTK and Numpy
🔗 vedo.embl.es
datapane/datapane ⭐ 1,346
Build and share data reports in 100% Python
🔗 datapane.com
facultyai/dash-bootstrap-components ⭐ 1,051
Bootstrap components for Plotly Dash
🔗 dash-bootstrap-components.opensource.faculty.ai
nomic-ai/deepscatter ⭐ 964
Zoomable, animated scatterplots in the browser that scales over a billion points
hazyresearch/meerkat ⭐ 807
Creative interactive views of any dataset.
holoviz/holoviz ⭐ 781
High-level tools to simplify visualization in Python.
🔗 holoviz.org

Web

Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management.

django/django ⭐ 76,586
The Web framework for perfectionists with deadlines.
🔗 www.djangoproject.com
tiangolo/fastapi ⭐ 70,494
FastAPI framework, high performance, easy to learn, fast to code, ready for production
🔗 fastapi.tiangolo.com
pallets/flask ⭐ 66,245
The Python micro framework for building web applications.
🔗 flask.palletsprojects.com
psf/requests ⭐ 51,298
A simple, yet elegant, HTTP library.
🔗 requests.readthedocs.io/en/latest
sherlock-project/sherlock ⭐ 51,051
🔎 Hunt down social media accounts by username across social networks
🔗 sherlock-project.github.io
tornadoweb/tornado ⭐ 21,488
Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
🔗 www.tornadoweb.org
huge-success/sanic ⭐ 17,707
Accelerate your web app development | Build fast. Run fast.
🔗 sanic.dev
pyscript/pyscript ⭐ 17,422
A framework that allows users to create rich Python applications in the browser using HTML's interface and the power of Pyodide, WASM, and modern web technologies.
🔗 pyscript.net
wagtail/wagtail ⭐ 17,138
A Django content management system focused on flexibility and user experience
🔗 wagtail.org
reflex-dev/reflex ⭐ 15,798
🕸️ Web apps in pure Python 🐍
🔗 reflex.dev
aio-libs/aiohttp ⭐ 14,525
Asynchronous HTTP client/server framework for asyncio and Python
🔗 docs.aiohttp.org
getpelican/pelican ⭐ 12,205
Static site generator that supports Markdown and reST syntax. Powered by Python.
🔗 getpelican.com
encode/httpx ⭐ 12,194
A next generation HTTP client for Python. 🦋
🔗 www.python-httpx.org
aws/chalice ⭐ 10,281
Python Serverless Microframework for AWS
benoitc/gunicorn ⭐ 9,480
gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.
🔗 www.gunicorn.org
encode/starlette ⭐ 9,444
The little ASGI framework that shines. 🌟
🔗 www.starlette.io
falconry/falcon ⭐ 9,379
The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.
🔗 falcon.readthedocs.io/en/stable
flet-dev/flet ⭐ 9,016
Flet enables developers to easily build realtime web, mobile and desktop apps in Python. No frontend experience required.
🔗 flet.dev
bottlepy/bottle ⭐ 8,281
bottle.py is a fast and simple micro-framework for python web-applications.
🔗 bottlepy.org
graphql-python/graphene ⭐ 7,969
GraphQL framework for Python
🔗 graphene-python.org
encode/uvicorn ⭐ 7,774
An ASGI web server, for Python. 🦄
🔗 www.uvicorn.org
reactive-python/reactpy ⭐ 7,650
ReactPy is a library for building user interfaces in Python without Javascript
🔗 reactpy.dev
zauberzeug/nicegui ⭐ 7,088
Create web-based user interfaces with Python. The nice way.
🔗 nicegui.io
pyeve/eve ⭐ 6,657
REST API framework designed for human beings
🔗 python-eve.org
pallets/werkzeug ⭐ 6,532
The comprehensive WSGI web application library.
🔗 werkzeug.palletsprojects.com
vitalik/django-ninja ⭐ 6,148
💨 Fast, Async-ready, Openapi, type hints based framework for building APIs
🔗 django-ninja.dev
webpy/webpy ⭐ 5,870
web.py is a web framework for python that is as simple as it is powerful.
🔗 webpy.org
stephenmcd/mezzanine ⭐ 4,712
CMS framework for Django
🔗 mezzanine.jupo.org
nameko/nameko ⭐ 4,649
A microservices framework for Python that lets service developers concentrate on application logic and encourages testability.
🔗 www.nameko.io
starlite-api/litestar ⭐ 4,369
Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs
🔗 litestar.dev
pywebio/PyWebIO ⭐ 4,317
Write interactive web app in script way.
🔗 pywebio.readthedocs.io
fastapi-users/fastapi-users ⭐ 4,023
Ready-to-use and customizable users management for FastAPI
🔗 fastapi-users.github.io/fastapi-users
pylons/pyramid ⭐ 3,899
Pyramid - A Python web framework
🔗 trypyramid.com
h2oai/wave ⭐ 3,849
H2O Wave is a software stack for building beautiful, low-latency, realtime, browser-based applications and dashboards entirely in Python/R without using HTML, Javascript, or CSS.
🔗 wave.h2o.ai
strawberry-graphql/strawberry ⭐ 3,748
A GraphQL library for Python that leverages type annotations 🍓
🔗 strawberry.rocks
websocket-client/websocket-client ⭐ 3,448
WebSocket client for Python
🔗 github.com/websocket-client/websocket-client
unbit/uwsgi ⭐ 3,405
uWSGI application server container
🔗 projects.unbit.it/uwsgi
pallets/quart ⭐ 2,601
An async Python micro framework for building web applications.
🔗 quart.palletsprojects.com
fastapi-admin/fastapi-admin ⭐ 2,513
A fast admin dashboard based on FastAPI and TortoiseORM with tabler ui, inspired by Django admin
🔗 fastapi-admin-docs.long2ice.io
flipkart-incubator/Astra ⭐ 2,420
Automated Security Testing For REST API's
masoniteframework/masonite ⭐ 2,144
The Modern And Developer Centric Python Web Framework. Be sure to read the documentation and join the Discord channel for questions: https://discord.gg/TwKeFahmPZ
🔗 docs.masoniteproject.com
dot-agent/nextpy ⭐ 2,092
🤖Self-Modifying App Framework from the Future 🔮
🔗 nextpy.org
python-restx/flask-restx ⭐ 2,062
Fork of Flask-RESTPlus: Fully featured framework for fast, easy and documented API development with Flask
🔗 flask-restx.readthedocs.io/en/latest
cherrypy/cherrypy ⭐ 1,779
CherryPy is a pythonic, object-oriented HTTP framework. https://cherrypy.dev
🔗 docs.cherrypy.dev
dmontagu/fastapi-utils ⭐ 1,731
Reusable utilities for FastAPI: a number of utilities to help reduce boilerplate and reuse common functionality across projects
neoteroi/BlackSheep ⭐ 1,715
Fast ASGI web framework for Python
🔗 www.neoteroi.dev/blacksheep
s3rius/FastAPI-template ⭐ 1,631
Feature rich robust FastAPI template.
jordaneremieff/mangum ⭐ 1,583
AWS Lambda support for ASGI applications
🔗 mangum.io
wtforms/wtforms ⭐ 1,458
A flexible forms validation and rendering library for Python.
🔗 wtforms.readthedocs.io
awtkns/fastapi-crudrouter ⭐ 1,301
A dynamic FastAPI router that automatically creates CRUD routes for your models
🔗 fastapi-crudrouter.awtkns.com
magicstack/httptools ⭐ 1,162
Fast HTTP parser
long2ice/fastapi-cache ⭐ 1,115
fastapi-cache is a tool to cache fastapi response and function result, with backends support redis and memcached.
🔗 github.com/long2ice/fastapi-cache
whitphx/stlite ⭐ 974
A port of Streamlit to WebAssembly, powered by Pyodide.
🔗 edit.share.stlite.net
rstudio/py-shiny ⭐ 936
Shiny for Python
🔗 shiny.posit.co/py
koxudaxi/fastapi-code-generator ⭐ 901
This code generator creates FastAPI app from an openapi file.
aeternalis-ingenium/FastAPI-Backend-Template ⭐ 550
A backend project template with FastAPI, PostgreSQL with asynchronous SQLAlchemy 2.0, Alembic for asynchronous database migration, and Docker.

Interactive version: www.awesomepython.org, Hugging Face Dataset: awesome-python

Please raise a new issue to suggest a Python repo that you would like to see added.

1,438 hand-picked awesome Python libraries and frameworks, updated 14 Apr 2024

Name		Name	Last commit message	Last commit date
Latest commit History 373 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
github_data.csv		github_data.csv
github_data.json		github_data.json

License

dylanhogg/awesome-python

Folders and files

Latest commit

History

Repository files navigation