Awesome Python

Hand-picked awesome Python libraries and frameworks, organised by category 🐍

Interactive version: www.awesomepython.org

Updated 20 Jul 2024

Categories

• Newly Created Repositories - Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here (10 repos)
• Code Quality - Code quality tooling: linters, formatters, pre-commit hooks, unused code removal (17 repos)
• Crypto and Blockchain - Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity (13 repos)
• Data - General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks (100 repos)
• Debugging - Debugging and tracing tools (9 repos)
• Diffusion Text to Image - Text-to-image diffusion model libraries, tools and apps for generating images from natural language (41 repos)
• Finance - Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives (31 repos)
• Game Development - Game development tools, engines and libraries (6 repos)
• GIS - Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections (29 repos)
• Graph - Graphs and network libraries: network analysis, graph machine learning, visualisation (6 repos)
• GUI - Graphical user interface libraries and toolkits (8 repos)
• Jupyter - Jupyter and JupyterLab and Notebook tools, libraries and plugins (24 repos)
• LLMs and ChatGPT - Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover (246 repos)
• Math and Science - Mathematical, numerical and scientific libraries (22 repos)
• Machine Learning - General - General and classical machine learning libraries. See below for other sections covering specialised ML areas (156 repos)
• Machine Learning - Deep Learning - Machine learning libraries that cross over with deep learning in some way (72 repos)
• Machine Learning - Interpretability - Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training (19 repos)
• Machine Learning - Ops - MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models (44 repos)
• Machine Learning - Reinforcement - Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF (22 repos)
• Machine Learning - Time Series - Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics (19 repos)
• Natural Language Processing - Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover (82 repos)
• Packaging - Python packaging, dependency management and bundling (28 repos)
• Pandas - Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations (24 repos)
• Performance - Performance, parallelisation and low level libraries (28 repos)
• Profiling - Memory and CPU/GPU profiling tools and libraries (11 repos)
• Security - Security related libraries: vulnerability discovery, SQL injection, environment auditing (14 repos)
• Simulation - Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover (28 repos)
• Study - Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials (55 repos)
• Template - Template tools and libraries: cookiecutter repos, generators, quick-starts (9 repos)
• Terminal - Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars (15 repos)
• Testing - Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins (24 repos)
• Typing - Typing libraries: static and run-time type checking, annotations (12 repos)
• Utility - General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools (197 repos)
• Vizualisation - Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL (33 repos)
• Web - Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management (58 repos)

Newly Created Repositories

Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here.

1. naklecha/llama3-from-scratch ⭐ 11,288
   llama3 implementation one matrix multiplication at a time

2. codium-ai/cover-agent ⭐ 4,042
   CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! 💻🤖🧪🐞
   🔗 www.codium.ai

3. blealtan/efficient-kan ⭐ 3,606
   An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).

4. google-research/timesfm ⭐ 3,171
   TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
   🔗 research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting

5. mistralai/mistral-finetune ⭐ 2,489
   A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models. It is based on LoRA.

6. pydantic/logfire ⭐ 1,707
   Uncomplicated Observability for Python and beyond! 🪵🔥
   🔗 docs.pydantic.dev/logfire

7. thudm/CogVLM2 ⭐ 1,599
   GPT4V-level open-source multi-modal model based on Llama3-8B

8. likejazz/llama3.np ⭐ 933
   llama3.np is a pure NumPy implementation for Llama 3 model.

9. eureka-research/DrEureka ⭐ 749
   Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)
   🔗 eureka-research.github.io/dr-eureka

10. prometheus-eval/prometheus-eval ⭐ 690
    Evaluate your LLM's response with Prometheus and GPT4 💯

Code Quality

Code quality tooling: linters, formatters, pre-commit hooks, unused code removal.

1. psf/black ⭐ 37,860
   The uncompromising Python code formatter
   🔗 black.readthedocs.io/en/stable

2. astral-sh/ruff ⭐ 29,132
   An extremely fast Python linter and code formatter, written in Rust.
   🔗 docs.astral.sh/ruff

3. google/yapf ⭐ 13,702
   A formatter for Python files

4. pre-commit/pre-commit ⭐ 12,444
   A framework for managing and maintaining multi-language pre-commit hooks.
   🔗 pre-commit.com

5. sqlfluff/sqlfluff ⭐ 7,428
   A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
   🔗 www.sqlfluff.com

6. pycqa/isort ⭐ 6,381
   A Python utility / library to sort imports.
   🔗 pycqa.github.io/isort

7. davidhalter/jedi ⭐ 5,731
   Awesome autocompletion, static analysis and refactoring library for python
   🔗 jedi.readthedocs.io

8. pycqa/pylint ⭐ 5,196
   It's not just a linter that annoys you!
   🔗 pylint.readthedocs.io/en/latest

9. asottile/pyupgrade ⭐ 3,430
   A tool (and pre-commit hook) to automatically upgrade syntax for newer versions of the language.

10. pycqa/flake8 ⭐ 3,351
    flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
    🔗 flake8.pycqa.org

11. jendrikseipp/vulture ⭐ 3,301
    Find dead Python code

12. wemake-services/wemake-python-styleguide ⭐ 2,466
    The strictest and most opinionated python linter ever!
    🔗 wemake-python-styleguide.rtfd.io

13. codespell-project/codespell ⭐ 1,812
    check code for common misspellings

14. python-lsp/python-lsp-server ⭐ 1,768
    Fork of the python-language-server project, maintained by the Spyder IDE team and the community

15. sourcery-ai/sourcery ⭐ 1,504
    Instant AI code reviews
    🔗 sourcery.ai

16. akaihola/darker ⭐ 624
    Apply black reformatting to Python files only in regions changed since a given commit. For a practical usage example, see the blog post at https://dev.to/akaihola/improving-python-code-incrementally-3f7a
    🔗 pypi.org/project/darker

17. tconbeer/sqlfmt ⭐ 369
    sqlfmt formats your dbt SQL files so you don't have to
    🔗 sqlfmt.com

Crypto and Blockchain

Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity.

1. ccxt/ccxt ⭐ 32,044
   A JavaScript / TypeScript / Python / C# / PHP cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges
   🔗 docs.ccxt.com

2. freqtrade/freqtrade ⭐ 26,570
   Free, open source crypto trading bot
   🔗 www.freqtrade.io

3. crytic/slither ⭐ 5,151
   Static Analyzer for Solidity and Vyper
   🔗 blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework

4. ethereum/web3.py ⭐ 4,895
   A python interface for interacting with the Ethereum blockchain and ecosystem.
   🔗 web3py.readthedocs.io

5. ethereum/consensus-specs ⭐ 3,494
   Ethereum Proof-of-Stake Consensus Specifications

6. cyberpunkmetalhead/Binance-volatility-trading-bot ⭐ 3,386
   This is a fully functioning Binance trading bot that measures the volatility of every coin on Binance and places trades with the highest gaining coins If you like this project consider donating though the Brave browser to allow me to continuously improve the script.

7. ethereum/py-evm ⭐ 2,221
   A Python implementation of the Ethereum Virtual Machine
   🔗 py-evm.readthedocs.io/en/latest

8. bmoscon/cryptofeed ⭐ 2,141
   Cryptocurrency Exchange Websocket Data Feed Handler

9. binance/binance-public-data ⭐ 1,412
   Details on how to get Binance public data

10. ofek/bit ⭐ 1,224
    Bitcoin made easy.
    🔗 ofek.dev/bit

11. man-c/pycoingecko ⭐ 1,038
    Python wrapper for the CoinGecko API

12. palkeo/panoramix ⭐ 783
    Ethereum decompiler

13. dylanhogg/awesome-crypto ⭐ 66
    A list of awesome crypto and blockchain projects
    🔗 www.awesomecrypto.xyz

Data

General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks.

1. scrapy/scrapy ⭐ 51,755
   Scrapy, a fast high-level web crawling & scraping framework for Python.
   🔗 scrapy.org

2. apache/spark ⭐ 38,960
   Apache Spark - A unified analytics engine for large-scale data processing
   🔗 spark.apache.org

3. mindsdb/mindsdb ⭐ 25,561
   The platform for building AI from enterprise data
   🔗 mindsdb.com

4. getredash/redash ⭐ 25,446
   Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
   🔗 redash.io

5. jaidedai/EasyOCR ⭐ 22,916
   Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
   🔗 www.jaided.ai

6. qdrant/qdrant ⭐ 18,898
   Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
   🔗 qdrant.tech

7. humansignal/label-studio ⭐ 17,522
   Label Studio is an open source data labeling tool. It lets you label data types like audio, text, images, videos, and time series with a simple and straightforward UI and export to various model formats.
   🔗 labelstud.io

8. joke2k/faker ⭐ 17,377
   Faker is a Python package that generates fake data for you.
   🔗 faker.readthedocs.io

9. binux/pyspider ⭐ 16,419
   A Powerful Spider(Web Crawler) System in Python.
   🔗 docs.pyspider.org

10. twintproject/twint ⭐ 15,657
    An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

11. airbytehq/airbyte ⭐ 14,891
    The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
    🔗 airbyte.com

12. apache/arrow ⭐ 13,950
    Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
    🔗 arrow.apache.org

13. chroma-core/chroma ⭐ 13,672
    the AI-native open-source embedding database
    🔗 www.trychroma.com

14. tiangolo/sqlmodel ⭐ 13,630
    SQL databases in Python, designed for simplicity, compatibility, and robustness.
    🔗 sqlmodel.tiangolo.com

15. redis/redis-py ⭐ 12,428
    Redis Python client

16. coleifer/peewee ⭐ 10,973
    a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb
    🔗 docs.peewee-orm.com

17. s0md3v/Photon ⭐ 10,697
    Incredibly fast crawler designed for OSINT.

18. avaiga/taipy ⭐ 9,894
    Turns Data and AI algorithms into production-ready web applications in no time.
    🔗 www.taipy.io

19. sqlalchemy/sqlalchemy ⭐ 9,186
    The Database Toolkit for Python
    🔗 www.sqlalchemy.org

20. simonw/datasette ⭐ 9,113
    An open source multi-tool for exploring and publishing data
    🔗 datasette.io

21. bigscience-workshop/petals ⭐ 8,934
    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
    🔗 petals.dev

22. yzhao062/pyod ⭐ 8,305
    A Python Library for Outlier and Anomaly Detection, Integrating Classical and Deep Learning Techniques
    🔗 pyod.readthedocs.io

23. voxel51/fiftyone ⭐ 7,910
    The open-source tool for building high-quality datasets and computer vision models
    🔗 fiftyone.ai

24. gristlabs/grist-core ⭐ 6,624
    Grist is the evolution of spreadsheets.
    🔗 www.getgrist.com

25. alirezamika/autoscraper ⭐ 6,078
    A Smart, Automatic, Fast and Lightweight Web Scraper for Python

26. tobymao/sqlglot ⭐ 6,066
    Python SQL Parser and Transpiler
    🔗 sqlglot.com

27. kaggle/kaggle-api ⭐ 6,041
    Official Kaggle API

28. madmaze/pytesseract ⭐ 5,673
    A Python wrapper for Google Tesseract

29. vi3k6i5/flashtext ⭐ 5,573
    Extract Keywords from sentence or Replace keywords in sentences.

30. airbnb/knowledge-repo ⭐ 5,454
    A next-generation curated knowledge sharing platform for data scientists and other technical professions.

31. facebookresearch/AugLy ⭐ 4,924
    A data augmentations library for audio, image, text, and video.
    🔗 ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models

32. ibis-project/ibis ⭐ 4,616
    Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It helps Python users explore and transform data of any size, stored anywhere.
    🔗 ibis-project.org

33. superduperdb/superduper ⭐ 4,564
    🔮 SuperDuper: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
    🔗 superduper.io

34. jazzband/tablib ⭐ 4,563
    Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c.
    🔗 tablib.readthedocs.io

35. lk-geimfari/mimesis ⭐ 4,350
    Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
    🔗 mimesis.name

36. amundsen-io/amundsen ⭐ 4,343
    Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
    🔗 www.amundsen.io/amundsen

37. mongodb/mongo-python-driver ⭐ 4,090
    PyMongo - the Official MongoDB Python driver
    🔗 pymongo.readthedocs.io

38. giskard-ai/giskard ⭐ 3,761
    🐢 Open-Source Evaluation & Testing for LLMs and ML models
    🔗 docs.giskard.ai

39. lancedb/lancedb ⭐ 3,672
    Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
    🔗 lancedb.github.io/lancedb

40. andialbrecht/sqlparse ⭐ 3,644
    A non-validating SQL parser module for Python

41. jmcnamara/XlsxWriter ⭐ 3,555
    A Python module for creating Excel XLSX files.
    🔗 xlsxwriter.readthedocs.io

42. deepchecks/deepchecks ⭐ 3,495
    Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
    🔗 docs.deepchecks.com/stable

43. rom1504/img2dataset ⭐ 3,458
    Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

44. run-llama/llama-hub ⭐ 3,425
    A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
    🔗 llamahub.ai

45. praw-dev/praw ⭐ 3,403
    PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
    🔗 praw.readthedocs.io

46. pyeve/cerberus ⭐ 3,126
    Lightweight, extensible data validation library for Python
    🔗 python-cerberus.org

47. datafold/data-diff ⭐ 2,920
    Compare tables within or across databases
    🔗 docs.datafold.com

48. zoomeranalytics/xlwings ⭐ 2,906
    xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows and macOS as well as with Google Sheets and Excel on the web.
    🔗 www.xlwings.org

49. pallets/itsdangerous ⭐ 2,864
    Safely pass trusted data to untrusted environments and back.
    🔗 itsdangerous.palletsprojects.com

50. docarray/docarray ⭐ 2,861
    Represent, send, store and search multimodal data
    🔗 docs.docarray.org

51. goldsmith/Wikipedia ⭐ 2,855
    A Pythonic wrapper for the Wikipedia API
    🔗 wikipedia.readthedocs.org

52. pathwaycom/pathway ⭐ 2,847
    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
    🔗 pathway.com

53. awslabs/amazon-redshift-utils ⭐ 2,731
    Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

54. sqlalchemy/alembic ⭐ 2,606
    A database migrations tool for SQLAlchemy.

55. kayak/pypika ⭐ 2,443
    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
    🔗 pypika.readthedocs.io/en/latest

56. pynamodb/PynamoDB ⭐ 2,405
    A pythonic interface to Amazon's DynamoDB
    🔗 pynamodb.readthedocs.io

57. rapidai/RapidOCR ⭐ 2,372
    Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle. （将PaddleOCR模型做了转换，采用ONNXRuntime推理，速度很快）
    🔗 rapidai.github.io/rapidocrdocs

58. emirozer/fake2db ⭐ 2,272
    Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, couchdb.

59. sdv-dev/SDV ⭐ 2,223
    Synthetic data generation for tabular data
    🔗 docs.sdv.dev/sdv

60. uqfoundation/dill ⭐ 2,207
    serialize all of Python
    🔗 dill.rtfd.io

61. accenture/AmpliGraph ⭐ 2,121
    Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org

62. graphistry/pygraphistry ⭐ 2,101
    PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer

63. dlt-hub/dlt ⭐ 2,033
    data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
    🔗 dlthub.com/docs

64. samuelcolvin/arq ⭐ 2,029
    Fast job queuing and RPC in python with asyncio and redis.
    🔗 arq-docs.helpmanual.io

65. sfu-db/connector-x ⭐ 1,871
    Fastest library to load data from DB to DataFrames in Rust and Python
    🔗 sfu-db.github.io/connector-x

66. agronholm/sqlacodegen ⭐ 1,793
    Automatic model code generator for SQLAlchemy

67. huggingface/datatrove ⭐ 1,786
    Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

68. uber/petastorm ⭐ 1,766
    Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

69. milvus-io/bootcamp ⭐ 1,726
    Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
    🔗 milvus.io

70. aio-libs/aiomysql ⭐ 1,723
    aiomysql is a library for accessing a MySQL database from the asyncio
    🔗 aiomysql.rtfd.io

71. aminalaee/sqladmin ⭐ 1,718
    SQLAlchemy Admin for FastAPI and Starlette
    🔗 aminalaee.dev/sqladmin

72. simple-salesforce/simple-salesforce ⭐ 1,628
    A very simple Salesforce.com REST API client for Python

73. collerek/ormar ⭐ 1,622
    python async orm with fastapi in mind and pydantic validation
    🔗 collerek.github.io/ormar

74. simonw/sqlite-utils ⭐ 1,572
    Python CLI utility and library for manipulating SQLite databases
    🔗 sqlite-utils.datasette.io

75. eleutherai/the-pile ⭐ 1,438
    The Pile is a large, diverse, open source language modelling data set that consists of many smaller datasets combined together.

76. sdispater/orator ⭐ 1,430
    The Orator ORM provides a simple yet beautiful ActiveRecord implementation.
    🔗 orator-orm.com

77. mchong6/JoJoGAN ⭐ 1,413
    Official PyTorch repo for JoJoGAN: One Shot Face Stylization

78. zarr-developers/zarr-python ⭐ 1,407
    An implementation of chunked, compressed, N-dimensional arrays for Python.
    🔗 zarr.readthedocs.io

79. aio-libs/aiopg ⭐ 1,385
    aiopg is a library for accessing a PostgreSQL database from the asyncio
    🔗 aiopg.readthedocs.io

80. ydataai/ydata-synthetic ⭐ 1,377
    Synthetic data generators for tabular and time-series data
    🔗 docs.synthetic.ydata.ai

81. google/tensorstore ⭐ 1,322
    Library for reading and writing large multi-dimensional arrays.
    🔗 google.github.io/tensorstore

82. scholarly-python-package/scholarly ⭐ 1,296
    Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!
    🔗 scholarly.readthedocs.io

83. eliasdabbas/advertools ⭐ 1,099
    advertools - online marketing productivity and analysis tools
    🔗 advertools.readthedocs.io

84. pytorch/data ⭐ 1,086
    A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

85. aio-libs/aiocache ⭐ 1,074
    Asyncio cache manager for redis, memcached and memory
    🔗 aiocache.readthedocs.io

86. brettkromkamp/contextualise ⭐ 1,043
    Contextualise is an effective tool particularly suited for organising information-heavy projects and activities consisting of unstructured and widely diverse data and information resources
    🔗 contextualise.dev

87. uber/fiber ⭐ 1,041
    Distributed Computing for AI Made Simple
    🔗 uber.github.io/fiber

88. intake/intake ⭐ 994
    Intake is a lightweight package for finding, investigating, loading and disseminating data.
    🔗 intake.readthedocs.io

89. scikit-hep/awkward ⭐ 813
    Manipulate JSON-like data with NumPy-like idioms.
    🔗 awkward-array.org

90. duckdb/dbt-duckdb ⭐ 807
    dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)

91. koaning/human-learn ⭐ 788
    Natural Intelligence is still a pretty good idea.
    🔗 koaning.github.io/human-learn

92. goccy/bigquery-emulator ⭐ 770
    BigQuery emulator provides a way to launch a BigQuery server on your local machine for testing and development.

93. macbre/sql-metadata ⭐ 767
    Uses tokenized query returned by python-sqlparse and generates query metadata
    🔗 pypi.python.org/pypi/sql-metadata

94. hyperqueryhq/whale ⭐ 724
    🐳 The stupidly simple CLI workspace for your data warehouse.
    🔗 rsyi.gitbook.io/whale

95. googleapis/python-bigquery ⭐ 719
    Python Client for Google BigQuery

96. dgarnitz/vectorflow ⭐ 656
    VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
    🔗 www.getvectorflow.com

97. kagisearch/vectordb ⭐ 595
    A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.
    🔗 vectordb.com

98. igorbenav/fastcrud ⭐ 565
    FastCRUD is a Python package for FastAPI, offering robust async CRUD operations and flexible endpoint creation utilities.

99. jina-ai/vectordb ⭐ 509
    A Python vector database you just need - no more, no less.

100. koaning/bulk ⭐ 471
     Bulk is a quick UI developer tool to apply some bulk labels.

Debugging

Debugging and tracing tools.

1. cool-rr/PySnooper ⭐ 16,300
   Never use print for debugging again

2. gruns/icecream ⭐ 8,692
   🍦 Never use print() to debug again.

3. shobrook/rebound ⭐ 4,092
   Command-line tool that instantly fetches Stack Overflow results when an exception is thrown

4. inducer/pudb ⭐ 2,914
   Full-screen console debugger for Python
   🔗 documen.tician.de/pudb

5. gotcha/ipdb ⭐ 1,836
   Integration of IPython pdb

6. alexmojaki/heartrate ⭐ 1,749
   Simple real time visualisation of the execution of a Python program.

7. alexmojaki/birdseye ⭐ 1,643
   Graphical Python debugger which lets you easily view the values of all evaluated expressions
   🔗 birdseye.readthedocs.io

8. alexmojaki/snoop ⭐ 1,222
   A powerful set of Python debugging tools, based on PySnooper

9. samuelcolvin/python-devtools ⭐ 968
   Dev tools for python
   🔗 python-devtools.helpmanual.io

Diffusion Text to Image

Text-to-image diffusion model libraries, tools and apps for generating images from natural language.

1. automatic1111/stable-diffusion-webui ⭐ 136,239
   Stable Diffusion web UI

2. compvis/stable-diffusion ⭐ 66,754
   A latent text-to-image diffusion model
   🔗 ommer-lab.com/research/latent-diffusion-models

3. comfyanonymous/ComfyUI ⭐ 42,528
   The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
   🔗 www.comfy.org

4. stability-ai/stablediffusion ⭐ 37,660
   High-Resolution Image Synthesis with Latent Diffusion Models

5. lllyasviel/ControlNet ⭐ 29,126
   Let us control diffusion models!

6. huggingface/diffusers ⭐ 24,159
   🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
   🔗 huggingface.co/docs/diffusers

7. invoke-ai/InvokeAI ⭐ 22,355
   InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multi...
   🔗 invoke-ai.github.io/invokeai

8. apple/ml-stable-diffusion ⭐ 16,491
   Stable Diffusion with Core ML on Apple Silicon

9. borisdayma/dalle-mini ⭐ 14,703
   DALL·E Mini - Generate images from a text prompt
   🔗 www.craiyon.com

10. divamgupta/diffusionbee-stable-diffusion-ui ⭐ 12,154
    Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
    🔗 diffusionbee.com

11. compvis/latent-diffusion ⭐ 11,145
    High-Resolution Image Synthesis with Latent Diffusion Models

12. lucidrains/DALLE2-pytorch ⭐ 10,974
    Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

13. instantid/InstantID ⭐ 10,520
    InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥
    🔗 instantid.github.io

14. facebookresearch/dinov2 ⭐ 8,422
    PyTorch code and models for the DINOv2 self-supervised learning method.

15. ashawkey/stable-dreamfusion ⭐ 8,027
    Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.

16. openbmb/MiniCPM-V ⭐ 7,999
    MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

17. carson-katri/dream-textures ⭐ 7,708
    Stable Diffusion built-in to Blender

18. xavierxiao/Dreambooth-Stable-Diffusion ⭐ 7,524
    Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion

19. timothybrooks/instruct-pix2pix ⭐ 6,123
    PyTorch implementation of InstructPix2Pix, an instruction-based image editing model, based on the original CompVis/stable_diffusion repo.

20. openai/consistency_models ⭐ 6,034
    Official repo for consistency models.

21. idea-research/GroundingDINO ⭐ 5,723
    [ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
    🔗 arxiv.org/abs/2303.05499

22. salesforce/BLIP ⭐ 4,487
    PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

23. nateraw/stable-diffusion-videos ⭐ 4,353
    Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts

24. opengvlab/InternVL ⭐ 4,212
    [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型
    🔗 internvl.github.io

25. jina-ai/discoart ⭐ 3,837
    🪩 Create Disco Diffusion artworks in one line

26. lkwq007/stablediffusion-infinity ⭐ 3,830
    Outpainting with Stable Diffusion on an infinite canvas

27. mlc-ai/web-stable-diffusion ⭐ 3,503
    Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
    🔗 mlc.ai/web-stable-diffusion

28. openai/glide-text2im ⭐ 3,501
    GLIDE: a diffusion-based text-conditional image synthesis model

29. openai/improved-diffusion ⭐ 3,029
    Release for Improved Denoising Diffusion Probabilistic Models

30. saharmor/dalle-playground ⭐ 2,760
    A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)

31. stability-ai/stability-sdk ⭐ 2,415
    SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)
    🔗 platform.stability.ai

32. google-research/big_vision ⭐ 2,040
    Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

33. thudm/CogVLM2 ⭐ 1,599
    GPT4V-level open-source multi-modal model based on Llama3-8B

34. divamgupta/stable-diffusion-tensorflow ⭐ 1,575
    Stable Diffusion in TensorFlow / Keras

35. coyote-a/ultimate-upscale-for-automatic1111 ⭐ 1,567
    Ultimate SD Upscale extension for AUTOMATIC1111 Stable Diffusion web UI

36. nvlabs/prismer ⭐ 1,291
    The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
    🔗 shikun.io/projects/prismer

37. chenyangqiqi/FateZero ⭐ 1,075
    [ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"
    🔗 fate-zero-edit.github.io

38. thereforegames/unprompted ⭐ 770
    Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.

39. open-compass/VLMEvalKit ⭐ 713
    Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 50+ HF models, 20+ benchmarks
    🔗 huggingface.co/spaces/opencompass/open_vlm_leaderboard

40. sharonzhou/long_stable_diffusion ⭐ 680
    Long-form text-to-images generation, using a pipeline of deep generative models (GPT-3 and Stable Diffusion)

41. tanelp/tiny-diffusion ⭐ 590
    A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.

Finance

Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives.

1. openbb-finance/OpenBB ⭐ 26,729
   Investment Research for Everyone, Everywhere.
   🔗 openbb.co

2. quantopian/zipline ⭐ 17,306
   Zipline, a Pythonic Algorithmic Trading Library
   🔗 www.zipline.io

3. microsoft/qlib ⭐ 14,635
   Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, ...
   🔗 qlib.readthedocs.io/en/latest

4. mementum/backtrader ⭐ 13,577
   Python Backtesting library for trading strategies
   🔗 www.backtrader.com

5. ai4finance-foundation/FinGPT ⭐ 12,688
   FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
   🔗 ai4finance.org

6. ranaroussi/yfinance ⭐ 12,523
   Download market data from Yahoo! Finance's API
   🔗 aroussi.com/post/python-yahoo-finance

7. ai4finance-foundation/FinRL ⭐ 9,443
   FinRL: Financial Reinforcement Learning. 🔥
   🔗 ai4finance.org

8. ta-lib/ta-lib-python ⭐ 9,269
   Python wrapper for TA-Lib (http://ta-lib.org/).
   🔗 ta-lib.github.io/ta-lib-python

9. quantconnect/Lean ⭐ 9,018
   Lean Algorithmic Trading Engine by QuantConnect (Python, C#)
   🔗 lean.io

10. goldmansachs/gs-quant ⭐ 6,633
    Python toolkit for quantitative finance
    🔗 developer.gs.com/discover/products/gs-quant

11. quantopian/pyfolio ⭐ 5,540
    Portfolio and risk analytics in Python
    🔗 quantopian.github.io/pyfolio

12. kernc/backtesting.py ⭐ 5,130
    🔎 📈 🐍 💰 Backtest trading strategies in Python.
    🔗 kernc.github.io/backtesting.py

13. twopirllc/pandas-ta ⭐ 5,016
    Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 150+ Indicators
    🔗 twopirllc.github.io/pandas-ta

14. ranaroussi/quantstats ⭐ 4,573
    Portfolio analytics for quants, written in Python

15. google/tf-quant-finance ⭐ 4,380
    High-performance TensorFlow library for quantitative finance.

16. gbeced/pyalgotrade ⭐ 4,343
    Python Algorithmic Trading Library
    🔗 gbeced.github.io/pyalgotrade

17. borisbanushev/stockpredictionai ⭐ 4,013
    In this noteboook I will create a complete process for predicting stock price movements. Follow along and we will achieve some pretty good results. For that purpose we will use a Generative Adversarial Network (GAN) with LSTM, a type of Recurrent Neural Network, as generator, and a Convolutional Neural Networ...

18. polakowo/vectorbt ⭐ 3,988
    Find your trading edge, using the fastest engine for backtesting, algorithmic trading, and research.
    🔗 vectorbt.dev

19. matplotlib/mplfinance ⭐ 3,499
    Financial Markets Data Visualization using Matplotlib
    🔗 pypi.org/project/mplfinance

20. cuemacro/finmarketpy ⭐ 3,398
    Python library for backtesting trading strategies & analyzing financial markets (formerly pythalesians)
    🔗 www.cuemacro.com

21. quantopian/alphalens ⭐ 3,187
    Performance analysis of predictive (alpha) stock factors
    🔗 quantopian.github.io/alphalens

22. zvtvz/zvt ⭐ 3,080
    modular quant framework.
    🔗 zvt.readthedocs.io/en/latest

23. robcarver17/pysystemtrade ⭐ 2,500
    Systematic Trading in python

24. quantopian/research_public ⭐ 2,364
    Quantitative research and educational materials
    🔗 www.quantopian.com/lectures

25. pmorissette/bt ⭐ 2,114
    bt - flexible backtesting for Python
    🔗 pmorissette.github.io/bt

26. blankly-finance/blankly ⭐ 2,039
    🚀 💸 Easily build, backtest and deploy your algo in just a few lines of code. Trade stocks, cryptos, and forex across exchanges w/ one package.
    🔗 package.blankly.finance

27. domokane/FinancePy ⭐ 2,009
    A Python Finance Library that focuses on the pricing and risk-management of Financial Derivatives, including fixed-income, equity, FX and credit derivatives.

28. pmorissette/ffn ⭐ 1,858
    ffn - a financial function library for Python
    🔗 pmorissette.github.io/ffn

29. cuemacro/findatapy ⭐ 1,623
    Python library to download market data via Bloomberg, Eikon, Quandl, Yahoo etc.

30. quantopian/empyrical ⭐ 1,252
    Common financial risk and performance metrics. Used by zipline and pyfolio.
    🔗 quantopian.github.io/empyrical

31. idanya/algo-trader ⭐ 761
    Trading bot with support for realtime trading, backtesting, custom strategies and much more.

Game Development

Game development tools, engines and libraries.

1. kitao/pyxel ⭐ 14,159
   A retro game engine for Python

2. pygame/pygame ⭐ 7,177
   🐍🎮 pygame (the library) is a Free and Open Source python programming language library for making multimedia applications like games built on top of the excellent SDL library. C, Python, Native, OpenGL.
   🔗 www.pygame.org

3. panda3d/panda3d ⭐ 4,373
   Powerful, mature open-source cross-platform game engine for Python and C++, developed by Disney and CMU
   🔗 www.panda3d.org

4. pokepetter/ursina ⭐ 2,138
   A game engine powered by python and panda3d.
   🔗 pokepetter.github.io/ursina

5. pyglet/pyglet ⭐ 1,814
   pyglet is a cross-platform windowing and multimedia library for Python, for developing games and other visually rich applications.
   🔗 pyglet.org

6. pythonarcade/arcade ⭐ 1,663
   Easy to use Python library for creating 2D arcade games.
   🔗 arcade.academy

GIS

Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections.

1. domlysz/BlenderGIS ⭐ 7,462
   Blender addons to make the bridge between Blender and geographic data

2. python-visualization/folium ⭐ 6,778
   Python Data. Leaflet.js Maps.
   🔗 python-visualization.github.io/folium

3. gboeing/osmnx ⭐ 4,759
   OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap.
   🔗 osmnx.readthedocs.io

4. osgeo/gdal ⭐ 4,664
   GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
   🔗 gdal.org

5. geopandas/geopandas ⭐ 4,363
   Python tools for geographic data
   🔗 geopandas.org

6. shapely/shapely ⭐ 3,760
   Manipulation and analysis of geometric objects
   🔗 shapely.readthedocs.io/en/stable

7. giswqs/geemap ⭐ 3,323
   A Python package for interactive geospatial analysis and visualization with Google Earth Engine.
   🔗 geemap.org

8. holoviz/datashader ⭐ 3,257
   Quickly and accurately render even the largest data.
   🔗 datashader.org

9. opengeos/leafmap ⭐ 3,084
   A Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment
   🔗 leafmap.org

10. opengeos/segment-geospatial ⭐ 2,769
    A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
    🔗 samgeo.gishub.org

11. google/earthengine-api ⭐ 2,593
    Python and JavaScript bindings for calling the Earth Engine API.

12. microsoft/torchgeo ⭐ 2,349
    TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
    🔗 www.osgeo.org/projects/torchgeo

13. rasterio/rasterio ⭐ 2,180
    Rasterio reads and writes geospatial raster datasets
    🔗 rasterio.readthedocs.io

14. mcordts/cityscapesScripts ⭐ 2,119
    README and scripts for the Cityscapes Dataset

15. azavea/raster-vision ⭐ 2,029
    An open source library and framework for deep learning on satellite and aerial imagery.
    🔗 docs.rastervision.io

16. apache/sedona ⭐ 1,823
    A cluster computing framework for processing large-scale geospatial data
    🔗 sedona.apache.org

17. plant99/felicette ⭐ 1,818
    Satellite imagery for dummies.

18. gboeing/osmnx-examples ⭐ 1,509
    Gallery of OSMnx tutorials, usage examples, and feature demonstations.
    🔗 osmnx.readthedocs.io

19. jupyter-widgets/ipyleaflet ⭐ 1,469
    A Jupyter - Leaflet.js bridge
    🔗 ipyleaflet.readthedocs.io

20. microsoft/GlobalMLBuildingFootprints ⭐ 1,331
    Worldwide building footprints derived from satellite imagery

21. pysal/pysal ⭐ 1,294
    PySAL: Python Spatial Analysis Library Meta-Package
    🔗 pysal.org/pysal

22. anitagraser/movingpandas ⭐ 1,178
    Movement trajectory classes and functions built on top of GeoPandas
    🔗 movingpandas.org

23. residentmario/geoplot ⭐ 1,139
    High-level geospatial data visualization library for Python.
    🔗 residentmario.github.io/geoplot/index.html

24. sentinel-hub/eo-learn ⭐ 1,098
    Earth observation processing framework for machine learning in Python
    🔗 eo-learn.readthedocs.io/en/latest

25. opengeos/streamlit-geospatial ⭐ 829
    A multi-page streamlit app for geospatial
    🔗 huggingface.co/spaces/giswqs/streamlit

26. makepath/xarray-spatial ⭐ 805
    Raster-based Spatial Analytics for Python
    🔗 xarray-spatial.readthedocs.io

27. osgeo/grass ⭐ 800
    GRASS GIS - free and open-source geospatial processing engine
    🔗 grass.osgeo.org

28. developmentseed/titiler ⭐ 724
    Build your own Raster dynamic map tile services
    🔗 developmentseed.org/titiler

29. scikit-mobility/scikit-mobility ⭐ 701
    scikit-mobility: mobility analysis in Python
    🔗 scikit-mobility.github.io/scikit-mobility

Graph

Graphs and network libraries: network analysis, graph machine learning, visualisation.

1. networkx/networkx ⭐ 14,496
   Network Analysis in Python
   🔗 networkx.org

2. stellargraph/stellargraph ⭐ 2,924
   StellarGraph - Machine Learning on Graphs
   🔗 stellargraph.readthedocs.io

3. westhealth/pyvis ⭐ 949
   Python package for creating and visualizing interactive network graphs.
   🔗 pyvis.readthedocs.io/en/latest

4. microsoft/graspologic ⭐ 680
   graspologic is a package for graph statistical algorithms
   🔗 graspologic-org.github.io/graspologic

5. rampasek/GraphGPS ⭐ 621
   Recipe for a General, Powerful, Scalable Graph Transformer

6. dylanhogg/llmgraph ⭐ 233
   Create knowledge graphs with LLMs

GUI

Graphical user interface libraries and toolkits.

1. pysimplegui/PySimpleGUI ⭐ 13,264
   Python GUIs for Humans! PySimpleGUI is the top-rated Python application development environment. Launched in 2018 and actively developed, maintained, and supported in 2024. Transforms tkinter, Qt, WxPython, and Remi into a simple, intuitive, and fun experience for both hobbyists and expert users.
   🔗 www.pysimplegui.com

2. hoffstadt/DearPyGui ⭐ 12,683
   Dear PyGui: A fast and powerful Graphical User Interface Toolkit for Python with minimal dependencies
   🔗 dearpygui.readthedocs.io/en/latest

3. parthjadhav/Tkinter-Designer ⭐ 8,667
   An easy and fast way to create a Python GUI 🐍

4. samuelcolvin/FastUI ⭐ 7,861
   FastUI is a new way to build web application user interfaces defined by declarative Python code.
   🔗 fastui-demo.onrender.com

5. r0x0r/pywebview ⭐ 4,514
   Build GUI for your Python program with JavaScript, HTML, and CSS
   🔗 pywebview.flowrl.com

6. beeware/toga ⭐ 4,215
   A Python native, OS native GUI toolkit.
   🔗 toga.readthedocs.io/en/latest

7. dddomodossola/remi ⭐ 3,481
   Python REMote Interface library. Platform independent. In about 100 Kbytes, perfect for your diet.

8. wxwidgets/Phoenix ⭐ 2,252
   wxPython's Project Phoenix. A new implementation of wxPython, better, stronger, faster than he was before.
   🔗 wxpython.org

Jupyter

Jupyter and JupyterLab and Notebook tools, libraries and plugins.

1. jupyterlab/jupyterlab ⭐ 13,972
   JupyterLab computational environment.
   🔗 jupyterlab.readthedocs.io

2. jupyter/notebook ⭐ 11,400
   Jupyter Interactive Notebook
   🔗 jupyter-notebook.readthedocs.io

3. mwouts/jupytext ⭐ 6,520
   Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
   🔗 jupytext.readthedocs.io

4. nteract/papermill ⭐ 5,725
   📚 Parameterize, execute, and analyze notebooks
   🔗 papermill.readthedocs.io/en/latest

5. connorferster/handcalcs ⭐ 5,381
   Python library for converting Python calculations into rendered latex.

6. voila-dashboards/voila ⭐ 5,330
   Voilà turns Jupyter notebooks into standalone web applications
   🔗 voila.readthedocs.io

7. executablebooks/jupyter-book ⭐ 3,777
   Create beautiful, publication-quality books and documents from computational content.
   🔗 jupyterbook.org

8. jupyterlite/jupyterlite ⭐ 3,754
   Wasm powered Jupyter running in the browser 💡
   🔗 jupyterlite.rtfd.io/en/stable/try/lab

9. jupyterlab/jupyterlab-desktop ⭐ 3,550
   JupyterLab desktop application, based on Electron.

10. jupyter-widgets/ipywidgets ⭐ 3,102
    Interactive Widgets for the Jupyter Notebook
    🔗 ipywidgets.readthedocs.io

11. quantopian/qgrid ⭐ 3,033
    An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks

12. jupyterlab/jupyter-ai ⭐ 3,017
    A generative AI extension for JupyterLab
    🔗 jupyter-ai.readthedocs.io

13. jupyter/nbdime ⭐ 2,630
    Tools for diffing and merging of Jupyter notebooks.
    🔗 nbdime.readthedocs.io

14. mito-ds/mito ⭐ 2,254
    The mitosheet package, trymito.io, and other public Mito code.
    🔗 trymito.io

15. jupyter/nbviewer ⭐ 2,189
    nbconvert as a web service: Render Jupyter Notebooks as static web pages
    🔗 nbviewer.jupyter.org

16. maartenbreddels/ipyvolume ⭐ 1,928
    3d plotting for Python in the Jupyter notebook based on IPython widgets using WebGL

17. jupyter-lsp/jupyterlab-lsp ⭐ 1,768
    Coding assistance for JupyterLab (code navigation + hover suggestions + linters + autocompletion + rename) using Language Server Protocol
    🔗 jupyterlab-lsp.readthedocs.io

18. jupyter/nbconvert ⭐ 1,694
    Jupyter Notebook Conversion
    🔗 nbconvert.readthedocs.io

19. nbqa-dev/nbQA ⭐ 997
    Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks
    🔗 nbqa.readthedocs.io/en/latest/index.html

20. vizzuhq/ipyvizzu ⭐ 933
    Build animated charts in Jupyter Notebook and similar environments with a simple Python syntax.
    🔗 ipyvizzu.vizzuhq.com

21. koaning/drawdata ⭐ 743
    Draw datasets from within Jupyter.
    🔗 calmcode.io/labs/drawdata.html

22. aws/graph-notebook ⭐ 705
    Library extending Jupyter notebooks to integrate with Apache TinkerPop, openCypher, and RDF SPARQL.
    🔗 github.com/aws/graph-notebook

23. linealabs/lineapy ⭐ 663
    Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
    🔗 lineapy.org

24. xiaohk/stickyland ⭐ 506
    Break the linear presentation of Jupyter Notebooks with sticky cells!
    🔗 xiaohk.github.io/stickyland

LLMs and ChatGPT

Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover.

1. significant-gravitas/AutoGPT ⭐ 164,660
   AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
   🔗 agpt.co

2. hwchase17/langchain ⭐ 89,354
   🦜🔗 Build context-aware reasoning applications
   🔗 python.langchain.com

3. nomic-ai/gpt4all ⭐ 67,509
   GPT4All: Chat with Local LLMs on Any Device
   🔗 gpt4all.io

4. ggerganov/llama.cpp ⭐ 61,825
   LLM inference in C/C++

5. xtekky/gpt4free ⭐ 59,326
   The official gpt4free repository | various collection of powerful language models
   🔗 g4f.ai

6. facebookresearch/llama ⭐ 54,268
   Inference code for Llama models

7. imartinez/private-gpt ⭐ 53,019
   Interact with your documents using the power of GPT, 100% privately, no data leaks
   🔗 docs.privategpt.dev

8. gpt-engineer-org/gpt-engineer ⭐ 51,432
   Specify what you want it to build, the AI asks for clarification, and then builds it.

9. killianlucas/open-interpreter ⭐ 50,936
   A natural language interface for computers
   🔗 openinterpreter.com

10. xai-org/grok-1 ⭐ 49,181
    This repository contains JAX example code for loading and running the Grok-1 open-weights model.

11. geekan/MetaGPT ⭐ 41,739
    🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
    🔗 deepwisdom.ai

12. thudm/ChatGLM-6B ⭐ 40,054
    ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

13. oobabooga/text-generation-webui ⭐ 38,493
    A Gradio web UI for Large Language Models.

14. hpcaitech/ColossalAI ⭐ 38,372
    Making large AI models cheaper, faster and more accessible
    🔗 www.colossalai.org

15. laion-ai/Open-Assistant ⭐ 36,852
    OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
    🔗 open-assistant.io

16. lm-sys/FastChat ⭐ 35,781
    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

17. karpathy/nanoGPT ⭐ 34,889
    The simplest, fastest repository for training/finetuning medium-sized GPTs.

18. moymix/TaskMatrix ⭐ 34,537
    Connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting.

19. quivrhq/quivr ⭐ 34,227
    Open-source RAG Framework for building GenAI Second Brains 🧠 Build productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Efficient retrieval augmented generation framework
    🔗 quivr.com

20. jerryjliu/llama_index ⭐ 33,698
    LlamaIndex is a data framework for your LLM applications
    🔗 docs.llamaindex.ai

21. tatsu-lab/stanford_alpaca ⭐ 29,171
    Code and documentation to train Stanford's Alpaca models, and generate the data.
    🔗 crfm.stanford.edu/2023/03/13/alpaca.html

22. pythagora-io/gpt-pilot ⭐ 29,144
    The first real AI developer

23. microsoft/autogen ⭐ 28,540
    A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
    🔗 microsoft.github.io/autogen

24. hiyouga/LLaMA-Factory ⭐ 26,660
    A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
    🔗 arxiv.org/abs/2403.13372

25. vision-cair/MiniGPT-4 ⭐ 25,163
    Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
    🔗 minigpt-4.github.io

26. microsoft/JARVIS ⭐ 23,379
    JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

27. vllm-project/vllm ⭐ 23,132
    A high-throughput and memory-efficient inference and serving engine for LLMs
    🔗 docs.vllm.ai

28. karpathy/llm.c ⭐ 22,036
    LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython

29. openai/gpt-2 ⭐ 21,993
    Code for the paper "Language Models are Unsupervised Multitask Learners"
    🔗 openai.com/blog/better-language-models

30. logspace-ai/langflow ⭐ 21,498
    ⛓️ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.
    🔗 www.langflow.org

31. openai/chatgpt-retrieval-plugin ⭐ 20,974
    The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

32. microsoft/semantic-kernel ⭐ 20,584
    Integrate cutting-edge LLM technology quickly and easily into your apps
    🔗 aka.ms/semantic-kernel

33. yoheinakajima/babyagi ⭐ 19,711
    GPT-4 powered task-driven autonomous agent

34. karpathy/minGPT ⭐ 19,475
    A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

35. danielmiessler/fabric ⭐ 19,385
    fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
    🔗 danielmiessler.com/p/fabric-origin-story

36. tloen/alpaca-lora ⭐ 18,418
    Instruct-tune LLaMA on consumer hardware

37. rasahq/rasa ⭐ 18,332
    💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
    🔗 rasa.com/docs/rasa

38. guidance-ai/guidance ⭐ 18,237
    A guidance language for controlling large language models.

39. haotian-liu/LLaVA ⭐ 18,222
    [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
    🔗 llava.hliu.cc

40. stitionai/devika ⭐ 17,960
    Devika is an advanced AI software engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective.

41. mlc-ai/mlc-llm ⭐ 17,815
    Universal LLM Deployment Engine with ML Compilation
    🔗 llm.mlc.ai

42. joaomdmoura/crewAI ⭐ 17,373
    Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
    🔗 crewai.com

43. karpathy/llama2.c ⭐ 16,843
    Inference Llama 2 in one file of pure C

44. thudm/ChatGLM2-6B ⭐ 15,634
    ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

45. facebookresearch/codellama ⭐ 15,472
    Inference code for CodeLlama models

46. huggingface/peft ⭐ 15,081
    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
    🔗 huggingface.co/docs/peft

47. transformeroptimus/SuperAGI ⭐ 14,971
    <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
    🔗 superagi.com

48. mayooear/gpt4-pdf-chatbot-langchain ⭐ 14,758
    GPT4 & LangChain Chatbot for large PDF docs
    🔗 www.youtube.com/watch?v=ih9pbgvvoo4

49. deepset-ai/haystack ⭐ 14,680
    🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conv...
    🔗 haystack.deepset.ai

50. stanfordnlp/dspy ⭐ 14,544
    DSPy: The framework for programming—not prompting—foundation models
    🔗 dspy-docs.vercel.app

51. fauxpilot/fauxpilot ⭐ 14,448
    FauxPilot - an open-source alternative to GitHub Copilot server

52. openai/evals ⭐ 14,397
    Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

53. idea-research/Grounded-Segment-Anything ⭐ 14,225
    Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
    🔗 arxiv.org/abs/2401.14159

54. assafelovic/gpt-researcher ⭐ 13,227
    GPT based autonomous agent that does online comprehensive research on any given topic
    🔗 gptr.dev

55. unslothai/unsloth ⭐ 12,771
    Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
    🔗 unsloth.ai

56. qwenlm/Qwen ⭐ 12,687
    The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

57. dao-ailab/flash-attention ⭐ 12,431
    Fast and memory-efficient exact attention

58. infiniflow/ragflow ⭐ 12,269
    RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
    🔗 ragflow.io

59. blinkdl/RWKV-LM ⭐ 12,010
    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

60. openlmlab/MOSS ⭐ 11,888
    An open-source tool-augmented conversational language model from Fudan University
    🔗 txsun1997.github.io/blogs/moss.html

61. mlc-ai/web-llm ⭐ 11,817
    High-performance In-browser LLM Inference Engine
    🔗 webllm.mlc.ai

62. paddlepaddle/PaddleNLP ⭐ 11,753
    👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
    🔗 paddlenlp.readthedocs.io

63. smol-ai/developer ⭐ 11,738
    the first library to let you embed a developer agent in your own app!
    🔗 twitter.com/smolmodels

64. h2oai/h2ogpt ⭐ 11,021
    Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
    🔗 h2o.ai

65. shishirpatil/gorilla ⭐ 10,872
    Enables LLMs to use tools by invoking APIs. Given a query, Gorilla comes up with the semantically and syntactically correct API.
    🔗 gorilla.cs.berkeley.edu

66. databrickslabs/dolly ⭐ 10,804
    Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
    🔗 www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html

67. phidatahq/phidata ⭐ 10,651
    Phidata is a toolkit for building AI Assistants using function calling.
    🔗 docs.phidata.com

68. berriai/litellm ⭐ 10,561
    Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
    🔗 docs.litellm.ai/docs

69. facebookresearch/llama-recipes ⭐ 10,511
    Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta ...

70. microsoft/LoRA ⭐ 9,835
    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
    🔗 arxiv.org/abs/2106.09685

71. vanna-ai/vanna ⭐ 9,827
    🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
    🔗 vanna.ai/docs

72. google-research/vision_transformer ⭐ 9,777
    Vision Transformer and MLP-Mixer Architectures

73. artidoro/qlora ⭐ 9,722
    QLoRA: Efficient Finetuning of Quantized LLMs
    🔗 arxiv.org/abs/2305.14314

74. embedchain/mem0 ⭐ 9,441
    The memory layer for Personalized AI
    🔗 docs.mem0.ai

75. nvidia/Megatron-LM ⭐ 9,434
    Ongoing research training transformer models at scale
    🔗 docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start

76. blinkdl/ChatRWKV ⭐ 9,341
    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

77. mistralai/mistral-inference ⭐ 9,253
    Official inference library for Mistral models
    🔗 mistral.ai

78. lightning-ai/litgpt ⭐ 8,818
    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
    🔗 lightning.ai

79. lvwerra/trl ⭐ 8,799
    Train transformer language models with reinforcement learning.
    🔗 hf.co/docs/trl

80. microsoft/promptflow ⭐ 8,786
    Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
    🔗 microsoft.github.io/promptflow

81. karpathy/minbpe ⭐ 8,758
    Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

82. mshumer/gpt-prompt-engineer ⭐ 8,242
    Simply input a description of your task and some test cases, and the system will generate, test, and rank a multitude of prompts to find the ones that perform the best.

83. apple/ml-ferret ⭐ 8,216
    Ferret: Refer and Ground Anything Anywhere at Any Granularity

84. eleutherai/gpt-neo ⭐ 8,175
    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
    🔗 www.eleuther.ai

85. optimalscale/LMFlow ⭐ 8,131
    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
    🔗 optimalscale.github.io/lmflow

86. thudm/CodeGeeX ⭐ 7,989
    CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
    🔗 codegeex.cn

87. lianjiatech/BELLE ⭐ 7,735
    BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

88. sjtu-ipads/PowerInfer ⭐ 7,664
    High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

89. thudm/GLM-130B ⭐ 7,646
    GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

90. plachtaa/VALL-E-X ⭐ 7,438
    An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

91. jzhang38/TinyLlama ⭐ 7,360
    The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

92. sweepai/sweep ⭐ 7,318
    Sweep: open-source AI-powered Software Developer for small features and bug fixes.
    🔗 sweep.dev

93. openlm-research/open_llama ⭐ 7,284
    OpenLLaMA: An Open Reproduction of LLaMA

94. abetlen/llama-cpp-python ⭐ 7,226
    Simple Python bindings for @ggerganov's llama.cpp library.
    🔗 llama-cpp-python.readthedocs.io

95. outlines-dev/outlines ⭐ 7,213
    Structured Text Generation from LLMs
    🔗 outlines-dev.github.io/outlines

96. bigcode-project/starcoder ⭐ 7,206
    Home of StarCoder: fine-tuning & inference!

97. vaibhavs10/insanely-fast-whisper ⭐ 7,002
    An opinionated CLI to transcribe Audio files w/ Whisper on-device! Powered by 🤗 Transformers, Optimum & flash-attn

98. zilliztech/GPTCache ⭐ 6,917
    Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
    🔗 gptcache.readthedocs.io

99. bhaskatripathi/pdfGPT ⭐ 6,840
    PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
    🔗 huggingface.co/spaces/bhaskartripathi/pdfgpt_turbo

100. apple/corenet ⭐ 6,754
     CoreNet is a deep neural network toolkit that allows researchers and engineers to train standard and novel small and large-scale models for variety of tasks, including foundation models (e.g., CLIP and LLM), object classification, object detection, and semantic segmentation.

101. eleutherai/gpt-neox ⭐ 6,718
     An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
     🔗 www.eleuther.ai

102. jxnl/instructor ⭐ 6,716
     Instructor is a Python library that makes it a breeze to work with structured outputs from large language models (LLMs). Built on top of Pydantic, it provides a simple, transparent, and user-friendly API to manage validation, retries, and streaming responses.
     🔗 python.useinstructor.com

103. mit-han-lab/streaming-llm ⭐ 6,373
     [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
     🔗 arxiv.org/abs/2309.17453

104. langchain-ai/opengpts ⭐ 6,325
     An open source effort to create a similar experience to OpenAI's GPTs and Assistants API.

105. skypilot-org/skypilot ⭐ 6,293
     SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
     🔗 skypilot.readthedocs.io

106. chainlit/chainlit ⭐ 6,216
     Build Conversational AI in minutes ⚡️
     🔗 docs.chainlit.io

107. nat/openplayground ⭐ 6,165
     An LLM playground you can run on your laptop

108. run-llama/rags ⭐ 6,093
     Build ChatGPT over your data, all with natural language

109. lightning-ai/lit-llama ⭐ 5,897
     Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

110. eleutherai/lm-evaluation-harness ⭐ 5,879
     A framework for few-shot evaluation of language models.
     🔗 www.eleuther.ai

111. internlm/InternLM ⭐ 5,840
     Official release of InternLM2.5 7B base and chat models. 1M context support
     🔗 internlm.intern-ai.org.cn

112. explodinggradients/ragas ⭐ 5,817
     Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
     🔗 docs.ragas.io

113. skyvern-ai/skyvern ⭐ 5,477
     Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows, replacing brittle or unreliable automation solutions.
     🔗 www.skyvern.com

114. minedojo/Voyager ⭐ 5,383
     An Open-Ended Embodied Agent with Large Language Models
     🔗 voyager.minedojo.org

115. pytorch-labs/gpt-fast ⭐ 5,373
     Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

116. dsdanielpark/Bard-API ⭐ 5,351
     The unofficial python package that returns response of Google Bard through cookie value.
     🔗 pypi.org/project/bardapi

117. microsoft/promptbase ⭐ 5,256
     promptbase is an evolving collection of resources, best practices, and example scripts for eliciting the best performance from foundation models.

118. langchain-ai/chat-langchain ⭐ 4,996
     Locally hosted chatbot specifically focused on question answering over the LangChain documentation
     🔗 chat.langchain.com

119. weaviate/Verba ⭐ 4,987
     Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

120. mnotgod96/AppAgent ⭐ 4,655
     AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
     🔗 appagent-official.github.io

121. openbmb/ToolBench ⭐ 4,618
     [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
     🔗 openbmb.github.io/toolbench

122. vikhyat/moondream ⭐ 4,558
     A tiny open-source computer-vision language model designed to run efficiently on edge devices
     🔗 moondream.ai

123. togethercomputer/RedPajama-Data ⭐ 4,461
     The RedPajama-Data repository contains code for preparing large datasets for training large language models.

124. langchain-ai/langgraph ⭐ 4,452
     LangGraph is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain.
     🔗 langchain-ai.github.io/langgraph

125. microsoft/BioGPT ⭐ 4,265
     Implementation of BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining

126. llmware-ai/llmware ⭐ 4,256
     Unified framework for building enterprise RAG pipelines with small, specialized models
     🔗 llmware-ai.github.io/llmware

127. microsoft/LLMLingua ⭐ 4,232
     To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
     🔗 llmlingua.com

128. allenai/OLMo ⭐ 4,225
     OLMo is a repository for training and using AI2's state-of-the-art open language models. It is built by scientists, for scientists.
     🔗 allenai.org/olmo

129. kyegomez/tree-of-thoughts ⭐ 4,171
     Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
     🔗 discord.gg/qutxnk2nmf

130. cg123/mergekit ⭐ 4,115
     Tools for merging pretrained large language models.

131. instruction-tuning-with-gpt-4/GPT-4-LLM ⭐ 4,098
     Instruction Tuning with GPT-4
     🔗 instruction-tuning-with-gpt-4.github.io

132. 1rgs/jsonformer ⭐ 4,000
     A Bulletproof Way to Generate Structured JSON from Language Models

133. yizhongw/self-instruct ⭐ 3,958
     Aligning pretrained language models with instruction data generated by themselves.

134. mshumer/gpt-llm-trainer ⭐ 3,873
     Input a description of your task, and the system will generate a dataset, parse it, and fine-tune a LLaMA 2 model for you

135. ravenscroftj/turbopilot ⭐ 3,835
     Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

136. whitead/paper-qa ⭐ 3,794
     LLM Chain for answering questions from documents with citations

137. nvidia/NeMo-Guardrails ⭐ 3,791
     NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

138. h2oai/h2o-llmstudio ⭐ 3,777
     H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
     🔗 gpt-gm.h2o.ai

139. guardrails-ai/guardrails ⭐ 3,653
     Open-source Python package for specifying structure and type, validating and correcting the outputs of large language models (LLMs)
     🔗 www.guardrailsai.com/docs

140. promptfoo/promptfoo ⭐ 3,634
     Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
     🔗 www.promptfoo.dev

141. mmabrouk/llm-workflow-engine ⭐ 3,624
     Power CLI and Workflow manager for LLMs (core package)

142. luodian/Otter ⭐ 3,518
     🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
     🔗 otter-ntu.github.io

143. simonw/llm ⭐ 3,509
     Access large language models from the command-line
     🔗 llm.datasette.io

144. eth-sri/lmql ⭐ 3,503
     A language for constraint-guided and efficient LLM programming.
     🔗 lmql.ai

145. minimaxir/simpleaichat ⭐ 3,437
     Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

146. microsoft/LMOps ⭐ 3,429
     General technology for enabling AI capabilities w/ LLMs and MLLMs
     🔗 aka.ms/generalai

147. minimaxir/gpt-2-simple ⭐ 3,401
     Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts

148. pathwaycom/llm-app ⭐ 3,375
     Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
     🔗 pathway.com/developers/templates

149. open-compass/opencompass ⭐ 3,314
     OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
     🔗 opencompass.org.cn

150. turboderp/exllamav2 ⭐ 3,265
     A fast inference library for running LLMs locally on modern consumer-class GPUs

151. deep-diver/LLM-As-Chatbot ⭐ 3,260
     LLM as a Chatbot Service

152. defog-ai/sqlcoder ⭐ 3,134
     SoTA LLM for converting natural language questions to SQL queries

153. jaymody/picoGPT ⭐ 3,133
     An unnecessarily tiny implementation of GPT-2 in NumPy.

154. next-gpt/NExT-GPT ⭐ 3,084
     Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
     🔗 next-gpt.github.io

155. agiresearch/AIOS ⭐ 3,035
     AIOS, a Large Language Model (LLM) Agent operating system, embeds large language model into Operating Systems (OS) as the brain of the OS, enabling an operating system "with soul" -- an important step towards AGI.

156. truefoundry/cognita ⭐ 3,014
     RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
     🔗 cognita.truefoundry.com

157. iryna-kondr/scikit-llm ⭐ 3,002
     Seamlessly integrate LLMs into scikit-learn.
     🔗 beastbyte.ai

158. baichuan-inc/Baichuan-13B ⭐ 2,976
     A 13B large language model developed by Baichuan Intelligent Technology
     🔗 huggingface.co/baichuan-inc/baichuan-13b-chat

159. microsoft/torchscale ⭐ 2,974
     Foundation Architecture for (M)LLMs
     🔗 aka.ms/generalai

160. freedomintelligence/LLMZoo ⭐ 2,906
     ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

161. sgl-project/sglang ⭐ 2,863
     SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

162. li-plus/chatglm.cpp ⭐ 2,840
     C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4

163. juncongmoo/pyllama ⭐ 2,802
     LLaMA: Open and Efficient Foundation Language Models

164. paperswithcode/galai ⭐ 2,667
     Model API for GALACTICA

165. alpha-vllm/LLaMA2-Accessory ⭐ 2,622
     An Open-source Toolkit for LLM Development
     🔗 llama2-accessory.readthedocs.io

166. hegelai/prompttools ⭐ 2,558
     Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
     🔗 prompttools.readthedocs.io

167. bclavie/RAGatouille ⭐ 2,507
     Bridging the gap between state-of-the-art research and alchemical RAG pipeline practices.

168. mistralai/mistral-finetune ⭐ 2,489
     A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models. It is based on LoRA.

169. cohere-ai/cohere-toolkit ⭐ 2,489
     Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

170. databricks/dbrx ⭐ 2,483
     Code examples and resources for DBRX, a large language model developed by Databricks
     🔗 www.databricks.com

171. pipecat-ai/pipecat ⭐ 2,391
     Open Source framework for voice and multimodal conversational AI

172. ofa-sys/OFA ⭐ 2,373
     Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

173. young-geng/EasyLM ⭐ 2,325
     Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

174. huggingface/text-embeddings-inference ⭐ 2,311
     A blazing fast inference solution for text embeddings models
     🔗 huggingface.co/docs/text-embeddings-inference/quick_tour

175. civitai/sd_civitai_extension ⭐ 2,298
     All of the Civitai models inside Automatic 1111 Stable Diffusion Web UI

176. noahshinn/reflexion ⭐ 2,169
     [NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning

177. cheshire-cat-ai/core ⭐ 2,167
     Production ready AI agent framework
     🔗 cheshirecat.ai

178. openai/finetune-transformer-lm ⭐ 2,121
     Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
     🔗 s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf

179. intel/neural-compressor ⭐ 2,084
     SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
     🔗 intel.github.io/neural-compressor

180. tairov/llama2.mojo ⭐ 2,070
     Inference Llama 2 in one file of pure 🔥
     🔗 www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov

181. langroid/langroid ⭐ 2,020
     Harness LLMs with Multi-Agent Programming
     🔗 langroid.github.io/langroid

182. openai/image-gpt ⭐ 2,019
     Archived. Code and models from the paper "Generative Pretraining from Pixels"

183. spcl/graph-of-thoughts ⭐ 1,990
     Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
     🔗 arxiv.org/pdf/2308.09687.pdf

184. neulab/prompt2model ⭐ 1,929
     prompt2model - Generate Deployable Models from Natural Language Instructions

185. predibase/lorax ⭐ 1,926
     Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
     🔗 loraexchange.ai

186. lucidrains/toolformer-pytorch ⭐ 1,924
     Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

187. openai/gpt-2-output-dataset ⭐ 1,918
     Dataset of GPT-2 outputs for research in detection, biases, and more

188. truera/trulens ⭐ 1,872
     Evaluation and Tracking for LLM Experiments
     🔗 www.trulens.org

189. minimaxir/aitextgen ⭐ 1,832
     A robust Python tool for text-based AI training and generation using GPT-2.
     🔗 docs.aitextgen.io

190. ist-daslab/gptq ⭐ 1,796
     Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
     🔗 arxiv.org/abs/2210.17323

191. epfllm/meditron ⭐ 1,771
     Meditron is a suite of open-source medical Large Language Models (LLMs).
     🔗 huggingface.co/epfl-llm

192. microsoft/Megatron-DeepSpeed ⭐ 1,751
     Ongoing research training transformer language models at scale, including: BERT & GPT-2

193. openai/gpt-discord-bot ⭐ 1,742
     Example Discord bot written in Python that uses the completions API to have conversations with the text-davinci-003 model, and the moderations API to filter the messages.

194. akariasai/self-rag ⭐ 1,639
     This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
     🔗 selfrag.github.io

195. ray-project/llm-applications ⭐ 1,616
     A comprehensive guide to building RAG-based LLM applications for production.

196. jina-ai/thinkgpt ⭐ 1,510
     Agent techniques to augment your LLM and push it beyong its limits

197. casper-hansen/AutoAWQ ⭐ 1,457
     AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
     🔗 casper-hansen.github.io/autoawq

198. cstankonrad/long_llama ⭐ 1,440
     LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.

199. farizrahman4u/loopgpt ⭐ 1,411
     Re-implementation of Auto-GPT as a python package, written with modularity and extensibility in mind.

200. openai/simple-evals ⭐ 1,371
     Lightweight library for evaluating language models

201. run-llama/llama-lab ⭐ 1,363
     Llama Lab is a repo dedicated to building cutting-edge projects using LlamaIndex

202. explosion/spacy-transformers ⭐ 1,327
     🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
     🔗 spacy.io/usage/embeddings-transformers

203. chatarena/chatarena ⭐ 1,299
     ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
     🔗 www.chatarena.org

204. agentops-ai/tokencost ⭐ 1,292
     Easy token price estimates for 400+ LLMs. TokenOps.
     🔗 agentops.ai

205. bigscience-workshop/Megatron-DeepSpeed ⭐ 1,283
     Ongoing research training transformer language models at scale, including: BERT & GPT-2

206. meetkai/functionary ⭐ 1,234
     Chat language model that can use tools and interpret the results

207. ray-project/ray-llm ⭐ 1,201
     RayLLM - LLMs on Ray
     🔗 aviary.anyscale.com

208. srush/MiniChain ⭐ 1,191
     A tiny library for coding with large language models.
     🔗 srush-minichain.hf.space

209. linksoul-ai/AutoAgents ⭐ 1,109
     [IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.
     🔗 huggingface.co/spaces/linksoul/autoagents

210. ibm/Dromedary ⭐ 1,102
     Dromedary: towards helpful, ethical and reliable LLMs.

211. evolvinglmms-lab/lmms-eval ⭐ 1,097
     Accelerating the development of large multimodal models (LMMs) with lmms-eval
     🔗 lmms-lab.github.io

212. keirp/automatic_prompt_engineer ⭐ 1,058
     Large Language Models Are Human-Level Prompt Engineers

213. hao-ai-lab/LookaheadDecoding ⭐ 1,047
     Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

214. lupantech/chameleon-llm ⭐ 1,039
     Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
     🔗 chameleon-llm.github.io

215. rlancemartin/auto-evaluator ⭐ 1,035
     Evaluation tool for LLM QA chains
     🔗 autoevaluator.langchain.com

216. agenta-ai/agenta ⭐ 1,031
     The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
     🔗 www.agenta.ai

217. nomic-ai/pygpt4all ⭐ 1,027
     Official supported Python bindings for llama.cpp + gpt4all
     🔗 nomic-ai.github.io/pygpt4all

218. explosion/spacy-llm ⭐ 1,022
     🦙 Integrating LLMs into structured NLP pipelines
     🔗 spacy.io/usage/large-language-models

219. ctlllll/LLM-ToolMaker ⭐ 1,011
     Large Language Models as Tool Makers

220. microsoft/Llama-2-Onnx ⭐ 1,002
     A Microsoft optimized version of the Llama 2 model, available from Meta

221. huggingface/nanotron ⭐ 972
     Minimalistic large language model 3D-parallelism training

222. ajndkr/lanarky ⭐ 958
     The web framework for building LLM microservices
     🔗 lanarky.ajndkr.com

223. likejazz/llama3.np ⭐ 933
     llama3.np is a pure NumPy implementation for Llama 3 model.

224. pinecone-io/canopy ⭐ 928
     Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone
     🔗 www.pinecone.io

225. cerebras/modelzoo ⭐ 870
     Examples of common deep learning models that can be trained on Cerebras hardware

226. muennighoff/sgpt ⭐ 828
     SGPT: GPT Sentence Embeddings for Semantic Search
     🔗 arxiv.org/abs/2202.08904

227. oliveirabruno01/babyagi-asi ⭐ 773
     BabyAGI: an Autonomous and Self-Improving agent, or BASI

228. topoteretes/cognee ⭐ 765
     Deterministic LLMs Outputs for AI Applications and AI Agents
     🔗 www.cognee.ai

229. opengenerativeai/GenossGPT ⭐ 747
     One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.
     🔗 genoss.ai

230. datadreamer-dev/DataDreamer ⭐ 742
     DataDreamer is a powerful open-source Python library for prompting, synthetic data generation, and training workflows. It is designed to be simple, extremely efficient, and research-grade.
     🔗 datadreamer.dev

231. salesforce/xgen ⭐ 713
     Salesforce open-source LLMs with 8k sequence length.

232. langchain-ai/langsmith-cookbook ⭐ 703
     LangSmith is a platform for building production-grade LLM applications.
     🔗 langsmith-cookbook.vercel.app

233. prometheus-eval/prometheus-eval ⭐ 690
     Evaluate your LLM's response with Prometheus and GPT4 💯

234. opengvlab/OmniQuant ⭐ 626
     [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

235. wandb/weave ⭐ 605
     Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
     🔗 wandb.me/weave

236. squeezeailab/SqueezeLLM ⭐ 603
     [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
     🔗 arxiv.org/abs/2306.07629

237. lupantech/ScienceQA ⭐ 573
     Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".

238. zhudotexe/kani ⭐ 542
     kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
     🔗 kani.readthedocs.io

239. hazyresearch/ama_prompting ⭐ 534
     Ask Me Anything language model prompting

240. vahe1994/SpQR ⭐ 515
     Quantization algorithm and the model evaluation code for SpQR method for LLM compression

241. continuum-llms/chatgpt-memory ⭐ 513
     Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis datastore.

242. hazyresearch/H3 ⭐ 505
     Language Modeling with the H3 State Space Model

243. modal-labs/llm-finetuning ⭐ 490
     Guide for fine-tuning Llama/Mistral/CodeLlama models and more

244. huggingface/lighteval ⭐ 481
     LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

245. judahpaul16/gpt-home ⭐ 364
     ChatGPT at home! Basically a better Google Nest Hub or Amazon Alexa home assistant. Built on the Raspberry Pi using the OpenAI API.
     🔗 hub.docker.com/r/judahpaul/gpt-home

246. stanford-oval/suql ⭐ 174
     SUQL: Conversational Search over Structured and Unstructured Data with LLMs
     🔗 arxiv.org/abs/2311.09818

Math and Science

Mathematical, numerical and scientific libraries.

1. numpy/numpy ⭐ 27,143
   The fundamental package for scientific computing with Python.
   🔗 numpy.org

2. taichi-dev/taichi ⭐ 25,121
   Productive, portable, and performant GPU programming in Python: Taichi Lang is an open-source, imperative, parallel programming language for high-performance numerical computation.
   🔗 taichi-lang.org

3. scipy/scipy ⭐ 12,732
   SciPy library main repository
   🔗 scipy.org

4. sympy/sympy ⭐ 12,615
   A computer algebra system written in pure Python
   🔗 sympy.org

5. google/or-tools ⭐ 10,807
   Google Optimization Tools (a.k.a., OR-Tools) is an open-source, fast and portable software suite for solving combinatorial optimization problems.
   🔗 developers.google.com/optimization

6. z3prover/z3 ⭐ 9,992
   Z3 is a theorem prover from Microsoft Research with a Python language binding.

7. cupy/cupy ⭐ 7,990
   NumPy & SciPy for GPU
   🔗 cupy.dev

8. google-deepmind/alphageometry ⭐ 3,829
   Solving Olympiad Geometry without Human Demonstrations

9. mikedh/trimesh ⭐ 2,862
   Python library for loading and using triangular meshes.
   🔗 trimesh.org

10. mckinsey/causalnex ⭐ 2,194
    A Python library that helps data scientists to infer causation rather than observing correlation.
    🔗 causalnex.readthedocs.io

11. pyomo/pyomo ⭐ 1,914
    An object-oriented algebraic modeling language in Python for structured optimization problems.
    🔗 www.pyomo.org

12. facebookresearch/theseus ⭐ 1,672
    A library for differentiable nonlinear optimization

13. google-research/torchsde ⭐ 1,525
    Differentiable SDE solvers with GPU support and efficient sensitivity analysis.

14. dynamicslab/pysindy ⭐ 1,367
    A package for the sparse identification of nonlinear dynamical systems from data
    🔗 pysindy.readthedocs.io/en/latest

15. geomstats/geomstats ⭐ 1,174
    Computations and statistics on manifolds with geometric structures.
    🔗 geomstats.ai

16. cma-es/pycma ⭐ 1,056
    pycma is a Python implementation of CMA-ES and a few related numerical optimization tools.

17. sj001/AI-Feynman ⭐ 610
    Implementation of AI Feynman: a Physics-Inspired Method for Symbolic Regression

18. willianfuks/tfcausalimpact ⭐ 593
    Python Causal Impact Implementation Based on Google's R Package. Built using TensorFlow Probability.

19. brandondube/prysm ⭐ 249
    Prysm is an open-source library for physical and first-order modeling of optical systems and analysis of related data: numerical and physical optics, integrated modeling, phase retrieval, segmented systems, polynomials and fitting, sequential raytracing.
    🔗 prysm.readthedocs.io/en/stable

20. lean-dojo/ReProver ⭐ 189
    Retrieval-Augmented Theorem Provers for Lean
    🔗 leandojo.org

21. albahnsen/pycircular ⭐ 90
    pycircular is a Python module for circular data analysis

22. gbillotey/Fractalshades ⭐ 27
    Arbitrary-precision fractal explorer - Python package

Machine Learning - General

General and classical machine learning libraries. See below for other sections covering specialised ML areas.

1. scikit-learn/scikit-learn ⭐ 58,933
   scikit-learn: machine learning in Python
   🔗 scikit-learn.org

2. openai/openai-cookbook ⭐ 57,704
   Examples and guides for using the OpenAI API
   🔗 cookbook.openai.com

3. tencentarc/GFPGAN ⭐ 35,141
   GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.

4. suno-ai/bark ⭐ 33,862
   🔊 Text-Prompted Generative Audio Model

5. google-research/google-research ⭐ 33,460
   This repository contains code released by Google Research
   🔗 research.google

6. facebookresearch/faiss ⭐ 29,557
   A library for efficient similarity search and clustering of dense vectors.
   🔗 faiss.ai

7. google/jax ⭐ 29,213
   Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
   🔗 jax.readthedocs.io

8. open-mmlab/mmdetection ⭐ 28,627
   OpenMMLab Detection Toolbox and Benchmark
   🔗 mmdetection.readthedocs.io

9. ageron/handson-ml2 ⭐ 27,355
   A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.

10. lutzroeder/netron ⭐ 26,914
    Visualizer for neural network, deep learning and machine learning models
    🔗 netron.app

11. google/mediapipe ⭐ 26,259
    Cross-platform, customizable ML solutions for live and streaming media.
    🔗 mediapipe.dev

12. dmlc/xgboost ⭐ 25,820
    Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
    🔗 xgboost.readthedocs.io/en/stable

13. harisiqbal88/PlotNeuralNet ⭐ 21,592
    Latex code for making neural networks diagrams

14. jina-ai/jina ⭐ 20,608
    ☁️ Build multimodal AI applications with cloud-native stack
    🔗 docs.jina.ai

15. roboflow/supervision ⭐ 17,956
    We write your reusable computer vision tools. 💜
    🔗 supervision.roboflow.com

16. onnx/onnx ⭐ 17,301
    Open standard for machine learning interoperability
    🔗 onnx.ai

17. microsoft/LightGBM ⭐ 16,378
    A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
    🔗 lightgbm.readthedocs.io/en/latest

18. ml-explore/mlx ⭐ 15,813
    MLX is an array framework for machine learning on Apple silicon, brought to you by Apple machine learning research.
    🔗 ml-explore.github.io/mlx

19. tensorflow/tensor2tensor ⭐ 15,169
    Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

20. ddbourgin/numpy-ml ⭐ 14,850
    Machine learning, in numpy
    🔗 numpy-ml.readthedocs.io

21. aleju/imgaug ⭐ 14,278
    Image augmentation for machine learning experiments.
    🔗 imgaug.readthedocs.io

22. microsoft/nni ⭐ 13,903
    An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
    🔗 nni.readthedocs.io

23. microsoft/onnxruntime ⭐ 13,615
    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
    🔗 onnxruntime.ai

24. microsoft/Swin-Transformer ⭐ 13,353
    This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
    🔗 arxiv.org/abs/2103.14030

25. jindongwang/transferlearning ⭐ 13,103
    Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习
    🔗 transferlearning.xyz

26. deepmind/deepmind-research ⭐ 12,966
    This repository contains implementations and illustrative code to accompany DeepMind publications

27. spotify/annoy ⭐ 12,940
    Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

28. neonbjb/tortoise-tts ⭐ 12,484
    A multi-voice TTS system trained with an emphasis on quality

29. deepmind/alphafold ⭐ 12,139
    Implementation of the inference pipeline of AlphaFold v2

30. ggerganov/ggml ⭐ 10,369
    Tensor library for machine learning

31. facebookresearch/AnimatedDrawings ⭐ 10,329
    Code to accompany "A Method for Animating Children's Drawings of the Human Figure"

32. optuna/optuna ⭐ 10,207
    A hyperparameter optimization framework
    🔗 optuna.org

33. twitter/the-algorithm-ml ⭐ 9,971
    Source code for Twitter's Recommendation Algorithm
    🔗 blog.twitter.com/engineering/en_us/topics/open-source/2023/twitter-recommendation-algorithm

34. statsmodels/statsmodels ⭐ 9,758
    Statsmodels: statistical modeling and econometrics in Python
    🔗 www.statsmodels.org/devel

35. epistasislab/tpot ⭐ 9,599
    A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
    🔗 epistasislab.github.io/tpot

36. megvii-basedetection/YOLOX ⭐ 9,189
    YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

37. cleanlab/cleanlab ⭐ 9,142
    The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
    🔗 cleanlab.ai

38. pycaret/pycaret ⭐ 8,675
    An open-source, low-code machine learning library in Python
    🔗 www.pycaret.org

39. wandb/wandb ⭐ 8,634
    🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
    🔗 wandb.ai

40. pymc-devs/pymc ⭐ 8,500
    Bayesian Modeling and Probabilistic Programming in Python
    🔗 docs.pymc.io

41. uberi/speech_recognition ⭐ 8,191
    Speech recognition module for Python, supporting several engines and APIs, online and offline.
    🔗 pypi.python.org/pypi/speechrecognition

42. facebookresearch/xformers ⭐ 8,049
    Hackable and optimized Transformers building blocks, supporting a composable construction.
    🔗 facebookresearch.github.io/xformers

43. catboost/catboost ⭐ 7,914
    A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
    🔗 catboost.ai

44. open-mmlab/mmsegmentation ⭐ 7,740
    OpenMMLab Semantic Segmentation Toolbox and Benchmark.
    🔗 mmsegmentation.readthedocs.io/en/main

45. automl/auto-sklearn ⭐ 7,490
    Automated Machine Learning with scikit-learn
    🔗 automl.github.io/auto-sklearn

46. awslabs/autogluon ⭐ 7,449
    Fast and Accurate ML in 3 Lines of Code
    🔗 auto.gluon.ai

47. huggingface/accelerate ⭐ 7,393
    🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
    🔗 huggingface.co/docs/accelerate

48. lmcinnes/umap ⭐ 7,232
    Uniform Manifold Approximation and Projection

49. hyperopt/hyperopt ⭐ 7,155
    Distributed Asynchronous Hyperparameter Optimization in Python
    🔗 hyperopt.github.io/hyperopt

50. featurelabs/featuretools ⭐ 7,140
    An open source python library for automated feature engineering
    🔗 www.featuretools.com

51. py-why/dowhy ⭐ 6,909
    DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.
    🔗 www.pywhy.org/dowhy

52. hips/autograd ⭐ 6,875
    Efficiently computes derivatives of numpy code.

53. scikit-learn-contrib/imbalanced-learn ⭐ 6,763
    A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning
    🔗 imbalanced-learn.org

54. open-mmlab/mmagic ⭐ 6,759
    OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.
    🔗 mmagic.readthedocs.io/en/latest

55. probml/pyprobml ⭐ 6,372
    Python code for "Probabilistic Machine learning" book by Kevin Murphy

56. nicolashug/Surprise ⭐ 6,283
    A Python scikit for building and analyzing recommender systems
    🔗 surpriselib.com

57. google/automl ⭐ 6,186
    Google Brain AutoML

58. cleverhans-lab/cleverhans ⭐ 6,117
    An adversarial example library for constructing attacks, building defenses, and benchmarking both

59. kevinmusgrave/pytorch-metric-learning ⭐ 5,876
    The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.
    🔗 kevinmusgrave.github.io/pytorch-metric-learning

60. open-mmlab/mmcv ⭐ 5,749
    OpenMMLab Computer Vision Foundation
    🔗 mmcv.readthedocs.io/en/latest

61. ml-explore/mlx-examples ⭐ 5,559
    Examples in the MLX framework

62. project-monai/MONAI ⭐ 5,526
    AI Toolkit for Healthcare Imaging
    🔗 monai.io

63. mdbloice/Augmentor ⭐ 5,044
    Image augmentation library in Python for machine learning.
    🔗 augmentor.readthedocs.io/en/stable

64. uber/causalml ⭐ 4,895
    Uplift modeling and causal inference with machine learning algorithms

65. online-ml/river ⭐ 4,893
    🌊 Online machine learning in Python
    🔗 riverml.xyz

66. rasbt/mlxtend ⭐ 4,827
    A library of extension and helper modules for Python's data analysis and machine learning libraries.
    🔗 rasbt.github.io/mlxtend

67. google-deepmind/graphcast ⭐ 4,401
    GraphCast: Learning skillful medium-range global weather forecasting

68. lucidrains/deep-daze ⭐ 4,378
    Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

69. marqo-ai/marqo ⭐ 4,346
    Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
    🔗 www.marqo.ai

70. skvark/opencv-python ⭐ 4,321
    Automated CI toolchain to produce precompiled opencv-python, opencv-python-headless, opencv-contrib-python and opencv-contrib-python-headless packages.
    🔗 pypi.org/project/opencv-python

71. sanchit-gandhi/whisper-jax ⭐ 4,261
    JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

72. districtdatalabs/yellowbrick ⭐ 4,250
    Visual analysis and diagnostic tools to facilitate machine learning model selection.
    🔗 www.scikit-yb.org

73. google-gemini/cookbook ⭐ 4,241
    A collection of guides and examples for the Gemini API, including quickstart tutorials for writing prompts.
    🔗 ai.google.dev/gemini-api/docs

74. apple/coremltools ⭐ 4,239
    Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.
    🔗 coremltools.readme.io

75. nv-tlabs/GET3D ⭐ 4,165
    Generative Model of High Quality 3D Textured Shapes Learned from Images

76. nmslib/hnswlib ⭐ 4,157
    Header-only C++/python library for fast approximate nearest neighbors
    🔗 github.com/nmslib/hnswlib

77. cmusphinx/pocketsphinx ⭐ 3,837
    A small speech recognizer

78. microsoft/FLAML ⭐ 3,779
    A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
    🔗 microsoft.github.io/flaml

79. ourownstory/neural_prophet ⭐ 3,745
    NeuralProphet: A simple forecasting package
    🔗 neuralprophet.com

80. py-why/EconML ⭐ 3,668
    ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to brin...
    🔗 www.microsoft.com/en-us/research/project/alice

81. huggingface/autotrain-advanced ⭐ 3,649
    AutoTrain Advanced: faster and easier training and deployments of state-of-the-art machine learning models
    🔗 huggingface.co/autotrain

82. thudm/CogVideo ⭐ 3,550
    Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"

83. huggingface/notebooks ⭐ 3,460
    Notebooks using the Hugging Face libraries 🤗

84. rucaibox/RecBole ⭐ 3,276
    A unified, comprehensive and efficient recommendation library
    🔗 recbole.io

85. yoheinakajima/instagraph ⭐ 3,248
    Converts text input or URL into knowledge graph and displays

86. facebookresearch/vissl ⭐ 3,239
    VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
    🔗 vissl.ai

87. zjunlp/DeepKE ⭐ 3,230
    [EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
    🔗 deepke.zjukg.cn

88. pytorch/glow ⭐ 3,189
    Compiler for Neural Network hardware accelerators

89. hrnet/HRNet-Semantic-Segmentation ⭐ 3,093
    The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919

90. lucidrains/musiclm-pytorch ⭐ 3,090
    Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

91. mljar/mljar-supervised ⭐ 2,975
    Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation
    🔗 mljar.com

92. lightly-ai/lightly ⭐ 2,847
    A python library for self-supervised learning on images.
    🔗 docs.lightly.ai/self-supervised-learning

93. shankarpandala/lazypredict ⭐ 2,776
    Lazy Predict help build a lot of basic models without much code and helps understand which models works better without any parameter tuning

94. scikit-optimize/scikit-optimize ⭐ 2,735
    Sequential model-based optimization with a scipy.optimize interface
    🔗 scikit-optimize.github.io

95. scikit-learn-contrib/hdbscan ⭐ 2,731
    A high performance implementation of HDBSCAN clustering.
    🔗 hdbscan.readthedocs.io/en/latest

96. huggingface/safetensors ⭐ 2,626
    Implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).
    🔗 huggingface.co/docs/safetensors

97. google-research/t5x ⭐ 2,589
    T5X is a modular, composable, research-friendly framework for high-performance, configurable, self-service training, evaluation, and inference of sequence models (starting with language) at many scales.

98. apple/ml-ane-transformers ⭐ 2,520
    Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

99. freedmand/semantra ⭐ 2,441
    Semantra is a multipurpose tool for semantically searching documents. Query by meaning rather than just by matching text.

100. scikit-learn-contrib/category_encoders ⭐ 2,384
     A library of sklearn compatible categorical variable encoders
     🔗 contrib.scikit-learn.org/category_encoders

101. huggingface/optimum ⭐ 2,326
     🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
     🔗 huggingface.co/docs/optimum/main

102. rom1504/clip-retrieval ⭐ 2,273
     Easily compute clip embeddings and build a clip retrieval system with them
     🔗 rom1504.github.io/clip-retrieval

103. aws/sagemaker-python-sdk ⭐ 2,067
     A library for training and deploying machine learning models on Amazon SageMaker
     🔗 sagemaker.readthedocs.io

104. huggingface/evaluate ⭐ 1,903
     🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
     🔗 huggingface.co/docs/evaluate

105. eric-mitchell/direct-preference-optimization ⭐ 1,876
     Reference implementation for DPO (Direct Preference Optimization)

106. huggingface/huggingface_hub ⭐ 1,852
     The official Python client for the Huggingface Hub.
     🔗 huggingface.co/docs/huggingface_hub

107. rentruewang/koila ⭐ 1,815
     Prevent PyTorch's CUDA error: out of memory in just 1 line of code.
     🔗 rentruewang.com/koila

108. contextlab/hypertools ⭐ 1,810
     A Python toolbox for gaining geometric insights into high-dimensional data
     🔗 hypertools.readthedocs.io/en/latest

109. linkedin/greykite ⭐ 1,804
     A flexible, intuitive and fast forecasting library

110. bmabey/pyLDAvis ⭐ 1,791
     Python library for interactive topic model visualization. Port of the R LDAvis package.

111. scikit-learn-contrib/lightning ⭐ 1,714
     Large-scale linear classification, regression and ranking in Python
     🔗 contrib.scikit-learn.org/lightning

112. tensorflow/addons ⭐ 1,686
     Useful extra functionality for TensorFlow 2.x maintained by SIG-addons

113. microsoft/i-Code ⭐ 1,655
     The ambition of the i-Code project is to build integrative and composable multimodal AI. The "i" stands for integrative multimodal learning.

114. castorini/pyserini ⭐ 1,565
     Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
     🔗 pyserini.io

115. googlecloudplatform/vertex-ai-samples ⭐ 1,538
     Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
     🔗 cloud.google.com/vertex-ai

116. visual-layer/fastdup ⭐ 1,534
     fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.

117. laekov/fastmoe ⭐ 1,478
     A fast MoE impl for PyTorch
     🔗 fastmoe.ai

118. kubeflow/katib ⭐ 1,461
     Automated Machine Learning on Kubernetes
     🔗 www.kubeflow.org/docs/components/katib

119. jina-ai/finetuner ⭐ 1,454
     🎯 Task-oriented embedding tuning for BERT, CLIP, etc.
     🔗 finetuner.jina.ai

120. microsoft/Olive ⭐ 1,368
     Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation.
     🔗 microsoft.github.io/olive

121. csinva/imodels ⭐ 1,341
     Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).
     🔗 csinva.io/imodels

122. borealisai/advertorch ⭐ 1,284
     A Toolbox for Adversarial Robustness Research

123. microsoft/Semi-supervised-learning ⭐ 1,272
     A Unified Semi-Supervised Learning Codebase (NeurIPS'22)
     🔗 usb.readthedocs.io

124. patchy631/machine-learning ⭐ 1,256
     Machine Learning Tutorials Repository

125. awslabs/dgl-ke ⭐ 1,250
     High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.
     🔗 dglke.dgl.ai/doc

126. spotify/voyager ⭐ 1,227
     🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.
     🔗 spotify.github.io/voyager

127. koaning/scikit-lego ⭐ 1,216
     Extra blocks for scikit-learn pipelines.
     🔗 koaning.github.io/scikit-lego

128. google/vizier ⭐ 1,195
     Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
     🔗 oss-vizier.readthedocs.io

129. qdrant/fastembed ⭐ 1,155
     Fast, Accurate, Lightweight Python library to make State of the Art Embedding
     🔗 qdrant.github.io/fastembed

130. automl/TabPFN ⭐ 1,143
     Official implementation of the TabPFN paper (https://arxiv.org/abs/2207.01848) and the tabpfn package.
     🔗 priorlabs.ai

131. lightning-ai/lightning-thunder ⭐ 1,086
     Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

132. google-research/deeplab2 ⭐ 992
     DeepLab2 is a TensorFlow library for deep labeling, aiming to provide a unified and state-of-the-art TensorFlow codebase for dense pixel labeling tasks.

133. davidmrau/mixture-of-experts ⭐ 903
     PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

134. lmcinnes/pynndescent ⭐ 871
     A Python nearest neighbor descent for approximate nearest neighbors

135. hazyresearch/safari ⭐ 851
     Convolutions for Sequence Modeling

136. oml-team/open-metric-learning ⭐ 840
     OML is a PyTorch-based framework to train and validate the models producing high-quality embeddings.
     🔗 open-metric-learning.readthedocs.io/en/latest/index.html

137. opentensor/bittensor ⭐ 821
     Internet-scale Neural Networks
     🔗 www.bittensor.com

138. nvidia/cuda-python ⭐ 816
     CUDA Python Low-level Bindings
     🔗 nvidia.github.io/cuda-python

139. criteo/autofaiss ⭐ 777
     Automatically create Faiss knn indices with the most optimal similarity search parameters.
     🔗 criteo.github.io/autofaiss

140. replicate/replicate-python ⭐ 696
     Python client for Replicate
     🔗 replicate.com

141. facebookresearch/balance ⭐ 677
     The balance python package offers a simple workflow and methods for dealing with biased data samples when looking to infer from them to some target population of interest.
     🔗 import-balance.org

142. awslabs/python-deequ ⭐ 676
     Python API for Deequ, a library built on Spark for defining "unit tests for data", which measure data quality in large datasets

143. huggingface/optimum-quanto ⭐ 662
     A pytorch quantization backend for optimum

144. nicolas-hbt/pygraft ⭐ 656
     Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
     🔗 pygraft.readthedocs.io/en/latest

145. qdrant/quaterion ⭐ 630
     Blazing fast framework for fine-tuning similarity learning models
     🔗 quaterion.qdrant.tech

146. hpcaitech/EnergonAI ⭐ 628
     Large-scale model inference.

147. pymc-labs/pymc-marketing ⭐ 600
     Bayesian marketing toolbox in PyMC. Media Mix (MMM), customer lifetime value (CLV), buy-till-you-die (BTYD) models and more.
     🔗 www.pymc-marketing.io

148. googleapis/python-aiplatform ⭐ 588
     A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.

149. huggingface/exporters ⭐ 581
     Export Hugging Face models to Core ML and TensorFlow Lite

150. microsoft/Focal-Transformer ⭐ 545
     [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"

151. nevronai/MetisFL ⭐ 533
     The first open Federated Learning framework implemented in C++ and Python.
     🔗 metisfl.org

152. cvxgrp/pymde ⭐ 528
     Minimum-distortion embedding with PyTorch
     🔗 pymde.org

153. mrdbourke/m1-machine-learning-test ⭐ 511
     Code for testing various M1 Chip benchmarks with TensorFlow.

154. linkedin/FastTreeSHAP ⭐ 503
     Fast SHAP value computation for interpreting tree-based models

155. lightning-ai/litdata ⭐ 261
     Transform datasets at scale. Optimize datasets for fast AI model training.

156. dylanhogg/gptauthor ⭐ 53
     GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.

Machine Learning - Deep Learning

Machine learning libraries that cross over with deep learning in some way.

1. tensorflow/tensorflow ⭐ 184,142
   An Open Source Machine Learning Framework for Everyone
   🔗 tensorflow.org

2. pytorch/pytorch ⭐ 80,511
   Tensors and Dynamic neural networks in Python with strong GPU acceleration
   🔗 pytorch.org

3. openai/whisper ⭐ 64,741
   Robust Speech Recognition via Large-Scale Weak Supervision

4. keras-team/keras ⭐ 61,337
   Deep Learning for humans
   🔗 keras.io

5. deepfakes/faceswap ⭐ 49,916
   Deepfakes Software For All
   🔗 www.faceswap.dev

6. iperov/DeepFaceLab ⭐ 46,336
   DeepFaceLab is the leading software for creating deepfakes.

7. facebookresearch/segment-anything ⭐ 45,644
   The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

8. microsoft/DeepSpeed ⭐ 33,912
   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
   🔗 www.deepspeed.ai

9. rwightman/pytorch-image-models ⭐ 30,815
   The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
   🔗 huggingface.co/docs/timm

10. facebookresearch/detectron2 ⭐ 29,450
    Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
    🔗 detectron2.readthedocs.io/en/latest

11. lightning-ai/pytorch-lightning ⭐ 27,545
    The deep learning framework to pretrain, finetune and deploy AI models. PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch code to decouple the science from the engineering.
    🔗 lightning.ai

12. xinntao/Real-ESRGAN ⭐ 27,072
    Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

13. facebookresearch/Detectron ⭐ 26,210
    FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.

14. matterport/Mask_RCNN ⭐ 24,414
    Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow

15. openai/CLIP ⭐ 23,701
    CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

16. paddlepaddle/Paddle ⭐ 21,904
    PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
    🔗 www.paddlepaddle.org

17. apache/mxnet ⭐ 20,730
    Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
    🔗 mxnet.apache.org

18. pyg-team/pytorch_geometric ⭐ 20,633
    Graph Neural Network Library for PyTorch
    🔗 pyg.org

19. lucidrains/vit-pytorch ⭐ 18,920
    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

20. sanster/IOPaint ⭐ 18,235
    Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.
    🔗 www.iopaint.com

21. rasbt/deeplearning-models ⭐ 16,465
    A collection of various deep learning architectures, models, and tips

22. danielgatis/rembg ⭐ 15,542
    Rembg is a tool to remove images background

23. albumentations-team/albumentations ⭐ 13,777
    Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
    🔗 albumentations.ai

24. dmlc/dgl ⭐ 13,225
    Python package built to ease deep learning on graph, on top of existing DL frameworks.
    🔗 dgl.ai

25. facebookresearch/detr ⭐ 13,137
    End-to-End Object Detection with Transformers

26. nvidia/DeepLearningExamples ⭐ 13,013
    State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

27. kornia/kornia ⭐ 9,637
    Geometric Computer Vision Library for Spatial AI
    🔗 kornia.readthedocs.io

28. mlfoundations/open_clip ⭐ 9,244
    An open source implementation of OpenAI's CLIP (Contrastive Language-Image Pre-training)

29. keras-team/autokeras ⭐ 9,100
    AutoML library for deep learning
    🔗 autokeras.com

30. facebookresearch/pytorch3d ⭐ 8,513
    PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
    🔗 pytorch3d.org

31. pyro-ppl/pyro ⭐ 8,444
    Deep universal probabilistic programming with Python and PyTorch
    🔗 pyro.ai

32. nvidia/apex ⭐ 8,193
    A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

33. arogozhnikov/einops ⭐ 8,177
    Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
    🔗 einops.rocks

34. facebookresearch/ImageBind ⭐ 8,092
    ImageBind One Embedding Space to Bind Them All

35. google/trax ⭐ 8,014
    Trax — Deep Learning with Clear Code and Speed

36. lucidrains/imagen-pytorch ⭐ 7,894
    Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

37. xpixelgroup/BasicSR ⭐ 6,508
    Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.
    🔗 basicsr.readthedocs.io/en/latest

38. google/flax ⭐ 5,818
    Flax is a neural network library for JAX that is designed for flexibility.
    🔗 flax.readthedocs.io

39. skorch-dev/skorch ⭐ 5,704
    A scikit-learn compatible neural network library that wraps PyTorch

40. facebookresearch/mmf ⭐ 5,451
    A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
    🔗 mmf.sh

41. mosaicml/composer ⭐ 5,074
    Supercharge Your Model Training
    🔗 docs.mosaicml.com

42. pytorch/ignite ⭐ 4,496
    High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
    🔗 pytorch-ignite.ai

43. facebookincubator/AITemplate ⭐ 4,487
    AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

44. deci-ai/super-gradients ⭐ 4,461
    Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS.
    🔗 www.supergradients.com

45. nvidiagameworks/kaolin ⭐ 4,321
    A PyTorch Library for Accelerating 3D Deep Learning Research

46. williamyang1991/VToonify ⭐ 3,509
    [SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer

47. facebookresearch/PyTorch-BigGraph ⭐ 3,361
    Generate embeddings from large-scale graph-structured data.
    🔗 torchbiggraph.readthedocs.io

48. cvg/LightGlue ⭐ 3,178
    LightGlue: Local Feature Matching at Light Speed (ICCV 2023)

49. google-research/scenic ⭐ 3,152
    Scenic: A Jax Library for Computer Vision Research and Beyond

50. pytorch/botorch ⭐ 3,016
    Bayesian optimization in PyTorch
    🔗 botorch.org

51. alpa-projects/alpa ⭐ 3,013
    Training and serving large-scale neural networks with auto parallelization.
    🔗 alpa.ai

52. deepmind/dm-haiku ⭐ 2,841
    JAX-based neural network library
    🔗 dm-haiku.readthedocs.io

53. explosion/thinc ⭐ 2,808
    🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
    🔗 thinc.ai

54. nerdyrodent/VQGAN-CLIP ⭐ 2,592
    Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.

55. danielegrattarola/spektral ⭐ 2,355
    Graph Neural Networks with Keras and Tensorflow 2.
    🔗 graphneural.network

56. google-research/electra ⭐ 2,315
    ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

57. neuralmagic/sparseml ⭐ 2,013
    Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

58. fepegar/torchio ⭐ 2,002
    Medical imaging toolkit for deep learning
    🔗 www.torchio.org

59. pytorch/torchrec ⭐ 1,804
    Pytorch domain library for recommendation systems

60. tensorflow/mesh ⭐ 1,566
    Mesh TensorFlow: Model Parallelism Made Easier

61. vt-vl-lab/FGVC ⭐ 1,548
    [ECCV 2020] Flow-edge Guided Video Completion

62. tensorly/tensorly ⭐ 1,525
    TensorLy: Tensor Learning in Python.
    🔗 tensorly.org

63. calculatedcontent/WeightWatcher ⭐ 1,415
    The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

64. hysts/pytorch_image_classification ⭐ 1,333
    PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet

65. jeshraghian/snntorch ⭐ 1,195
    Deep and online learning with spiking neural networks in Python
    🔗 snntorch.readthedocs.io/en/latest

66. xl0/lovely-tensors ⭐ 1,073
    Tensors, for human consumption
    🔗 xl0.github.io/lovely-tensors

67. tensorflow/similarity ⭐ 1,004
    TensorFlow Similarity is a python package focused on making similarity learning quick and easy.

68. keras-team/keras-cv ⭐ 980
    Industry-strength Computer Vision workflows with Keras

69. deepmind/android_env ⭐ 974
    RL research on Android devices.

70. deepmind/chex ⭐ 747
    Chex is a library of utilities for helping to write reliable JAX code
    🔗 chex.readthedocs.io

71. kakaobrain/rq-vae-transformer ⭐ 730
    The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)

72. whitead/dmol-book ⭐ 595
    Deep learning for molecules and materials book
    🔗 dmol.pub

Machine Learning - Interpretability

Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training.

1. slundberg/shap ⭐ 22,171
   A game theoretic approach to explain the output of any machine learning model.
   🔗 shap.readthedocs.io

2. marcotcr/lime ⭐ 11,417
   Lime: Explaining the predictions of any machine learning classifier

3. interpretml/interpret ⭐ 6,147
   Fit interpretable models. Explain blackbox machine learning.
   🔗 interpret.ml/docs

4. pytorch/captum ⭐ 4,719
   Model interpretability and understanding for PyTorch
   🔗 captum.ai

5. tensorflow/lucid ⭐ 4,637
   A collection of infrastructure and tools for research in neural network interpretability.

6. pair-code/lit ⭐ 3,435
   The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.
   🔗 pair-code.github.io/lit

7. arize-ai/phoenix ⭐ 3,054
   AI Observability & Evaluation
   🔗 docs.arize.com/phoenix

8. teamhg-memex/eli5 ⭐ 2,742
   A library for debugging/inspecting machine learning classifiers and explaining their predictions
   🔗 eli5.readthedocs.io

9. maif/shapash ⭐ 2,689
   🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
   🔗 maif.github.io/shapash

10. seldonio/alibi ⭐ 2,350
    Algorithms for explaining machine learning models
    🔗 docs.seldon.io/projects/alibi/en/stable

11. oegedijk/explainerdashboard ⭐ 2,266
    Quickly build Explainable AI dashboards that show the inner workings of so-called "blackbox" machine learning models.
    🔗 explainerdashboard.readthedocs.io

12. eleutherai/pythia ⭐ 2,149
    Interpretability analysis and scaling laws to understand how knowledge develops and evolves during training in autoregressive transformers

13. jalammar/ecco ⭐ 1,943
    Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
    🔗 ecco.readthedocs.io

14. trusted-ai/AIX360 ⭐ 1,568
    Interpretability and explainability of data and machine learning models
    🔗 aix360.res.ibm.com

15. google-deepmind/penzai ⭐ 1,558
    A JAX library for writing models as legible, functional pytree data structures, along with tools for visualizing, modifying, and analyzing them. Penzai focuses on making it easy to do stuff with models after they have been trained
    🔗 penzai.readthedocs.io

16. cdpierse/transformers-interpret ⭐ 1,236
    Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

17. ethicalml/xai ⭐ 1,083
    XAI is a Machine Learning library that is designed with AI explainability in its core. XAI contains various tools that enable for analysis and evaluation of data and models
    🔗 ethical.institute/principles.html#commitment-3

18. selfexplainml/PiML-Toolbox ⭐ 911
    PiML (Python Interpretable Machine Learning) toolbox for model development & diagnostics
    🔗 selfexplainml.github.io/piml-toolbox

19. salesforce/OmniXAI ⭐ 847
    OmniXAI: A Library for eXplainable AI

Machine Learning - Ops

MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models.

1. apache/airflow ⭐ 35,426
   Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
   🔗 airflow.apache.org

2. ray-project/ray ⭐ 32,138
   Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
   🔗 ray.io

3. mlflow/mlflow ⭐ 17,963
   Open source platform for the machine learning lifecycle
   🔗 mlflow.org

4. spotify/luigi ⭐ 17,559
   Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

5. prefecthq/prefect ⭐ 15,435
   Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
   🔗 prefect.io

6. horovod/horovod ⭐ 14,071
   Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
   🔗 horovod.ai

7. iterative/dvc ⭐ 13,411
   🦉 ML Experiments and Data Management with Git
   🔗 dvc.org

8. ludwig-ai/ludwig ⭐ 11,004
   Low-code framework for building custom LLMs, neural networks, and other AI models
   🔗 ludwig.ai

9. dagster-io/dagster ⭐ 10,792
   An orchestration platform for the development, production, and observation of data assets.
   🔗 dagster.io

10. great-expectations/great_expectations ⭐ 9,685
    Always know what to expect from your data.
    🔗 docs.greatexpectations.io

11. kedro-org/kedro ⭐ 9,508
    Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
    🔗 kedro.org

12. dbt-labs/dbt-core ⭐ 9,342
    dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
    🔗 getdbt.com

13. bentoml/OpenLLM ⭐ 9,339
    Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
    🔗 bentoml.com

14. huggingface/text-generation-inference ⭐ 8,411
    A Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power Hugging Chat, the Inference API and Inference Endpoint.
    🔗 hf.co/docs/text-generation-inference

15. activeloopai/deeplake ⭐ 7,897
    Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
    🔗 activeloop.ai

16. netflix/metaflow ⭐ 7,837
    🚀 Build and manage real-life ML, AI, and data science projects with ease!
    🔗 metaflow.org

17. mage-ai/mage-ai ⭐ 7,479
    🧙 Build, run, and manage data pipelines for integrating and transforming data.
    🔗 www.mage.ai

18. kestra-io/kestra ⭐ 7,127
    Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
    🔗 kestra.io

19. bentoml/BentoML ⭐ 6,815
    The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
    🔗 bentoml.com

20. allegroai/clearml ⭐ 5,457
    ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
    🔗 clear.ml/docs

21. feast-dev/feast ⭐ 5,389
    The Open Source Feature Store for Machine Learning
    🔗 feast.dev

22. flyteorg/flyte ⭐ 5,220
    Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
    🔗 flyte.org

23. aimhubio/aim ⭐ 4,979
    Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
    🔗 aimstack.io

24. evidentlyai/evidently ⭐ 4,896
    Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b

25. langfuse/langfuse ⭐ 4,790
    🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
    🔗 langfuse.com/docs

26. adap/flower ⭐ 4,495
    Flower: A Friendly Federated Learning Framework
    🔗 flower.ai

27. orchest/orchest ⭐ 4,034
    Build data pipelines, the easy way 🛠️
    🔗 orchest.readthedocs.io/en/stable

28. zenml-io/zenml ⭐ 3,830
    ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
    🔗 zenml.io

29. kubeflow/pipelines ⭐ 3,513
    Machine Learning Pipelines for Kubeflow
    🔗 www.kubeflow.org/docs/components/pipelines

30. polyaxon/polyaxon ⭐ 3,513
    MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
    🔗 polyaxon.com

31. ploomber/ploomber ⭐ 3,442
    The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
    🔗 docs.ploomber.io

32. internlm/lmdeploy ⭐ 3,395
    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
    🔗 lmdeploy.readthedocs.io/en/latest

33. internlm/xtuner ⭐ 3,351
    An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
    🔗 xtuner.readthedocs.io/zh-cn/latest

34. towhee-io/towhee ⭐ 3,087
    Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
    🔗 towhee.io

35. determined-ai/determined ⭐ 2,934
    Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
    🔗 determined.ai

36. leptonai/leptonai ⭐ 2,582
    A Pythonic framework to simplify AI service building
    🔗 lepton.ai

37. meltano/meltano ⭐ 1,702
    Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
    🔗 meltano.com

38. dagworks-inc/hamilton ⭐ 1,580
    Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
    🔗 hamilton.dagworks.io/en/latest

39. azure/PyRIT ⭐ 1,517
    The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and ML engineers to red team foundation models and their applications.

40. hi-primus/optimus ⭐ 1,462
    🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
    🔗 hi-optimus.com

41. kubeflow/examples ⭐ 1,387
    A repository to host extended examples and tutorials

42. dstackai/dstack ⭐ 1,244
    dstack is an easy-to-use and flexible container orchestrator for running AI workloads in any cloud or data center.
    🔗 dstack.ai

43. dagworks-inc/burr ⭐ 758
    Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
    🔗 burr.dagworks.io

44. nccr-itmo/FEDOT ⭐ 623
    Automated modeling and machine learning framework FEDOT
    🔗 fedot.readthedocs.io

Machine Learning - Reinforcement

Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF

1. openai/gym ⭐ 34,270
   A toolkit for developing and comparing reinforcement learning algorithms.
   🔗 www.gymlibrary.dev

2. unity-technologies/ml-agents ⭐ 16,672
   The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
   🔗 unity.com/products/machine-learning-agents

3. openai/baselines ⭐ 15,526
   OpenAI Baselines: high-quality implementations of reinforcement learning algorithms

4. google/dopamine ⭐ 10,423
   Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.
   🔗 github.com/google/dopamine

5. deepmind/pysc2 ⭐ 7,966
   StarCraft II Learning Environment

6. lucidrains/PaLM-rlhf-pytorch ⭐ 7,646
   Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

7. thu-ml/tianshou ⭐ 7,625
   An elegant PyTorch deep reinforcement learning library.
   🔗 tianshou.org

8. tensorlayer/TensorLayer ⭐ 7,307
   Deep Learning and Reinforcement Learning Library for Scientists and Engineers
   🔗 tensorlayerx.com

9. farama-foundation/Gymnasium ⭐ 6,325
   An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
   🔗 gymnasium.farama.org

10. keras-rl/keras-rl ⭐ 5,498
    Deep Reinforcement Learning for Keras.
    🔗 keras-rl.readthedocs.io

11. deepmind/dm_control ⭐ 3,646
    Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.

12. ai4finance-foundation/ElegantRL ⭐ 3,554
    Massively Parallel Deep Reinforcement Learning. 🔥
    🔗 ai4finance.org

13. facebookresearch/ReAgent ⭐ 3,542
    A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)
    🔗 reagent.ai

14. deepmind/acme ⭐ 3,434
    A library of reinforcement learning components and agents

15. eureka-research/Eureka ⭐ 2,746
    Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)
    🔗 eureka-research.github.io

16. pettingzoo-team/PettingZoo ⭐ 2,468
    An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities
    🔗 pettingzoo.farama.org

17. kzl/decision-transformer ⭐ 2,272
    Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.

18. pytorch/rl ⭐ 2,027
    A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
    🔗 pytorch.org/rl

19. anthropics/hh-rlhf ⭐ 1,509
    Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
    🔗 arxiv.org/abs/2204.05862

20. humancompatibleai/imitation ⭐ 1,218
    Clean PyTorch implementations of imitation and reward learning algorithms
    🔗 imitation.readthedocs.io

21. arise-initiative/robosuite ⭐ 1,179
    robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
    🔗 robosuite.ai

22. denys88/rl_games ⭐ 808
    RL Games: High performance RL library

Natural Language Processing

Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover.

1. huggingface/transformers ⭐ 129,432
   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
   🔗 huggingface.co/transformers

2. pytorch/fairseq ⭐ 29,846
   Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

3. explosion/spaCy ⭐ 29,309
   💫 Industrial-strength Natural Language Processing (NLP) in Python
   🔗 spacy.io

4. myshell-ai/OpenVoice ⭐ 27,337
   Instant voice cloning by MyShell.
   🔗 research.myshell.ai/open-voice

5. microsoft/unilm ⭐ 19,192
   Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
   🔗 aka.ms/generalai

6. huggingface/datasets ⭐ 18,772
   🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
   🔗 huggingface.co/docs/datasets

7. rare-technologies/gensim ⭐ 15,453
   Topic Modelling for Humans
   🔗 radimrehurek.com/gensim

8. vikparuchuri/marker ⭐ 14,472
   Marker converts PDF, EPUB, and MOBI to markdown. It's 10x faster than nougat, more accurate on most documents, and has low hallucination risk.
   🔗 www.datalab.to

9. ukplab/sentence-transformers ⭐ 14,461
   Multilingual Sentence & Image Embeddings with BERT
   🔗 www.sbert.net

10. gunthercox/ChatterBot ⭐ 13,968
    ChatterBot is a machine learning, conversational dialog engine for creating chat bots
    🔗 chatterbot.readthedocs.io

11. flairnlp/flair ⭐ 13,740
    A very simple framework for state-of-the-art Natural Language Processing (NLP)
    🔗 flairnlp.github.io/flair

12. nltk/nltk ⭐ 13,258
    NLTK Source
    🔗 www.nltk.org

13. jina-ai/clip-as-service ⭐ 12,299
    🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
    🔗 clip-as-service.jina.ai

14. allenai/allennlp ⭐ 11,714
    An open-source NLP research library, built on PyTorch.
    🔗 www.allennlp.org

15. openai/tiktoken ⭐ 11,172
    tiktoken is a fast BPE tokeniser for use with OpenAI's models.

16. nvidia/NeMo ⭐ 10,958
    A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
    🔗 docs.nvidia.com/nemo-framework/user-guide/latest/overview.html

17. facebookresearch/seamless_communication ⭐ 10,555
    Foundational Models for State-of-the-Art Speech and Text Translation

18. facebookresearch/ParlAI ⭐ 10,453
    A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
    🔗 parl.ai

19. m-bain/whisperX ⭐ 10,119
    WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

20. google/sentencepiece ⭐ 9,852
    Unsupervised text tokenizer for Neural Network-based text generation.

21. doccano/doccano ⭐ 9,247
    Open source annotation tool for machine learning practitioners.

22. vikparuchuri/surya ⭐ 9,232
    OCR, layout analysis, reading order, line detection in 90+ languages
    🔗 www.datalab.to

23. sloria/TextBlob ⭐ 9,032
    Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
    🔗 textblob.readthedocs.io

24. togethercomputer/OpenChatKit ⭐ 9,020
    OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots

25. clips/pattern ⭐ 8,710
    Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
    🔗 github.com/clips/pattern/wiki

26. facebookresearch/nougat ⭐ 8,488
    Implementation of Nougat Neural Optical Understanding for Academic Documents
    🔗 facebookresearch.github.io/nougat

27. speechbrain/speechbrain ⭐ 8,275
    A PyTorch-based Speech Toolkit
    🔗 speechbrain.github.io

28. espnet/espnet ⭐ 8,133
    End-to-End Speech Processing Toolkit
    🔗 espnet.github.io/espnet

29. neuml/txtai ⭐ 7,592
    💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
    🔗 neuml.github.io/txtai

30. deeppavlov/DeepPavlov ⭐ 6,610
    An open source library for deep learning end-to-end dialog systems and chatbots.
    🔗 deeppavlov.ai

31. facebookresearch/metaseq ⭐ 6,436
    A codebase for working with Open Pre-trained Transformers, originally forked from fairseq.

32. kingoflolz/mesh-transformer-jax ⭐ 6,247
    Model parallel transformers in JAX and Haiku

33. maartengr/BERTopic ⭐ 5,817
    Leveraging BERT and c-TF-IDF to create easily interpretable topics.
    🔗 maartengr.github.io/bertopic

34. prefecthq/marvin ⭐ 5,014
    ✨ Build AI interfaces that spark joy
    🔗 askmarvin.ai

35. minimaxir/textgenrnn ⭐ 4,942
    Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.

36. aiwaves-cn/agents ⭐ 4,900
    An Open-source Framework for Autonomous Language Agents

37. salesforce/CodeGen ⭐ 4,842
    CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

38. layout-parser/layout-parser ⭐ 4,667
    A Unified Toolkit for Deep Learning Based Document Image Analysis
    🔗 layout-parser.github.io

39. facebookresearch/DrQA ⭐ 4,467
    Reading Wikipedia to Answer Open-Domain Questions

40. makcedward/nlpaug ⭐ 4,354
    Data augmentation for NLP
    🔗 makcedward.github.io

41. thilinarajapakse/simpletransformers ⭐ 4,043
    Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
    🔗 simpletransformers.ai

42. argilla-io/argilla ⭐ 3,657
    Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
    🔗 argilla-io.github.io/argilla/latest

43. maartengr/KeyBERT ⭐ 3,339
    Minimal keyword extraction with BERT
    🔗 maartengr.github.io/keybert

44. life4/textdistance ⭐ 3,332
    📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.

45. jsvine/markovify ⭐ 3,288
    A simple, extensible Markov chain generator.

46. bytedance/lightseq ⭐ 3,136
    LightSeq: A High Performance Library for Sequence Processing and Generation

47. promptslab/Promptify ⭐ 3,125
    Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
    🔗 discord.gg/m88xfymbk6

48. errbotio/errbot ⭐ 3,091
    Errbot is a chatbot, a daemon that connects to your favorite chat service and bring your tools and some fun into the conversation.
    🔗 errbot.io

49. huawei-noah/Pretrained-Language-Model ⭐ 2,991
    Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

50. neuralmagic/deepsparse ⭐ 2,944
    Sparsity-aware deep learning inference runtime for CPUs
    🔗 neuralmagic.com/deepsparse

51. ddangelov/Top2Vec ⭐ 2,894
    Top2Vec learns jointly embedded topic, document and word vectors.

52. jbesomi/texthero ⭐ 2,880
    Text preprocessing, representation and visualization from zero to hero.
    🔗 texthero.org

53. huggingface/neuralcoref ⭐ 2,838
    ✨Fast Coreference Resolution in spaCy with Neural Networks
    🔗 huggingface.co/coref

54. salesforce/CodeT5 ⭐ 2,663
    Home of CodeT5: Open Code LLMs for Code Understanding and Generation
    🔗 arxiv.org/abs/2305.07922

55. bigscience-workshop/promptsource ⭐ 2,598
    Toolkit for creating, sharing and using natural language prompts.

56. huggingface/setfit ⭐ 2,089
    SetFit is an efficient and prompt-free framework for few-shot fine-tuning of Sentence Transformers.
    🔗 hf.co/docs/setfit

57. jamesturk/jellyfish ⭐ 2,024
    🪼 a python library for doing approximate and phonetic matching of strings.
    🔗 jamesturk.github.io/jellyfish

58. alibaba/EasyNLP ⭐ 2,009
    EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

59. thudm/P-tuning-v2 ⭐ 1,938
    An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

60. marella/ctransformers ⭐ 1,763
    Python bindings for the Transformer models implemented in C/C++ using GGML library.

61. featureform/featureform ⭐ 1,752
    The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
    🔗 www.featureform.com

62. deepset-ai/FARM ⭐ 1,735
    🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
    🔗 farm.deepset.ai

63. franck-dernoncourt/NeuroNER ⭐ 1,687
    Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.
    🔗 neuroner.com

64. plasticityai/magnitude ⭐ 1,616
    A fast, efficient universal vector embedding utility package.

65. arxiv-vanity/arxiv-vanity ⭐ 1,599
    Renders papers from arXiv as responsive web pages so you don't have to squint at a PDF.
    🔗 www.arxiv-vanity.com

66. google-research/language ⭐ 1,585
    Shared repository for open-sourced projects from the Google AI Language team.
    🔗 ai.google/research/teams/language

67. explosion/spacy-models ⭐ 1,560
    💫 Models for the spaCy Natural Language Processing (NLP) library
    🔗 spacy.io

68. chrismattmann/tika-python ⭐ 1,458
    Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.

69. dmmiller612/bert-extractive-summarizer ⭐ 1,370
    Easy to use extractive text summarization with BERT

70. gunthercox/chatterbot-corpus ⭐ 1,353
    A multilingual dialog corpus
    🔗 chatterbot-corpus.readthedocs.io

71. jonasgeiping/cramming ⭐ 1,263
    Cramming the training of a (BERT-type) language model into limited compute.

72. nomic-ai/nomic ⭐ 1,163
    Interact, analyze and structure massive text, image, embedding, audio and video datasets
    🔗 atlas.nomic.ai

73. intellabs/fastRAG ⭐ 1,137
    Efficient Retrieval Augmentation and Generation Framework

74. abertsch72/unlimiformer ⭐ 1,043
    Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

75. urchade/GLiNER ⭐ 1,034
    Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
    🔗 arxiv.org/abs/2311.08526

76. pemistahl/lingua-py ⭐ 1,023
    The most accurate natural language detection library for Python, suitable for short text and mixed-language text

77. openai/grade-school-math ⭐ 945
    GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems

78. norskregnesentral/skweak ⭐ 914
    skweak: A software toolkit for weak supervision applied to NLP tasks

79. explosion/spacy-streamlit ⭐ 782
    👑 spaCy building blocks and visualizers for Streamlit apps
    🔗 share.streamlit.io/ines/spacy-streamlit-demo/master/app.py

80. paddlepaddle/RocketQA ⭐ 755
    🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.

81. keras-team/keras-nlp ⭐ 738
    Modular Natural Language Processing workflows with Keras

82. explosion/spacy-stanza ⭐ 722
    💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy

Packaging

Python packaging, dependency management and bundling.

1. pyenv/pyenv ⭐ 37,899
   pyenv lets you easily switch between multiple versions of Python.

2. python-poetry/poetry ⭐ 30,483
   Python packaging and dependency management made easy
   🔗 python-poetry.org

3. pypa/pipenv ⭐ 24,737
   A virtualenv management tool that supports a multitude of systems and nicely bridges the gaps between pip, python and virtualenv.
   🔗 pipenv.pypa.io

4. astral-sh/uv ⭐ 15,209
   An extremely fast Python package installer and resolver, written in Rust. Designed as a drop-in replacement for pip and pip-compile.
   🔗 astral.sh

5. mitsuhiko/rye ⭐ 12,727
   a Hassle-Free Python Experience
   🔗 rye.astral.sh

6. pyinstaller/pyinstaller ⭐ 11,540
   Freeze (package) Python programs into stand-alone executables
   🔗 www.pyinstaller.org

7. pypa/pipx ⭐ 9,615
   Install and Run Python Applications in Isolated Environments
   🔗 pipx.pypa.io

8. jazzband/pip-tools ⭐ 7,600
   A set of tools to keep your pinned Python dependencies fresh (pip-compile + pip-sync)
   🔗 pip-tools.rtfd.io

9. pdm-project/pdm ⭐ 7,596
   A modern Python package and dependency manager supporting the latest PEP standards
   🔗 pdm-project.org

10. mamba-org/mamba ⭐ 6,573
    The Fast Cross-Platform Package Manager: mamba is a reimplementation of the conda package manager in C++
    🔗 mamba.readthedocs.io

11. conda/conda ⭐ 6,253
    A system-level, binary package and environment manager running on all major operating systems and platforms.
    🔗 docs.conda.io/projects/conda

12. conda-forge/miniforge ⭐ 5,809
    A conda-forge distribution.
    🔗 conda-forge.org/miniforge

13. pypa/hatch ⭐ 5,725
    Modern, extensible Python project management
    🔗 hatch.pypa.io/latest

14. indygreg/PyOxidizer ⭐ 5,319
    A modern Python application packaging and distribution tool

15. pypa/virtualenv ⭐ 4,768
    A tool to create isolated Python environments. Since Python 3.3, a subset of it has been integrated into the standard lib venv module.
    🔗 virtualenv.pypa.io

16. spack/spack ⭐ 4,112
    A flexible package manager that supports multiple versions, configurations, platforms, and compilers.
    🔗 spack.io

17. beeware/briefcase ⭐ 2,505
    Tools to support converting a Python project into a standalone native application.
    🔗 briefcase.readthedocs.io

18. pantsbuild/pex ⭐ 2,493
    A tool for generating .pex (Python EXecutable) files, lock files and venvs.
    🔗 docs.pex-tool.org

19. prefix-dev/pixi ⭐ 2,424
    pixi is a cross-platform, multi-language package manager and workflow tool built on the foundation of the conda ecosystem.
    🔗 pixi.sh

20. pypa/flit ⭐ 2,135
    Simplified packaging of Python modules
    🔗 flit.pypa.io

21. linkedin/shiv ⭐ 1,711
    shiv is a command line utility for building fully self contained Python zipapps as outlined in PEP 441, but with all their dependencies included.

22. marcelotduarte/cx_Freeze ⭐ 1,286
    cx_Freeze creates standalone executables from Python scripts, with the same performance, is cross-platform and should work on any platform that Python itself works on.
    🔗 marcelotduarte.github.io/cx_freeze

23. ofek/pyapp ⭐ 1,108
    Runtime installer for Python applications
    🔗 ofek.dev/pyapp

24. pypa/gh-action-pypi-publish ⭐ 876
    The blessed GitHub Action, for publishing your 📦 distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
    🔗 packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows

25. py2exe/py2exe ⭐ 794
    Create standalone Windows programs from Python code
    🔗 www.py2exe.org

26. prefix-dev/rip ⭐ 635
    RIP is a library that allows the resolving and installing of Python PyPI packages from Rust into a virtual environment. It's based on our experience with building Rattler and aims to provide the same experience but for PyPI instead of Conda.
    🔗 prefix.dev

27. snok/install-poetry ⭐ 556
    Github action for installing and configuring Poetry

28. python-poetry/install.python-poetry.org ⭐ 187
    The official Poetry installation script
    🔗 install.python-poetry.org

Pandas

Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations.

1. pandas-dev/pandas ⭐ 42,744
   Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
   🔗 pandas.pydata.org

2. pola-rs/polars ⭐ 28,095
   Dataframes powered by a multithreaded, vectorized query engine, written in Rust
   🔗 docs.pola.rs

3. duckdb/duckdb ⭐ 20,952
   DuckDB is an analytical in-process SQL database management system
   🔗 www.duckdb.org

4. ydataai/ydata-profiling ⭐ 12,261
   1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
   🔗 docs.profiling.ydata.ai

5. gventuri/pandas-ai ⭐ 12,055
   Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
   🔗 pandas-ai.com

6. kanaries/pygwalker ⭐ 10,745
   PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis
   🔗 kanaries.net/pygwalker

7. rapidsai/cudf ⭐ 8,047
   cuDF is a GPU DataFrame library for loading joining, aggregating, filtering, and otherwise manipulating data
   🔗 docs.rapids.ai/api/cudf/stable

8. aws/aws-sdk-pandas ⭐ 3,852
   pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
   🔗 aws-sdk-pandas.readthedocs.io

9. nalepae/pandarallel ⭐ 3,595
   A simple and efficient tool to parallelize Pandas operations on all available CPUs
   🔗 nalepae.github.io/pandarallel

10. blaze/blaze ⭐ 3,178
    NumPy and Pandas interface to Big Data
    🔗 blaze.pydata.org

11. unionai-oss/pandera ⭐ 3,156
    A light-weight, flexible, and expressive statistical data testing library
    🔗 www.union.ai/pandera

12. adamerose/PandasGUI ⭐ 3,152
    A GUI for Pandas DataFrames

13. pydata/pandas-datareader ⭐ 2,874
    Extract data from a wide range of Internet sources into a pandas DataFrame.
    🔗 pydata.github.io/pandas-datareader/stable/index.html

14. scikit-learn-contrib/sklearn-pandas ⭐ 2,793
    Pandas integration with sklearn

15. jmcarpenter2/swifter ⭐ 2,493
    A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

16. delta-io/delta-rs ⭐ 2,006
    A native Rust library for Delta Lake, with bindings into Python
    🔗 delta-io.github.io/delta-rs

17. fugue-project/fugue ⭐ 1,922
    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
    🔗 fugue-tutorials.readthedocs.io

18. eventual-inc/Daft ⭐ 1,887
    Distributed DataFrame for Python designed for the cloud, powered by Rust
    🔗 getdaft.io

19. pyjanitor-devs/pyjanitor ⭐ 1,328
    Clean APIs for data cleaning. Python implementation of R package Janitor
    🔗 pyjanitor-devs.github.io/pyjanitor

20. machow/siuba ⭐ 1,135
    Python library for using dplyr like syntax with pandas and SQL
    🔗 siuba.org

21. renumics/spotlight ⭐ 1,054
    Interactively explore unstructured datasets from your dataframe.
    🔗 renumics.com

22. holoviz/hvplot ⭐ 1,027
    A high-level plotting API for pandas, dask, xarray, and networkx built on HoloViews
    🔗 hvplot.holoviz.org

23. tkrabel/bamboolib ⭐ 935
    bamboolib - a GUI for pandas DataFrames
    🔗 bamboolib.com

24. mwouts/itables ⭐ 736
    This packages changes how Pandas and Polars DataFrames are rendered in Jupyter Notebooks. With itables you can display your tables as interactive DataTables that you can sort, paginate, scroll or filter.
    🔗 mwouts.github.io/itables

Performance

Performance, parallelisation and low level libraries.

1. celery/celery ⭐ 24,100
   Distributed Task Queue (development branch)
   🔗 docs.celeryq.dev

2. google/flatbuffers ⭐ 22,591
   FlatBuffers: Memory Efficient Serialization Library
   🔗 flatbuffers.dev

3. pybind/pybind11 ⭐ 15,167
   Seamless operability between C++11 and Python
   🔗 pybind11.readthedocs.io

4. exaloop/codon ⭐ 13,980
   A high-performance, zero-overhead, extensible Python compiler using LLVM
   🔗 docs.exaloop.io/codon

5. dask/dask ⭐ 12,259
   Parallel computing with task scheduling
   🔗 dask.org

6. numba/numba ⭐ 9,648
   NumPy aware dynamic Python compiler using LLVM
   🔗 numba.pydata.org

7. modin-project/modin ⭐ 9,622
   Modin: Scale your Pandas workflows by changing a single line of code
   🔗 modin.readthedocs.io

8. nebuly-ai/nebuly ⭐ 8,366
   The user analytics platform for LLMs
   🔗 www.nebuly.com

9. vaexio/vaex ⭐ 8,228
   Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
   🔗 vaex.io

10. mher/flower ⭐ 6,293
    Real-time monitor and web admin for Celery distributed task queue
    🔗 flower.readthedocs.io

11. python-trio/trio ⭐ 6,003
    Trio – a friendly Python library for async concurrency and I/O
    🔗 trio.readthedocs.io

12. ultrajson/ultrajson ⭐ 4,287
    Ultra fast JSON decoder and encoder written in C with Python bindings
    🔗 pypi.org/project/ujson

13. facebookincubator/cinder ⭐ 3,430
    Cinder is Meta's internal performance-oriented production version of CPython.
    🔗 trycinder.com

14. tlkh/asitop ⭐ 3,194
    Perf monitoring CLI tool for Apple Silicon
    🔗 tlkh.github.io/asitop

15. ipython/ipyparallel ⭐ 2,566
    IPython Parallel: Interactive Parallel Computing in Python
    🔗 ipyparallel.readthedocs.io

16. airtai/faststream ⭐ 2,179
    FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
    🔗 faststream.airt.ai/latest

17. intel/intel-extension-for-transformers ⭐ 2,069
    ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

18. h5py/h5py ⭐ 2,047
    HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5 binary data format.
    🔗 www.h5py.org

19. agronholm/anyio ⭐ 1,693
    High level asynchronous concurrency and networking framework that works on top of either trio or asyncio

20. faster-cpython/ideas ⭐ 1,666
    Discussion and work tracker for Faster CPython project.

21. dask/distributed ⭐ 1,556
    A distributed task scheduler for Dask
    🔗 distributed.dask.org

22. tiangolo/asyncer ⭐ 1,516
    Asyncer, async and await, focused on developer experience.
    🔗 asyncer.tiangolo.com

23. intel/intel-extension-for-pytorch ⭐ 1,474
    A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

24. nschloe/perfplot ⭐ 1,328
    📈 Performance analysis for Python snippets

25. intel/scikit-learn-intelex ⭐ 1,187
    Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
    🔗 intel.github.io/scikit-learn-intelex

26. markshannon/faster-cpython ⭐ 940
    How to make CPython faster.

27. zerointensity/pointers.py ⭐ 914
    Bringing the hell of pointers to Python.
    🔗 pointers.zintensity.dev

28. brandtbucher/specialist ⭐ 618
    Visualize CPython's specializing, adaptive interpreter. 🔥

Profiling

Memory and CPU/GPU profiling tools and libraries.

1. bloomberg/memray ⭐ 12,854
   Memray is a memory profiler for Python
   🔗 bloomberg.github.io/memray

2. benfred/py-spy ⭐ 12,211
   Sampling profiler for Python programs

3. plasma-umass/scalene ⭐ 11,401
   Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

4. joerick/pyinstrument ⭐ 6,304
   🚴 Call stack profiler for Python. Shows you why your code is slow!
   🔗 pyinstrument.readthedocs.io

5. gaogaotiantian/viztracer ⭐ 4,675
   VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.
   🔗 viztracer.readthedocs.io

6. pythonprofilers/memory_profiler ⭐ 4,277
   Monitor Memory usage of Python code
   🔗 pypi.python.org/pypi/memory_profiler

7. reloadware/reloadium ⭐ 2,754
   Hot Reloading and Profiling for Python
   🔗 reloadium.io

8. pyutils/line_profiler ⭐ 2,583
   Line-by-line profiling for Python

9. jiffyclub/snakeviz ⭐ 2,285
   An in-browser Python profile viewer
   🔗 jiffyclub.github.io/snakeviz

10. p403n1x87/austin ⭐ 1,405
    Python frame stack sampler for CPython
    🔗 pypi.org/project/austin-dist

11. pythonspeed/filprofiler ⭐ 824
    A Python memory profiler for data processing and scientific computing applications
    🔗 pythonspeed.com/products/filmemoryprofiler

Security

Security related libraries: vulnerability discovery, SQL injection, environment auditing.

1. swisskyrepo/PayloadsAllTheThings ⭐ 58,493
   A list of useful payloads and bypass for Web Application Security and Pentest/CTF
   🔗 swisskyrepo.github.io/payloadsallthethings

2. sqlmapproject/sqlmap ⭐ 31,373
   Automatic SQL injection and database takeover tool
   🔗 sqlmap.org

3. certbot/certbot ⭐ 31,151
   Certbot is EFF's tool to obtain certs from Let's Encrypt and (optionally) auto-enable HTTPS on your server. It can also act as a client for any other CA that uses the ACME protocol.

4. aquasecurity/trivy ⭐ 22,229
   Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
   🔗 aquasecurity.github.io/trivy

5. bridgecrewio/checkov ⭐ 6,752
   Checkov is a static code analysis tool for infrastructure as code (IaC) and also a software composition analysis (SCA) tool for images and open source packages.
   🔗 www.checkov.io

6. nccgroup/ScoutSuite ⭐ 6,347
   Multi-Cloud Security Auditing Tool

7. pycqa/bandit ⭐ 6,165
   Bandit is a tool designed to find common security issues in Python code.
   🔗 bandit.readthedocs.io

8. stamparm/maltrail ⭐ 5,956
   Malicious traffic detection system

9. rhinosecuritylabs/pacu ⭐ 4,204
   The AWS exploitation framework, designed for testing the security of Amazon Web Services environments.
   🔗 rhinosecuritylabs.com/aws/pacu-open-source-aws-exploitation-framework

10. dashingsoft/pyarmor ⭐ 3,104
    A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts.
    🔗 pyarmor.dashingsoft.com

11. luijait/DarkGPT ⭐ 1,871
    DarkGPT is an OSINT assistant based on GPT-4-200K (recommended use) designed to perform queries on leaked databases, thus providing an artificial intelligence assistant that can be useful in your traditional OSINT processes.

12. pyupio/safety ⭐ 1,662
    Safety checks Python dependencies for known security vulnerabilities and suggests the proper remediations for vulnerabilities detected.
    🔗 safetycli.com/product/safety-cli

13. trailofbits/pip-audit ⭐ 948
    Audits Python environments, requirements files and dependency trees for known security vulnerabilities, and can automatically fix them
    🔗 pypi.org/project/pip-audit

14. fadi002/de4py ⭐ 814
    toolkit for python reverse engineering
    🔗 de4py.000.pe

Simulation

Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover.

1. atsushisakai/PythonRobotics ⭐ 22,339
   Python sample codes for robotics algorithms.
   🔗 atsushisakai.github.io/pythonrobotics

2. bulletphysics/bullet3 ⭐ 12,223
   Bullet Physics SDK: real-time collision detection and multi-physics simulation for VR, games, visual effects, robotics, machine learning etc.
   🔗 bulletphysics.org

3. isl-org/Open3D ⭐ 10,879
   Open3D: A Modern Library for 3D Data Processing
   🔗 www.open3d.org

4. qiskit/qiskit ⭐ 4,876
   Qiskit is an open-source SDK for working with quantum computers at the level of extended quantum circuits, operators, and primitives.
   🔗 www.ibm.com/quantum/qiskit

5. astropy/astropy ⭐ 4,311
   Astronomy and astrophysics core library
   🔗 www.astropy.org

6. quantumlib/Cirq ⭐ 4,199
   A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.

7. nvidia/warp ⭐ 3,865
   A Python framework for high performance GPU simulation and graphics
   🔗 nvidia.github.io/warp

8. openai/mujoco-py ⭐ 2,792
   MuJoCo is a physics engine for detailed, efficient rigid body simulations with contacts. mujoco-py allows using MuJoCo from Python 3.

9. rdkit/rdkit ⭐ 2,530
   The official sources for the RDKit library

10. taichi-dev/difftaichi ⭐ 2,434
    10 differentiable physical simulators built with Taichi differentiable programming (DiffTaichi, ICLR 2020)

11. projectmesa/mesa ⭐ 2,308
    Mesa is an open-source Python library for agent-based modeling, ideal for simulating complex systems and exploring emergent behaviors.
    🔗 mesa.readthedocs.io

12. google/brax ⭐ 2,152
    Massively parallel rigidbody physics simulation on accelerator hardware.

13. quantecon/QuantEcon.py ⭐ 1,901
    A community based Python library for quantitative economics
    🔗 quantecon.org/quantecon-py

14. facebookresearch/habitat-lab ⭐ 1,833
    A modular high-level library to train embodied AI agents across a variety of tasks and environments.
    🔗 aihabitat.org

15. nvidia-omniverse/IsaacGymEnvs ⭐ 1,794
    Example RL environments for the NVIDIA Isaac Gym high performance environments

16. microsoft/PromptCraft-Robotics ⭐ 1,791
    Community for applying LLMs to robotics and a robot simulator with ChatGPT integration
    🔗 aka.ms/chatgpt-robotics

17. nvidia-omniverse/IsaacLab ⭐ 1,604
    Unified framework for robot learning built on NVIDIA Isaac Sim
    🔗 isaac-sim.github.io/isaaclab

18. deepmodeling/deepmd-kit ⭐ 1,413
    A deep learning package for many-body potential energy representation and molecular dynamics
    🔗 docs.deepmodeling.com/projects/deepmd

19. sail-sg/envpool ⭐ 1,047
    C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
    🔗 envpool.readthedocs.io

20. a-r-j/graphein ⭐ 1,002
    Protein Graph Library
    🔗 graphein.ai

21. bowang-lab/scGPT ⭐ 930
    scGPT: Towards Building a Foundation Model for Single-Cell Multi-omics Using Generative AI
    🔗 scgpt.readthedocs.io/en/latest

22. hardmaru/estool ⭐ 927
    Evolution Strategies Tool

23. viblo/pymunk ⭐ 903
    Pymunk is a easy-to-use pythonic 2d physics library that can be used whenever you need 2d rigid body physics from Python
    🔗 www.pymunk.org

24. google-deepmind/materials_discovery ⭐ 841
    Graph Networks for Materials Science (GNoME) is a project centered around scaling machine learning methods to tackle materials science.

25. facebookresearch/fairo ⭐ 838
    A modular embodied agent architecture and platform for building embodied agents

26. google/evojax ⭐ 816
    EvoJAX is a scalable, general purpose, hardware-accelerated neuroevolution toolkit built on the JAX library

27. nvidia-omniverse/OmniIsaacGymEnvs ⭐ 777
    Reinforcement Learning Environments for Omniverse Isaac Gym

28. eureka-research/DrEureka ⭐ 749
    Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)
    🔗 eureka-research.github.io/dr-eureka

Study

Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials.

1. thealgorithms/Python ⭐ 182,280
   All Algorithms implemented in Python
   🔗 the-algorithms.com

2. microsoft/generative-ai-for-beginners ⭐ 56,729
   18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
   🔗 microsoft.github.io/generative-ai-for-beginners

3. jakevdp/PythonDataScienceHandbook ⭐ 42,219
   Python Data Science Handbook: full text in Jupyter Notebooks
   🔗 jakevdp.github.io/pythondatasciencehandbook

4. mlabonne/llm-course ⭐ 34,298
   Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
   🔗 mlabonne.github.io/blog

5. realpython/python-guide ⭐ 28,013
   Python best practices guidebook, written for humans.
   🔗 docs.python-guide.org

6. christoschristofidis/awesome-deep-learning ⭐ 23,336
   A curated list of awesome Deep Learning tutorials, projects and communities.

7. rasbt/LLMs-from-scratch ⭐ 23,082
   Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
   🔗 www.manning.com/books/build-a-large-language-model-from-scratch

8. d2l-ai/d2l-en ⭐ 22,570
   Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
   🔗 d2l.ai

9. wesm/pydata-book ⭐ 21,698
   Materials and IPython notebooks for "Python for Data Analysis" by Wes McKinney, published by O'Reilly Media

10. microsoft/recommenders ⭐ 18,478
    Best Practices on Recommendation Systems
    🔗 recommenders-team.github.io/recommenders/intro.html

11. fchollet/deep-learning-with-python-notebooks ⭐ 17,963
    Jupyter notebooks for the code samples of the book "Deep Learning with Python"

12. hannibal046/Awesome-LLM ⭐ 16,195
    Awesome-LLM: a curated list of Large Language Model

13. graykode/nlp-tutorial ⭐ 13,926
    Natural Language Processing Tutorial for Deep Learning Researchers
    🔗 www.reddit.com/r/machinelearning/comments/amfinl/project_nlptutoral_repository_who_is_studying

14. shangtongzhang/reinforcement-learning-an-introduction ⭐ 13,352
    Python Implementation of Reinforcement Learning: An Introduction

15. naklecha/llama3-from-scratch ⭐ 11,288
    llama3 implementation one matrix multiplication at a time

16. karpathy/nn-zero-to-hero ⭐ 11,063
    Neural Networks: Zero to Hero

17. eugeneyan/open-llms ⭐ 10,640
    📋 A list of open LLMs available for commercial use.

18. openai/spinningup ⭐ 9,837
    An educational resource to help anyone learn deep reinforcement learning.
    🔗 spinningup.openai.com

19. rucaibox/LLMSurvey ⭐ 9,626
    The official GitHub page for the survey paper "A Survey of Large Language Models".
    🔗 arxiv.org/abs/2303.18223

20. karpathy/micrograd ⭐ 9,532
    A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

21. mrdbourke/pytorch-deep-learning ⭐ 9,450
    Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
    🔗 learnpytorch.io

22. mooler0410/LLMsPracticalGuide ⭐ 9,045
    A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
    🔗 arxiv.org/abs/2304.13712v2

23. nielsrogge/Transformers-Tutorials ⭐ 8,593
    This repository contains demos I made with the Transformers library by HuggingFace.

24. zhanymkanov/fastapi-best-practices ⭐ 7,867
    FastAPI Best Practices and Conventions we used at our startup

25. firmai/industry-machine-learning ⭐ 7,143
    A curated list of applied machine learning and data science notebooks and libraries across different industries (by @firmai)
    🔗 www.linkedin.com/company/firmai

26. gkamradt/langchain-tutorials ⭐ 6,525
    Overview and tutorial of the LangChain Library

27. udlbook/udlbook ⭐ 5,536
    Understanding Deep Learning - Simon J.D. Prince

28. srush/GPU-Puzzles ⭐ 5,408
    Teaching beginner GPU programming in a completely interactive fashion

29. neetcode-gh/leetcode ⭐ 5,326
    Leetcode solutions for NeetCode.io

30. udacity/deep-learning-v2-pytorch ⭐ 5,238
    Projects and exercises for the latest Deep Learning ND program https://www.udacity.com/course/deep-learning-nanodegree--nd101

31. mrdbourke/tensorflow-deep-learning ⭐ 5,043
    All course materials for the Zero to Mastery Deep Learning with TensorFlow course.
    🔗 dbourke.link/ztmtfcourse

32. roboflow/notebooks ⭐ 4,841
    Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.
    🔗 roboflow.com/models

33. timofurrer/awesome-asyncio ⭐ 4,487
    A curated list of awesome Python asyncio frameworks, libraries, software and resources

34. zotroneneis/machine_learning_basics ⭐ 4,246
    Plain python implementations of basic machine learning algorithms

35. alirezadir/Machine-Learning-Interviews ⭐ 3,951
    This repo is meant to serve as a guide for Machine Learning/AI technical interviews.

36. huggingface/deep-rl-class ⭐ 3,739
    This repo contains the syllabus of the Hugging Face Deep Reinforcement Learning Course.

37. promptslab/Awesome-Prompt-Engineering ⭐ 3,524
    This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
    🔗 discord.gg/m88xfymbk6

38. huggingface/diffusion-models-class ⭐ 3,400
    Materials for the Hugging Face Diffusion Models Course

39. cosmicpython/book ⭐ 3,326
    A Book about Pythonic Application Architecture Patterns for Managing Complexity. Cosmos is the Opposite of Chaos you see. O'R. wouldn't actually let us call it "Cosmic Python" tho.
    🔗 www.cosmicpython.com

40. rasbt/machine-learning-book ⭐ 3,122
    Code Repository for Machine Learning with PyTorch and Scikit-Learn
    🔗 sebastianraschka.com/books/#machine-learning-with-pytorch-and-scikit-learn

41. fluentpython/example-code-2e ⭐ 3,087
    Example code for Fluent Python, 2nd edition (O'Reilly 2022)
    🔗 amzn.to/3j48u2j

42. amanchadha/coursera-deep-learning-specialization ⭐ 2,877
    Notes, programming assignments and quizzes from all courses within the Coursera Deep Learning specialization offered by deeplearning.ai: (i) Neural Networks and Deep Learning; (ii) Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization; (iii) Structuring Machine Learning Projects; (iv...

43. mrdbourke/zero-to-mastery-ml ⭐ 2,752
    All course materials for the Zero to Mastery Machine Learning and Data Science course.
    🔗 dbourke.link/ztmmlcourse

44. krzjoa/awesome-python-data-science ⭐ 2,429
    Probably the best curated list of data science software in Python.
    🔗 krzjoa.github.io/awesome-python-data-science

45. cgpotts/cs224u ⭐ 2,081
    Code for CS224u: Natural Language Understanding

46. cerlymarco/MEDIUM_NoteBook ⭐ 2,050
    Repository containing notebooks of my posts on Medium

47. gerdm/prml ⭐ 2,016
    Repository of notes, code and notebooks in Python for the book Pattern Recognition and Machine Learning by Christopher Bishop

48. trananhkma/fucking-awesome-python ⭐ 1,977
    awesome-python with ⭐ and 🍴

49. chandlerbang/awesome-self-supervised-gnn ⭐ 1,516
    Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

50. atcold/NYU-DLSP21 ⭐ 1,512
    NYU Deep Learning Spring 2021
    🔗 atcold.github.io/nyu-dlsp21

51. huggingface/cookbook ⭐ 1,507
    Community-driven practical examples of building AI applications and solving various tasks with AI using open-source tools and models.
    🔗 huggingface.co/learn/cookbook

52. patrickloeber/MLfromscratch ⭐ 1,222
    Machine Learning algorithm implementations from scratch.

53. davidadsp/Generative_Deep_Learning_2nd_Edition ⭐ 972
    The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.
    🔗 www.oreilly.com/library/view/generative-deep-learning/9781098134174

54. jackhidary/quantumcomputingbook ⭐ 778
    Companion site for the textbook Quantum Computing: An Applied Approach

55. dylanhogg/awesome-python ⭐ 281
    🐍 Hand-picked awesome Python libraries and frameworks, organised by category
    🔗 www.awesomepython.org

Template

Template tools and libraries: cookiecutter repos, generators, quick-starts.

1. tiangolo/full-stack-fastapi-template ⭐ 24,714
   Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.

2. cookiecutter/cookiecutter ⭐ 22,018
   A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.
   🔗 pypi.org/project/cookiecutter

3. drivendata/cookiecutter-data-science ⭐ 7,992
   A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.
   🔗 cookiecutter-data-science.drivendata.org

4. buuntu/fastapi-react ⭐ 2,145
   🚀 Cookiecutter Template for FastAPI + React Projects. Using PostgreSQL, SQLAlchemy, and Docker

5. pyscaffold/pyscaffold ⭐ 2,053
   🛠 Python project template generator with batteries included
   🔗 pyscaffold.org

6. cjolowicz/cookiecutter-hypermodern-python ⭐ 1,762
   Cookiecutter template for a Python package based on the Hypermodern Python article series.
   🔗 cookiecutter-hypermodern-python.readthedocs.io

7. tezromach/python-package-template ⭐ 1,085
   🚀 Your next Python package needs a bleeding-edge project structure.

8. martinheinz/python-project-blueprint ⭐ 952
   Blueprint/Boilerplate For Python Projects

9. fmind/mlops-python-package ⭐ 578
   Kickstart your MLOps initiative with a flexible, robust, and productive Python package.
   🔗 fmind.github.io/mlops-python-package

Terminal

Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars.

1. willmcgugan/rich ⭐ 48,285
   Rich is a Python library for rich text and beautiful formatting in the terminal.
   🔗 rich.readthedocs.io/en/latest

2. tqdm/tqdm ⭐ 27,987
   ⚡ A Fast, Extensible Progress Bar for Python and CLI
   🔗 tqdm.github.io

3. google/python-fire ⭐ 26,616
   Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.

4. willmcgugan/textual ⭐ 24,279
   The lean application framework for Python. Build sophisticated user interfaces with a simple Python API. Run your apps in the terminal and a web browser.
   🔗 textual.textualize.io

5. pallets/click ⭐ 15,322
   Python composable command line interface toolkit
   🔗 click.palletsprojects.com

6. tiangolo/typer ⭐ 14,925
   Typer, build great CLIs. Easy to code. Based on Python type hints.
   🔗 typer.tiangolo.com

7. saulpw/visidata ⭐ 7,692
   A terminal spreadsheet multitool for discovering and arranging data
   🔗 visidata.org

8. tconbeer/harlequin ⭐ 3,357
   The SQL IDE for Your Terminal.
   🔗 harlequin.sh

9. manrajgrover/halo ⭐ 2,865
   💫 Beautiful spinners for terminal, IPython and Jupyter

10. urwid/urwid ⭐ 2,765
    Console user interface library for Python (official repo)
    🔗 urwid.org

11. textualize/trogon ⭐ 2,406
    Easily turn your Click CLI into a powerful terminal application

12. darrenburns/elia ⭐ 1,633
    A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

13. tmbo/questionary ⭐ 1,476
    Python library to build pretty command line user prompts ✨Easy to use multi-select lists, confirmations, free text prompts ...

14. jazzband/prettytable ⭐ 1,312
    Display tabular data in a visually appealing ASCII table format
    🔗 pypi.org/project/prettytable

15. 1j01/textual-paint ⭐ 929
    🎨 MS Paint in your terminal.
    🔗 pypi.org/project/textual-paint

Testing

Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins.

1. mitmproxy/mitmproxy ⭐ 35,318
   An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.
   🔗 mitmproxy.org

2. locustio/locust ⭐ 24,243
   Write scalable load tests in plain Python 🚗💨

3. pytest-dev/pytest ⭐ 11,669
   The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
   🔗 pytest.org

4. microsoft/playwright-python ⭐ 11,208
   Python version of the Playwright testing and automation library.
   🔗 playwright.dev/python

5. robotframework/robotframework ⭐ 9,414
   Generic automation framework for acceptance testing and RPA
   🔗 robotframework.org

6. getmoto/moto ⭐ 7,503
   A library that allows you to easily mock out tests based on AWS infrastructure.
   🔗 docs.getmoto.org/en/latest

7. hypothesisworks/hypothesis ⭐ 7,416
   Hypothesis is a powerful, flexible, and easy to use library for property-based testing.
   🔗 hypothesis.works

8. newsapps/beeswithmachineguns ⭐ 6,424
   A utility for arming (creating) many bees (micro EC2 instances) to attack (load test) targets (web applications).
   🔗 apps.chicagotribune.com

9. seleniumbase/SeleniumBase ⭐ 4,505
   📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
   🔗 seleniumbase.io

10. getsentry/responses ⭐ 4,088
    A utility for mocking out the Python Requests library.

11. codium-ai/cover-agent ⭐ 4,042
    CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! 💻🤖🧪🐞
    🔗 www.codium.ai

12. spulec/freezegun ⭐ 4,041
    Let your Python tests travel through time

13. tox-dev/tox ⭐ 3,585
    Command line driven CI frontend and development task automation tool.
    🔗 tox.wiki

14. behave/behave ⭐ 3,106
    BDD, Python style.
    🔗 behave.readthedocs.io/en/latest

15. nedbat/coveragepy ⭐ 2,911
    The code coverage tool for Python
    🔗 coverage.readthedocs.io

16. cobrateam/splinter ⭐ 2,700
    splinter - python test framework for web applications
    🔗 splinter.readthedocs.org/en/stable/index.html

17. kevin1024/vcrpy ⭐ 2,652
    Automatically mock your HTTP interactions to simplify and speed up testing

18. confident-ai/deepeval ⭐ 2,445
    The LLM Evaluation Framework
    🔗 docs.confident-ai.com

19. pytest-dev/pytest-testinfra ⭐ 2,343
    With Testinfra you can write unit tests in Python to test actual state of your servers configured by management tools like Salt, Ansible, Puppet, Chef and so on.
    🔗 testinfra.readthedocs.io

20. pytest-dev/pytest-mock ⭐ 1,790
    Thin-wrapper around the mock package for easier use with pytest
    🔗 pytest-mock.readthedocs.io/en/latest

21. pytest-dev/pytest-cov ⭐ 1,699
    Coverage plugin for pytest.

22. pytest-dev/pytest-xdist ⭐ 1,408
    pytest plugin for distributed testing and loop-on-failures testing modes.
    🔗 pytest-xdist.readthedocs.io

23. pytest-dev/pytest-asyncio ⭐ 1,367
    Asyncio support for pytest
    🔗 pytest-asyncio.readthedocs.io

24. taverntesting/tavern ⭐ 1,005
    A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax
    🔗 taverntesting.github.io

Machine Learning - Time Series

Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics.

1. facebook/prophet ⭐ 18,069
   Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
   🔗 facebook.github.io/prophet

2. blue-yonder/tsfresh ⭐ 8,230
   Automatic extraction of relevant features from time series:
   🔗 tsfresh.readthedocs.io

3. sktime/sktime ⭐ 7,606
   A unified framework for machine learning with time series
   🔗 www.sktime.net

4. unit8co/darts ⭐ 7,603
   A python library for user-friendly forecasting and anomaly detection on time series.
   🔗 unit8co.github.io/darts

5. facebookresearch/Kats ⭐ 4,849
   Kats, a kit to analyze time series data, a lightweight, easy-to-use, generalizable, and extendable framework to perform time series analysis, from understanding the key statistics and characteristics, detecting change points and anomalies, to forecasting future trends.

6. awslabs/gluonts ⭐ 4,454
   Probabilistic time series modeling in Python
   🔗 ts.gluon.ai

7. nixtla/statsforecast ⭐ 3,740
   Lightning ⚡️ fast forecasting with statistical and econometric models.
   🔗 nixtlaverse.nixtla.io/statsforecast

8. salesforce/Merlion ⭐ 3,312
   Merlion: A Machine Learning Framework for Time Series Intelligence

9. google-research/timesfm ⭐ 3,171
   TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
   🔗 research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting

10. tdameritrade/stumpy ⭐ 3,088
    STUMPY is a powerful and scalable Python library for modern time series analysis
    🔗 stumpy.readthedocs.io/en/latest

11. amazon-science/chronos-forecasting ⭐ 2,103
    Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
    🔗 arxiv.org/abs/2403.07815

12. rjt1990/pyflux ⭐ 2,099
    Open source time series library for Python

13. aistream-peelout/flow-forecast ⭐ 1,964
    Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).
    🔗 flow-forecast.atlassian.net/wiki/spaces/ff/overview

14. uber/orbit ⭐ 1,833
    A Python package for Bayesian forecasting with object-oriented design and probabilistic models under the hood.
    🔗 orbit-ml.readthedocs.io/en/stable

15. alkaline-ml/pmdarima ⭐ 1,553
    A statistical library designed to fill the void in Python's time series analysis capabilities, including the equivalent of R's auto.arima function.
    🔗 www.alkaline-ml.com/pmdarima

16. time-series-foundation-models/lag-llama ⭐ 1,120
    Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

17. winedarksea/AutoTS ⭐ 1,057
    Automated Time Series Forecasting

18. autoviml/Auto_TS ⭐ 700
    Automatically build ARIMA, SARIMAX, VAR, FB Prophet and XGBoost Models on Time Series data sets with a Single Line of Code. Created by Ram Seshadri. Collaborators welcome.

19. google/temporian ⭐ 654
    Temporian is an open-source Python library for preprocessing ⚡ and feature engineering 🛠 temporal data 📈 for machine learning applications 🤖
    🔗 temporian.readthedocs.io

Typing

Typing libraries: static and run-time type checking, annotations.

1. python/mypy ⭐ 17,920
   Optional static typing for Python
   🔗 www.mypy-lang.org

2. microsoft/pyright ⭐ 12,699
   Static Type Checker for Python

3. facebook/pyre-check ⭐ 6,753
   Performant type-checking for python.
   🔗 pyre-check.org

4. python-attrs/attrs ⭐ 5,153
   Python Classes Without Boilerplate
   🔗 www.attrs.org

5. instagram/MonkeyType ⭐ 4,693
   A Python library that generates static type annotations by collecting runtime types

6. google/pytype ⭐ 4,676
   A static type analyzer for Python code
   🔗 google.github.io/pytype

7. python/typeshed ⭐ 4,172
   Collection of library stubs for Python, with static types

8. mtshiba/pylyzer ⭐ 2,161
   A fast static code analyzer & language server for Python
   🔗 mtshiba.github.io/pylyzer

9. microsoft/pylance-release ⭐ 1,684
   Fast, feature-rich language support for Python. Documentation and issues for Pylance.

10. agronholm/typeguard ⭐ 1,473
    Run-time type checker for Python

11. patrick-kidger/torchtyping ⭐ 1,358
    Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.

12. robertcraigie/pyright-python ⭐ 152
    Python command line wrapper for pyright, a static type checker
    🔗 pypi.org/project/pyright

Utility

General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools.

1. yt-dlp/yt-dlp ⭐ 77,167
   A feature-rich command-line audio/video downloader
   🔗 discord.gg/h5mncfw63r

2. home-assistant/core ⭐ 69,988
   🏡 Open source home automation that puts local control and privacy first.
   🔗 www.home-assistant.io

3. python/cpython ⭐ 61,174
   The Python programming language
   🔗 www.python.org

4. localstack/localstack ⭐ 53,077
   💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
   🔗 localstack.cloud

5. faif/python-patterns ⭐ 39,914
   A collection of design patterns/idioms in Python

6. mingrammer/diagrams ⭐ 35,681
   🎨 Diagram as Code for prototyping cloud system architectures
   🔗 diagrams.mingrammer.com

7. ggerganov/whisper.cpp ⭐ 33,185
   Port of OpenAI's Whisper model in C/C++

8. keon/algorithms ⭐ 23,798
   Minimal examples of data structures and algorithms in Python

9. norvig/pytudes ⭐ 22,532
   Python programs, usually short, of considerable difficulty, to perfect particular skills.

10. modularml/mojo ⭐ 22,334
    The Mojo Programming Language
    🔗 docs.modular.com/mojo

11. openai/openai-python ⭐ 21,237
    The official Python library for the OpenAI API
    🔗 pypi.org/project/openai

12. chriskiehl/Gooey ⭐ 20,499
    Turn (almost) any Python command line program into a full GUI application with one line

13. facebookresearch/audiocraft ⭐ 20,243
    Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

14. pydantic/pydantic ⭐ 19,760
    Data validation using Python type hints
    🔗 docs.pydantic.dev

15. squidfunk/mkdocs-material ⭐ 19,277
    Documentation that simply works
    🔗 squidfunk.github.io/mkdocs-material

16. delgan/loguru ⭐ 18,878
    Python logging made (stupidly) simple

17. micropython/micropython ⭐ 18,771
    MicroPython - a lean and efficient Python implementation for microcontrollers and constrained systems
    🔗 micropython.org

18. mkdocs/mkdocs ⭐ 18,731
    Project documentation with Markdown.
    🔗 www.mkdocs.org

19. rustpython/RustPython ⭐ 18,085
    A Python Interpreter written in Rust
    🔗 rustpython.github.io

20. kivy/kivy ⭐ 17,354
    Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
    🔗 kivy.org

21. higherorderco/Bend ⭐ 16,822
    A massively parallel, high-level programming language
    🔗 higherorderco.com

22. ipython/ipython ⭐ 16,195
    Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.
    🔗 ipython.readthedocs.org

23. blakeblackshear/frigate ⭐ 16,187
    NVR with realtime local object detection for IP cameras
    🔗 frigate.video

24. alievk/avatarify-python ⭐ 16,182
    Avatars for Zoom, Skype and other video-conferencing apps.

25. paul-gauthier/aider ⭐ 14,037
    Aider is a command line tool that lets you pair program with LLMs, to edit code stored in your local git repository
    🔗 aider.chat

26. zulko/moviepy ⭐ 12,141
    Video editing with Python
    🔗 zulko.github.io/moviepy

27. openai/triton ⭐ 12,019
    Development repository for the Triton language and compiler
    🔗 triton-lang.org

28. python-pillow/Pillow ⭐ 11,920
    The Python Imaging Library adds image processing capabilities to Python (Pillow is the friendly PIL fork)
    🔗 python-pillow.org

29. pyodide/pyodide ⭐ 11,743
    Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
    🔗 pyodide.org/en/stable

30. dbader/schedule ⭐ 11,623
    Python job scheduling for humans.
    🔗 schedule.readthedocs.io

31. pyo3/pyo3 ⭐ 11,543
    Rust bindings for the Python interpreter
    🔗 pyo3.rs

32. pytube/pytube ⭐ 11,436
    A lightweight, dependency-free Python library (and command-line utility) for downloading YouTube Videos.
    🔗 pytube.io

33. nuitka/Nuitka ⭐ 11,432
    Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4-3.12. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
    🔗 nuitka.net

34. caronc/apprise ⭐ 11,010
    Apprise - Push Notifications that work with just about every platform!
    🔗 hub.docker.com/r/caronc/apprise

35. ninja-build/ninja ⭐ 10,823
    Ninja is a small build system with a focus on speed.
    🔗 ninja-build.org

36. secdev/scapy ⭐ 10,342
    Scapy: the Python-based interactive packet manipulation program & library.
    🔗 scapy.net

37. magicstack/uvloop ⭐ 10,170
    Ultra fast asyncio event loop.

38. pallets/jinja ⭐ 10,111
    A very fast and expressive template engine.
    🔗 jinja.palletsprojects.com

39. asweigart/pyautogui ⭐ 9,948
    A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.

40. aws/serverless-application-model ⭐ 9,291
    The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation templates.
    🔗 aws.amazon.com/serverless/sam

41. cython/cython ⭐ 9,190
    The most widely used Python to C compiler
    🔗 cython.org

42. paramiko/paramiko ⭐ 8,947
    The leading native Python SSHv2 protocol library.
    🔗 paramiko.org

43. boto/boto3 ⭐ 8,846
    AWS SDK for Python
    🔗 aws.amazon.com/sdk-for-python

44. arrow-py/arrow ⭐ 8,631
    🏹 Better dates & times for Python
    🔗 arrow.readthedocs.io

45. facebookresearch/hydra ⭐ 8,425
    Hydra is a framework for elegantly configuring complex applications
    🔗 hydra.cc

46. xonsh/xonsh ⭐ 8,195
    🐚 Python-powered shell. Full-featured and cross-platform.
    🔗 xon.sh

47. eternnoir/pyTelegramBotAPI ⭐ 7,900
    Python Telegram bot api.

48. py-pdf/pypdf ⭐ 7,779
    A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
    🔗 pypdf.readthedocs.io/en/latest

49. kellyjonbrazil/jc ⭐ 7,704
    CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.

50. googleapis/google-api-python-client ⭐ 7,576
    🐍 The official Python client library for Google's discovery based APIs.
    🔗 googleapis.github.io/google-api-python-client/docs

51. theskumar/python-dotenv ⭐ 7,341
    Reads key-value pairs from a .env file and can set them as environment variables. It helps in developing applications following the 12-factor principles.
    🔗 saurabh-kumar.com/python-dotenv

52. jasonppy/VoiceCraft ⭐ 7,251
    Zero-Shot Speech Editing and Text-to-Speech in the Wild

53. google/latexify_py ⭐ 7,105
    A library to generate LaTeX expression from Python code.

54. googlecloudplatform/python-docs-samples ⭐ 7,104
    Code samples used on cloud.google.com

55. marshmallow-code/marshmallow ⭐ 6,939
    A lightweight library for converting complex objects to and from simple Python datatypes.
    🔗 marshmallow.readthedocs.io

56. hugapi/hug ⭐ 6,854
    Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

57. pygithub/PyGithub ⭐ 6,816
    Typed interactions with the GitHub API v3
    🔗 pygithub.readthedocs.io

58. pyca/cryptography ⭐ 6,428
    cryptography is a package designed to expose cryptographic primitives and recipes to Python developers.
    🔗 cryptography.io

59. openai/point-e ⭐ 6,416
    Point cloud diffusion for 3D model synthesis

60. gorakhargosh/watchdog ⭐ 6,399
    Python library and shell utilities to monitor filesystem events.
    🔗 packages.python.org/watchdog

61. jd/tenacity ⭐ 6,320
    Retrying library for Python
    🔗 tenacity.readthedocs.io

62. icloud-photos-downloader/icloud_photos_downloader ⭐ 6,257
    A command-line tool to download photos from iCloud

63. sphinx-doc/sphinx ⭐ 6,222
    The Sphinx documentation generator
    🔗 www.sphinx-doc.org

64. sdispater/pendulum ⭐ 6,127
    Python datetimes made easy
    🔗 pendulum.eustace.io

65. bndr/pipreqs ⭐ 5,993
    pipreqs - Generate pip requirements.txt file based on imports of any project. Looking for maintainers to move this project forward.

66. agronholm/apscheduler ⭐ 5,965
    Task scheduling library for Python

67. scikit-image/scikit-image ⭐ 5,961
    Image processing in Python
    🔗 scikit-image.org

68. wireservice/csvkit ⭐ 5,907
    A suite of utilities for converting to and working with CSV, the king of tabular file formats.
    🔗 csvkit.readthedocs.io

69. ijl/orjson ⭐ 5,863
    Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

70. timdettmers/bitsandbytes ⭐ 5,781
    Accessible large language models via k-bit quantization for PyTorch.
    🔗 huggingface.co/docs/bitsandbytes/main/en/index

71. pdfminer/pdfminer.six ⭐ 5,659
    Community maintained fork of pdfminer - we fathom PDF
    🔗 pdfminersix.readthedocs.io

72. pytransitions/transitions ⭐ 5,520
    A lightweight, object-oriented finite state machine implementation in Python with many extensions

73. rsalmei/alive-progress ⭐ 5,259
    A new kind of Progress Bar, with real-time throughput, ETA, and very cool animations!

74. buildbot/buildbot ⭐ 5,200
    Python-based continuous integration testing framework; your pull requests are more than welcome!
    🔗 www.buildbot.net

75. prompt-toolkit/ptpython ⭐ 5,125
    A better Python REPL

76. pycqa/pycodestyle ⭐ 5,005
    Simple Python style checker in one Python file
    🔗 pycodestyle.pycqa.org

77. spotify/pedalboard ⭐ 4,992
    🎛 🔊 A Python library for audio.
    🔗 spotify.github.io/pedalboard

78. jorgebastida/awslogs ⭐ 4,802
    AWS CloudWatch logs for Humans™

79. pywinauto/pywinauto ⭐ 4,784
    Windows GUI Automation with Python (based on text properties)
    🔗 pywinauto.github.io

80. tebelorg/RPA-Python ⭐ 4,716
    Python package for doing RPA

81. pytoolz/toolz ⭐ 4,583
    A functional standard library for Python.
    🔗 toolz.readthedocs.org

82. hhatto/autopep8 ⭐ 4,542
    A tool that automatically formats Python code to conform to the PEP 8 style guide.
    🔗 pypi.org/project/autopep8

83. pyinvoke/invoke ⭐ 4,322
    Pythonic task management & command execution.
    🔗 pyinvoke.org

84. bogdanp/dramatiq ⭐ 4,164
    A fast and reliable background task processing library for Python 3.
    🔗 dramatiq.io

85. evhub/coconut ⭐ 4,003
    Coconut (coconut-lang.org) is a variant of Python that adds on top of Python syntax new features for simple, elegant, Pythonic functional programming.
    🔗 coconut-lang.org

86. adafruit/circuitpython ⭐ 3,969
    CircuitPython - a Python implementation for teaching coding with microcontrollers
    🔗 circuitpython.org

87. ashleve/lightning-hydra-template ⭐ 3,889
    PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

88. miguelgrinberg/python-socketio ⭐ 3,866
    Python Socket.IO server and client

89. joblib/joblib ⭐ 3,749
    Computing with Python functions.
    🔗 joblib.readthedocs.org

90. rspeer/python-ftfy ⭐ 3,733
    Fixes mojibake and other glitches in Unicode text, after the fact.
    🔗 ftfy.readthedocs.org

91. pyinfra-dev/pyinfra ⭐ 3,717
    pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
    🔗 pyinfra.com

92. ets-labs/python-dependency-injector ⭐ 3,717
    Dependency injection framework for Python
    🔗 python-dependency-injector.ets-labs.org

93. python-markdown/markdown ⭐ 3,672
    A Python implementation of John Gruber’s Markdown with Extension support.
    🔗 python-markdown.github.io

94. zeromq/pyzmq ⭐ 3,619
    PyZMQ: Python bindings for zeromq
    🔗 zguide.zeromq.org/py:all

95. more-itertools/more-itertools ⭐ 3,612
    More routines for operating on iterables, beyond itertools
    🔗 more-itertools.rtfd.io

96. blealtan/efficient-kan ⭐ 3,606
    An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).

97. pyo3/maturin ⭐ 3,517
    Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages
    🔗 maturin.rs

98. pypi/warehouse ⭐ 3,514
    The Python Package Index
    🔗 pypi.org

99. pydata/xarray ⭐ 3,510
    N-D labeled arrays and datasets in Python
    🔗 xarray.dev

100. tartley/colorama ⭐ 3,481
     Simple cross-platform colored terminal text in Python

101. osohq/oso ⭐ 3,448
     Oso is a batteries-included framework for building authorization in your application.
     🔗 docs.osohq.com

102. jorisschellekens/borb ⭐ 3,339
     borb is a library for reading, creating and manipulating PDF files in python.
     🔗 borbpdf.com

103. suor/funcy ⭐ 3,324
     A fancy and practical functional tools

104. pyserial/pyserial ⭐ 3,158
     Python serial port access library

105. spotify/basic-pitch ⭐ 3,151
     A lightweight yet powerful audio-to-MIDI converter with pitch bend detection
     🔗 basicpitch.io

106. camelot-dev/camelot ⭐ 2,807
     A Python library to extract tabular data from PDFs
     🔗 camelot-py.readthedocs.io

107. legrandin/pycryptodome ⭐ 2,750
     A self-contained cryptographic library for Python
     🔗 www.pycryptodome.org

108. tox-dev/pipdeptree ⭐ 2,735
     A command line utility to display dependency tree of the installed Python packages
     🔗 pypi.python.org/pypi/pipdeptree

109. lxml/lxml ⭐ 2,624
     The lxml XML toolkit for Python
     🔗 lxml.de

110. liiight/notifiers ⭐ 2,623
     The easy way to send notifications
     🔗 notifiers.readthedocs.io

111. whylabs/whylogs ⭐ 2,595
     An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
     🔗 whylogs.readthedocs.io

112. pexpect/pexpect ⭐ 2,565
     A Python module for controlling interactive programs in a pseudo-terminal
     🔗 pexpect.readthedocs.io

113. litl/backoff ⭐ 2,531
     Python library providing function decorators for configurable backoff and retry

114. pyston/pyston ⭐ 2,505
     A faster and highly-compatible implementation of the Python programming language.
     🔗 www.pyston.org

115. scrapinghub/dateparser ⭐ 2,505
     python parser for human readable dates

116. yaml/pyyaml ⭐ 2,482
     Canonical source repository for PyYAML

117. dosisod/refurb ⭐ 2,464
     A tool for refurbishing and modernizing Python codebases

118. cdgriffith/Box ⭐ 2,411
     Python dictionaries with advanced dot notation access
     🔗 github.com/cdgriffith/box/wiki

119. pypa/setuptools ⭐ 2,390
     Official project repository for the Setuptools build system
     🔗 pypi.org/project/setuptools

120. nschloe/tikzplotlib ⭐ 2,356
     📊 Save matplotlib figures as TikZ/PGFplots for smooth integration into LaTeX.

121. hgrecco/pint ⭐ 2,329
     Operate and manipulate physical quantities in Python
     🔗 pint.readthedocs.org

122. dateutil/dateutil ⭐ 2,287
     Useful extensions to the standard Python datetime features

123. grantjenks/python-diskcache ⭐ 2,251
     Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
     🔗 www.grantjenks.com/docs/diskcache

124. pndurette/gTTS ⭐ 2,198
     Python library and CLI tool to interface with Google Translate's text-to-speech API
     🔗 gtts.readthedocs.org

125. kiminewt/pyshark ⭐ 2,175
     Python wrapper for tshark, allowing python packet parsing using wireshark dissectors

126. ianmiell/shutit ⭐ 2,149
     Automation framework for programmers
     🔗 ianmiell.github.io/shutit

127. pyparsing/pyparsing ⭐ 2,147
     Python library for creating PEG parsers

128. jcrist/msgspec ⭐ 2,099
     A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
     🔗 jcristharif.com/msgspec

129. libaudioflux/audioFlux ⭐ 2,096
     A library for audio and music analysis, feature extraction.
     🔗 audioflux.top

130. astanin/python-tabulate ⭐ 2,053
     Pretty-print tabular data in Python, a library and a command-line utility. Repository migrated from bitbucket.org/astanin/python-tabulate.
     🔗 pypi.org/project/tabulate

131. google/gin-config ⭐ 2,017
     Gin provides a lightweight configuration framework for Python

132. grahamdumpleton/wrapt ⭐ 2,012
     A Python module for decorators, wrappers and monkey patching.

133. nateshmbhat/pyttsx3 ⭐ 2,001
     Offline Text To Speech synthesis for python

134. pyfilesystem/pyfilesystem2 ⭐ 1,966
     Python's Filesystem abstraction layer
     🔗 www.pyfilesystem.org

135. landscapeio/prospector ⭐ 1,922
     Inspects Python source files and provides information about type and location of classes, methods etc

136. python-rope/rope ⭐ 1,890
     a python refactoring library

137. mitmproxy/pdoc ⭐ 1,880
     API Documentation for Python Projects
     🔗 pdoc.dev

138. julienpalard/Pipe ⭐ 1,878
     A Python library to use infix notation in Python

139. omry/omegaconf ⭐ 1,876
     Flexible Python configuration system. The last one you will ever need.

140. rhettbull/osxphotos ⭐ 1,874
     Python app to work with pictures and associated metadata from Apple Photos on macOS. Also includes a package to provide programmatic access to the Photos library, pictures, and metadata.

141. numba/llvmlite ⭐ 1,870
     A lightweight LLVM python binding for writing JIT compilers
     🔗 llvmlite.pydata.org

142. chaostoolkit/chaostoolkit ⭐ 1,858
     Chaos Engineering Toolkit & Orchestration for Developers
     🔗 chaostoolkit.org

143. carpedm20/emoji ⭐ 1,853
     emoji terminal output for Python

144. pydoit/doit ⭐ 1,813
     task management & automation tool
     🔗 pydoit.org

145. joowani/binarytree ⭐ 1,810
     Python Library for Studying Binary Trees
     🔗 binarytree.readthedocs.io

146. pygments/pygments ⭐ 1,765
     Pygments is a generic syntax highlighter written in Python
     🔗 pygments.org

147. kalliope-project/kalliope ⭐ 1,709
     Kalliope is a framework that will help you to create your own personal assistant.
     🔗 kalliope-project.github.io

148. pydantic/logfire ⭐ 1,707
     Uncomplicated Observability for Python and beyond! 🪵🔥
     🔗 docs.pydantic.dev/logfire

149. konradhalas/dacite ⭐ 1,697
     Simple creation of data classes from dictionaries.

150. open-telemetry/opentelemetry-python ⭐ 1,676
     OpenTelemetry Python API and SDK
     🔗 opentelemetry.io

151. samuelcolvin/watchfiles ⭐ 1,673
     Simple, modern and fast file watching and code reload in python.
     🔗 watchfiles.helpmanual.io

152. home-assistant/supervisor ⭐ 1,672
     🏡 Home Assistant Supervisor
     🔗 home-assistant.io/hassio

153. p0dalirius/Coercer ⭐ 1,669
     A python script to automatically coerce a Windows server to authenticate on an arbitrary machine through 12 methods.
     🔗 podalirius.net

154. hbldh/bleak ⭐ 1,644
     A cross platform Bluetooth Low Energy Client for Python using asyncio

155. mkdocstrings/mkdocstrings ⭐ 1,632
     📘 Automatic documentation from sources, for MkDocs.
     🔗 mkdocstrings.github.io

156. rubik/radon ⭐ 1,618
     Various code metrics for Python code
     🔗 radon.readthedocs.org

157. facebookincubator/Bowler ⭐ 1,527
     Safe code refactoring for modern Python.
     🔗 pybowler.io

158. nficano/python-lambda ⭐ 1,487
     A toolkit for developing and deploying serverless Python code in AWS Lambda.

159. quodlibet/mutagen ⭐ 1,485
     Python module for handling audio metadata
     🔗 mutagen.readthedocs.io

160. instagram/LibCST ⭐ 1,472
     A concrete syntax tree parser and serializer library for Python that preserves many aspects of Python's abstract syntax tree
     🔗 libcst.readthedocs.io

161. lcompilers/lpython ⭐ 1,470
     Python compiler
     🔗 lpython.org

162. fabiocaccamo/python-benedict ⭐ 1,458
     📘 dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, html, ini, json, pickle, plist, query-string, toml, xls, xml, yaml), s3 support and many utilities.

163. aws-samples/aws-glue-samples ⭐ 1,410
     AWS Glue code samples

164. pycqa/pyflakes ⭐ 1,352
     A simple program which checks Python source files for errors
     🔗 pypi.org/project/pyflakes

165. lidatong/dataclasses-json ⭐ 1,342
     Easily serialize Data Classes to and from JSON

166. ossf/criticality_score ⭐ 1,304
     Gives criticality score for an open source project

167. brandon-rhodes/python-patterns ⭐ 1,288
     Source code behind the python-patterns.guide site by Brandon Rhodes

168. aio-libs/yarl ⭐ 1,271
     Yet another URL library
     🔗 yarl.aio-libs.org

169. jaraco/keyring ⭐ 1,227
     The Python keyring library provides an easy way to access the system keyring service from python. It can be used in any application that needs safe password storage.

170. anthropics/anthropic-sdk-python ⭐ 1,189
     SDK providing access to Anthropic's safety-first language model APIs

171. oracle/graalpython ⭐ 1,168
     A Python 3 implementation built on GraalVM

172. pdoc3/pdoc ⭐ 1,113
     🐍 ➡️ 📜 Auto-generate API documentation for Python projects
     🔗 pdoc3.github.io/pdoc

173. pyo3/rust-numpy ⭐ 1,064
     PyO3-based Rust bindings of the NumPy C-API

174. c4urself/bump2version ⭐ 1,049
     Version-bump your software with a single command
     🔗 pypi.python.org/pypi/bump2version

175. metachris/logzero ⭐ 1,028
     Robust and effective logging for Python 2 and 3.
     🔗 logzero.readthedocs.io

176. pyfpdf/fpdf2 ⭐ 1,013
     Simple PDF generation for Python
     🔗 py-pdf.github.io/fpdf2

177. fsspec/filesystem_spec ⭐ 956
     A specification that python filesystems should adhere to.

178. milvus-io/pymilvus ⭐ 951
     Python SDK for Milvus.

179. fastai/fastcore ⭐ 912
     Python supercharged for the fastai library
     🔗 fastcore.fast.ai

180. lastmile-ai/aiconfig ⭐ 903
     AIConfig saves prompts, models and model parameters as source control friendly configs. This allows you to iterate on prompts and model parameters separately from your application code.
     🔗 aiconfig.lastmileai.dev

181. alex-sherman/unsync ⭐ 872
     Unsynchronize asyncio

182. pypy/pypy ⭐ 846
     PyPy is a very fast and compliant implementation of the Python language.
     🔗 pypy.org

183. samuelcolvin/dirty-equals ⭐ 782
     Doing dirty (but extremely useful) things with equals.
     🔗 dirty-equals.helpmanual.io

184. barracuda-fsh/pyobd ⭐ 777
     An OBD-II compliant car diagnostic tool

185. pypa/build ⭐ 705
     A simple, correct Python build frontend
     🔗 build.pypa.io

186. qdrant/qdrant-client ⭐ 690
     Python client for Qdrant vector search engine
     🔗 qdrant.tech

187. ariebovenberg/whenever ⭐ 682
     ⏰ Modern datetime library for Python, written in Rust
     🔗 whenever.rtfd.io

188. open-telemetry/opentelemetry-python-contrib ⭐ 659
     OpenTelemetry instrumentation for Python modules
     🔗 opentelemetry.io

189. instagram/Fixit ⭐ 659
     Advanced Python linting framework with auto-fixes and hierarchical configuration that makes it easy to write custom in-repo lint rules.
     🔗 fixit.rtfd.io/en/latest

190. modal-labs/modal-examples ⭐ 647
     Examples of programs built using Modal
     🔗 modal.com/docs

191. gefyrahq/gefyra ⭐ 645
     Blazingly-fast 🚀, rock-solid, local application development ➡️ with Kubernetes.
     🔗 gefyra.dev

192. methexis-inc/terminal-copilot ⭐ 565
     A smart terminal assistant that helps you find the right command.

193. platformdirs/platformdirs ⭐ 541
     A small Python module for determining appropriate platform-specific dirs, e.g. a "user data dir".
     🔗 platformdirs.readthedocs.io

194. argoproj-labs/hera ⭐ 531
     Hera is an Argo Python SDK. Hera aims to make construction and submission of various Argo Project resources easy and accessible to everyone! Hera abstracts away low-level setup details while still maintaining a consistent vocabulary with Argo. ⭐️ Remember to star!
     🔗 hera.rtfd.io

195. fastai/ghapi ⭐ 527
     A delightful and complete interface to GitHub's amazing API
     🔗 ghapi.fast.ai

196. steamship-core/steamship-langchain ⭐ 507
     steamship-langchain

197. google/pyglove ⭐ 321
     Manipulating Python Programs

Vizualisation

Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL.

1. apache/superset ⭐ 60,738
   Apache Superset is a Data Visualization and Data Exploration Platform
   🔗 superset.apache.org

2. streamlit/streamlit ⭐ 33,438
   Streamlit — A faster way to build and share data apps.
   🔗 streamlit.io

3. gradio-app/gradio ⭐ 31,019
   Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
   🔗 www.gradio.app

4. plotly/dash ⭐ 20,910
   Data Apps & Dashboards for Python. No JavaScript Required.
   🔗 plotly.com/dash

5. matplotlib/matplotlib ⭐ 19,692
   matplotlib: plotting with Python
   🔗 matplotlib.org/stable

6. bokeh/bokeh ⭐ 19,065
   Interactive Data Visualization in the browser, from Python
   🔗 bokeh.org

7. plotly/plotly.py ⭐ 15,732
   The interactive graphing library for Python ✨ This project now includes Plotly Express!
   🔗 plotly.com/python

8. mwaskom/seaborn ⭐ 12,216
   Statistical data visualization in Python
   🔗 seaborn.pydata.org

9. visgl/deck.gl ⭐ 11,934
   WebGL2 powered visualization framework
   🔗 deck.gl

10. marceloprates/prettymaps ⭐ 11,038
    A small set of Python functions to draw pretty maps from OpenStreetMap data. Based on osmnx, matplotlib and shapely libraries.

11. altair-viz/altair ⭐ 9,082
    Declarative statistical visualization library for Python
    🔗 altair-viz.github.io

12. nvidia/TensorRT-LLM ⭐ 7,510
    TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT...
    🔗 nvidia.github.io/tensorrt-llm

13. lux-org/lux ⭐ 5,075
    Automatically visualize your pandas dataframe via a single print! 📊 💡

14. renpy/renpy ⭐ 4,757
    The Ren'Py Visual Novel Engine
    🔗 www.renpy.org

15. man-group/dtale ⭐ 4,639
    Visualizer for pandas data structures
    🔗 alphatechadmin.pythonanywhere.com

16. holoviz/panel ⭐ 4,466
    Panel: The powerful data exploration & web app framework for Python
    🔗 panel.holoviz.org

17. has2k1/plotnine ⭐ 3,902
    A Grammar of Graphics for Python
    🔗 plotnine.org

18. residentmario/missingno ⭐ 3,864
    missingno provides a small toolset of flexible and easy-to-use missing data visualizations and utilities that allows you to get a quick visual summary of the completeness (or lack thereof) of your dataset.

19. pyqtgraph/pyqtgraph ⭐ 3,777
    Fast data visualization and GUI tools for scientific / engineering applications
    🔗 www.pyqtgraph.org

20. vispy/vispy ⭐ 3,262
    Main repository for Vispy
    🔗 vispy.org

21. ml-tooling/opyrator ⭐ 3,044
    🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
    🔗 opyrator-playground.mltooling.org

22. netflix/flamescope ⭐ 2,991
    FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.

23. facebookresearch/hiplot ⭐ 2,722
    HiPlot makes understanding high dimensional data easy
    🔗 facebookresearch.github.io/hiplot

24. holoviz/holoviews ⭐ 2,665
    With Holoviews, your data visualizes itself.
    🔗 holoviews.org

25. kozea/pygal ⭐ 2,619
    pygal is a dynamic SVG charting library written in python.
    🔗 www.pygal.org

26. pyvista/pyvista ⭐ 2,485
    3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)
    🔗 docs.pyvista.org

27. mckinsey/vizro ⭐ 2,480
    Vizro is a toolkit for creating modular data visualization applications.
    🔗 vizro.readthedocs.io/en/stable

28. marcomusy/vedo ⭐ 1,985
    A python module for scientific analysis of 3D data based on VTK and Numpy
    🔗 vedo.embl.es

29. datapane/datapane ⭐ 1,362
    Build and share data reports in 100% Python
    🔗 datapane.com

30. facultyai/dash-bootstrap-components ⭐ 1,090
    Bootstrap components for Plotly Dash
    🔗 dash-bootstrap-components.opensource.faculty.ai

31. nomic-ai/deepscatter ⭐ 1,001
    Zoomable, animated scatterplots in the browser that scales over a billion points

32. holoviz/holoviz ⭐ 821
    High-level tools to simplify visualization in Python.
    🔗 holoviz.org

33. hazyresearch/meerkat ⭐ 818
    Creative interactive views of any dataset.

Web

Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management.

1. django/django ⭐ 78,066
   The Web framework for perfectionists with deadlines.
   🔗 www.djangoproject.com

2. tiangolo/fastapi ⭐ 73,629
   FastAPI framework, high performance, easy to learn, fast to code, ready for production
   🔗 fastapi.tiangolo.com

3. pallets/flask ⭐ 67,093
   The Python micro framework for building web applications.
   🔗 flask.palletsprojects.com

4. sherlock-project/sherlock ⭐ 52,780
   Hunt down social media accounts by username across social networks
   🔗 sherlockproject.xyz

5. psf/requests ⭐ 51,778
   A simple, yet elegant, HTTP library.
   🔗 requests.readthedocs.io/en/latest

6. tornadoweb/tornado ⭐ 21,621
   Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
   🔗 www.tornadoweb.org

7. reflex-dev/reflex ⭐ 18,075
   🕸️ Web apps in pure Python 🐍
   🔗 reflex.dev

8. huge-success/sanic ⭐ 17,899
   Accelerate your web app development | Build fast. Run fast.
   🔗 sanic.dev

9. wagtail/wagtail ⭐ 17,641
   A Django content management system focused on flexibility and user experience
   🔗 wagtail.org

10. pyscript/pyscript ⭐ 17,573
    A framework that allows users to create rich Python applications in the browser using HTML's interface and the power of Pyodide, WASM, and modern web technologies.
    🔗 pyscript.net

11. aio-libs/aiohttp ⭐ 14,810
    Asynchronous HTTP client/server framework for asyncio and Python
    🔗 docs.aiohttp.org

12. vincigit00/Scrapegraph-ai ⭐ 13,299
    ScrapeGraphAI is a web scraping python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents
    🔗 scrapegraphai.com

13. encode/httpx ⭐ 12,756
    A next generation HTTP client for Python. 🦋
    🔗 www.python-httpx.org

14. getpelican/pelican ⭐ 12,404
    Static site generator that supports Markdown and reST syntax. Powered by Python.
    🔗 getpelican.com

15. aws/chalice ⭐ 10,536
    Python Serverless Microframework for AWS

16. flet-dev/flet ⭐ 10,308
    Flet enables developers to easily build realtime web, mobile and desktop apps in Python. No frontend experience required.
    🔗 flet.dev

17. encode/starlette ⭐ 9,812
    The little ASGI framework that shines. 🌟
    🔗 www.starlette.io

18. benoitc/gunicorn ⭐ 9,647
    gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.
    🔗 www.gunicorn.org

19. falconry/falcon ⭐ 9,447
    The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.
    🔗 falcon.readthedocs.io/en/stable

20. bottlepy/bottle ⭐ 8,341
    bottle.py is a fast and simple micro-framework for python web-applications.
    🔗 bottlepy.org

21. zauberzeug/nicegui ⭐ 8,337
    Create web-based user interfaces with Python. The nice way.
    🔗 nicegui.io

22. encode/uvicorn ⭐ 8,163
    An ASGI web server, for Python. 🦄
    🔗 www.uvicorn.org

23. graphql-python/graphene ⭐ 8,031
    GraphQL framework for Python
    🔗 graphene-python.org

24. reactive-python/reactpy ⭐ 7,767
    ReactPy is a library for building user interfaces in Python without Javascript
    🔗 reactpy.dev

25. pyeve/eve ⭐ 6,676
    REST API framework designed for human beings
    🔗 python-eve.org

26. vitalik/django-ninja ⭐ 6,642
    💨 Fast, Async-ready, Openapi, type hints based framework for building APIs
    🔗 django-ninja.dev

27. pallets/werkzeug ⭐ 6,592
    The comprehensive WSGI web application library.
    🔗 werkzeug.palletsprojects.com

28. webpy/webpy ⭐ 5,882
    web.py is a web framework for python that is as simple as it is powerful.
    🔗 webpy.org

29. starlite-api/litestar ⭐ 5,151
    Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs
    🔗 litestar.dev

30. stephenmcd/mezzanine ⭐ 4,742
    CMS framework for Django
    🔗 mezzanine.jupo.org

31. nameko/nameko ⭐ 4,682
    A microservices framework for Python that lets service developers concentrate on application logic and encourages testability.
    🔗 www.nameko.io

32. pywebio/PyWebIO ⭐ 4,440
    Write interactive web app in script way.
    🔗 pywebio.readthedocs.io

33. fastapi-users/fastapi-users ⭐ 4,331
    Ready-to-use and customizable users management for FastAPI
    🔗 fastapi-users.github.io/fastapi-users

34. pylons/pyramid ⭐ 3,923
    Pyramid - A Python web framework
    🔗 trypyramid.com

35. h2oai/wave ⭐ 3,903
    H2O Wave is a software stack for building beautiful, low-latency, realtime, browser-based applications and dashboards entirely in Python/R without using HTML, Javascript, or CSS.
    🔗 wave.h2o.ai

36. strawberry-graphql/strawberry ⭐ 3,863
    A GraphQL library for Python that leverages type annotations 🍓
    🔗 strawberry.rocks

37. websocket-client/websocket-client ⭐ 3,522
    WebSocket client for Python
    🔗 github.com/websocket-client/websocket-client

38. unbit/uwsgi ⭐ 3,431
    uWSGI application server container
    🔗 projects.unbit.it/uwsgi

39. pallets/quart ⭐ 2,774
    An async Python micro framework for building web applications.
    🔗 quart.palletsprojects.com

40. fastapi-admin/fastapi-admin ⭐ 2,713
    A fast admin dashboard based on FastAPI and TortoiseORM with tabler ui, inspired by Django admin
    🔗 fastapi-admin-docs.long2ice.io

41. flipkart-incubator/Astra ⭐ 2,459
    Automated Security Testing For REST API's

42. masoniteframework/masonite ⭐ 2,168
    The Modern And Developer Centric Python Web Framework. Be sure to read the documentation and join the Discord channel for questions: https://discord.gg/TwKeFahmPZ
    🔗 docs.masoniteproject.com

43. dot-agent/nextpy ⭐ 2,164
    🤖Self-Modifying Framework from the Future 🔮 World's First AMS
    🔗 dotagent.ai

44. python-restx/flask-restx ⭐ 2,119
    Fork of Flask-RESTPlus: Fully featured framework for fast, easy and documented API development with Flask
    🔗 flask-restx.readthedocs.io/en/latest

45. dmontagu/fastapi-utils ⭐ 1,835
    Reusable utilities for FastAPI: a number of utilities to help reduce boilerplate and reuse common functionality across projects

46. s3rius/FastAPI-template ⭐ 1,818
    Feature rich robust FastAPI template.

47. cherrypy/cherrypy ⭐ 1,813
    CherryPy is a pythonic, object-oriented HTTP framework. https://cherrypy.dev
    🔗 docs.cherrypy.dev

48. neoteroi/BlackSheep ⭐ 1,804
    Fast ASGI web framework for Python
    🔗 www.neoteroi.dev/blacksheep

49. indico/indico ⭐ 1,703
    Indico - A feature-rich event management system, made @ CERN, the place where the Web was born.
    🔗 getindico.io

50. jordaneremieff/mangum ⭐ 1,658
    AWS Lambda support for ASGI applications
    🔗 mangum.io

51. wtforms/wtforms ⭐ 1,487
    A flexible forms validation and rendering library for Python.
    🔗 wtforms.readthedocs.io

52. awtkns/fastapi-crudrouter ⭐ 1,346
    A dynamic FastAPI router that automatically creates CRUD routes for your models
    🔗 fastapi-crudrouter.awtkns.com

53. long2ice/fastapi-cache ⭐ 1,208
    fastapi-cache is a tool to cache fastapi response and function result, with backends support redis and memcached.
    🔗 github.com/long2ice/fastapi-cache

54. magicstack/httptools ⭐ 1,182
    Fast HTTP parser

55. rstudio/py-shiny ⭐ 1,123
    Shiny for Python
    🔗 shiny.posit.co/py

56. whitphx/stlite ⭐ 1,099
    A port of Streamlit to WebAssembly, powered by Pyodide.
    🔗 edit.share.stlite.net

57. koxudaxi/fastapi-code-generator ⭐ 967
    This code generator creates FastAPI app from an openapi file.

58. aeternalis-ingenium/FastAPI-Backend-Template ⭐ 590
    A backend project template with FastAPI, PostgreSQL with asynchronous SQLAlchemy 2.0, Alembic for asynchronous database migration, and Docker.

---

Interactive version: www.awesomepython.org, Hugging Face Dataset: awesome-python

Please raise a new issue to suggest a Python repo that you would like to see added.

1,512 hand-picked awesome Python libraries and frameworks, updated 20 Jul 2024