Skip to content

ml-tooling/best-of-python

main
Switch branches/tags
Code

Best-of Python

πŸ†Β  A ranked list of awesome Python open-source libraries & tools. Updated weekly.

This curated list contains 390 awesome open-source projects with a total of 1.4M stars grouped into 28 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml. Contributions are very welcome!


πŸ§™β€β™‚οΈΒ  Discover other best-of lists or create your own.
πŸ“«Β  Subscribe to our newsletter for updates and trending projects.


Contents

Explanation

  • πŸ₯‡πŸ₯ˆπŸ₯‰Β  Combined project-quality score
  • ⭐️  Star count from GitHub
  • 🐣  New project (less than 6 months old)
  • πŸ’€Β  Inactive project (6 months no activity)
  • πŸ’€Β  Dead project (12 months no activity)
  • πŸ“ˆπŸ“‰Β  Project is trending up or down
  • βž•Β  Project was recently added
  • ❗️  Warning (e.g. missing/risky license)
  • πŸ‘¨β€πŸ’»Β  Contributors count from GitHub
  • πŸ”€Β  Fork count from GitHub
  • πŸ“‹Β  Issue count from GitHub
  • ⏱️  Last update timestamp on package manager
  • πŸ“₯Β  Download count from package manager
  • πŸ“¦Β  Number of dependent projects
  • Β  Pandas related project

Data Serialization

Back to top

protobuf (πŸ₯‡49 Β· ⭐ 55K) - Protocol Buffers - Googles data interchange format. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 980 Β· πŸ”€ 14K Β· πŸ“₯ 38M Β· πŸ“¦ 240K Β· πŸ“‹ 5K - 17% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/protocolbuffers/protobuf
    
  • PyPi (πŸ“₯ 91M / month Β· πŸ“¦ 15K Β· ⏱️ 24.06.2022):

     pip install protobuf
    
  • Conda (πŸ“₯ 8.9M Β· ⏱️ 10.05.2022):

     conda install -c conda-forge protobuf
    
  • npm (πŸ“₯ 4.6M / month Β· πŸ“¦ 2.6K Β· ⏱️ 21.04.2022):

     npm install google-protobuf
    
flatbuffers (πŸ₯‡41 Β· ⭐ 18K) - FlatBuffers: Memory Efficient Serialization Library. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 560 Β· πŸ”€ 2.8K Β· πŸ“₯ 64K Β· πŸ“¦ 2.5K Β· πŸ“‹ 2K - 7% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/google/flatbuffers
    
  • PyPi (πŸ“₯ 9M / month Β· πŸ“¦ 210 Β· ⏱️ 10.05.2021):

     pip install flatbuffers
    
  • Conda (πŸ“₯ 380K Β· ⏱️ 04.03.2022):

     conda install -c conda-forge flatbuffers
    
  • npm (πŸ“₯ 360K / month Β· πŸ“¦ 220 Β· ⏱️ 25.02.2022):

     npm install flatbuffers
    
marshmallow (πŸ₯ˆ38 Β· ⭐ 6.1K) - A lightweight library for converting complex objects to and from.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 200 Β· πŸ”€ 610 Β· πŸ“¦ 49K Β· πŸ“‹ 1.2K - 13% open Β· ⏱️ 26.06.2022):

     git clone https://github.com/marshmallow-code/marshmallow
    
  • PyPi (πŸ“₯ 16M / month Β· πŸ“¦ 10K Β· ⏱️ 26.06.2022):

     pip install marshmallow
    
  • Conda (πŸ“₯ 1.1M Β· ⏱️ 28.06.2022):

     conda install -c conda-forge marshmallow
    
ultrajson (πŸ₯ˆ36 Β· ⭐ 3.7K) - Ultra fast JSON decoder and encoder written in C with Python bindings. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 81 Β· πŸ”€ 350 Β· πŸ“‹ 330 - 10% open Β· ⏱️ 20.06.2022):

     git clone https://github.com/ultrajson/ultrajson
    
  • PyPi (πŸ“₯ 8.9M / month Β· πŸ“¦ 4.2K Β· ⏱️ 18.05.2022):

     pip install ujson
    
  • Conda (πŸ“₯ 2M Β· ⏱️ 20.05.2022):

     conda install -c conda-forge ujson
    
dill (πŸ₯ˆ35 Β· ⭐ 1.7K) - serialize all of python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 35 Β· πŸ”€ 140 Β· πŸ“₯ 260K Β· πŸ“¦ 54K Β· πŸ“‹ 420 - 36% open Β· ⏱️ 26.06.2022):

     git clone https://github.com/uqfoundation/dill
    
  • PyPi (πŸ“₯ 19M / month Β· πŸ“¦ 3.4K Β· ⏱️ 20.05.2022):

     pip install dill
    
  • Conda (πŸ“₯ 2.2M Β· ⏱️ 20.05.2022):

     conda install -c conda-forge dill
    
simplejson (πŸ₯ˆ35 Β· ⭐ 1.5K) - simplejson is a simple, fast, extensible JSON encoder/decoder for.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 38 Β· πŸ”€ 310 Β· πŸ“₯ 5.9K Β· πŸ“¦ 85K Β· πŸ“‹ 190 - 9% open Β· ⏱️ 22.04.2022):

     git clone https://github.com/simplejson/simplejson
    
  • PyPi (πŸ“₯ 13M / month Β· πŸ“¦ 21K Β· ⏱️ 16.11.2021):

     pip install simplejson
    
  • Conda (πŸ“₯ 1.7M Β· ⏱️ 03.04.2022):

     conda install -c conda-forge simplejson
    
jsonpickle (πŸ₯ˆ34 Β· ⭐ 1K) - Python library for serializing any arbitrary object graph into JSON... BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 64 Β· πŸ”€ 150 Β· πŸ“‹ 260 - 22% open Β· ⏱️ 23.06.2022):

     git clone https://github.com/jsonpickle/jsonpickle
    
  • PyPi (πŸ“₯ 9.2M / month Β· πŸ“¦ 2.3K Β· ⏱️ 11.05.2022):

     pip install jsonpickle
    
  • Conda (πŸ“₯ 910K Β· ⏱️ 11.05.2022):

     conda install -c conda-forge jsonpickle
    
orjson (πŸ₯‰33 Β· ⭐ 3.4K) - Fast, correct Python JSON library supporting dataclasses, datetimes,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 16 Β· πŸ”€ 120 Β· πŸ“¦ 16K Β· πŸ“‹ 230 - 7% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/ijl/orjson
    
  • PyPi (πŸ“₯ 4.5M / month Β· πŸ“¦ 540 Β· ⏱️ 28.06.2022):

     pip install orjson
    
  • Conda (πŸ“₯ 380K Β· ⏱️ 28.06.2022):

     conda install -c conda-forge orjson
    
msgpack (πŸ₯‰33 Β· ⭐ 1.6K) - MessagePack serializer implementation for Python msgpack.org[Python]. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 72 Β· πŸ”€ 200 Β· πŸ“₯ 890 Β· πŸ“‹ 250 - 1% open Β· ⏱️ 03.06.2022):

     git clone https://github.com/msgpack/msgpack-python
    
  • PyPi (πŸ“₯ 21M / month Β· πŸ“¦ 2K Β· ⏱️ 03.06.2022):

     pip install msgpack
    
  • Conda (πŸ“₯ 7.3M Β· ⏱️ 03.06.2022):

     conda install -c conda-forge msgpack-python
    
cloudpickle (πŸ₯‰33 Β· ⭐ 1.2K) - Extended pickling support for Python objects. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 51 Β· πŸ”€ 130 Β· πŸ“₯ 19 Β· πŸ“¦ 55K Β· πŸ“‹ 220 - 33% open Β· ⏱️ 24.05.2022):

     git clone https://github.com/cloudpipe/cloudpickle
    
  • PyPi (πŸ“₯ 28M / month Β· πŸ“¦ 2.6K Β· ⏱️ 10.09.2021):

     pip install cloudpickle
    
  • Conda (πŸ“₯ 8.2M Β· ⏱️ 20.05.2022):

     conda install -c conda-forge cloudpickle
    
srsly (πŸ₯‰30 Β· ⭐ 270) - Modern high-performance serialization utilities for Python (JSON,.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 11 Β· πŸ”€ 25 Β· πŸ“¦ 19K Β· ⏱️ 12.04.2022):

     git clone https://github.com/explosion/srsly
    
  • PyPi (πŸ“₯ 4.7M / month Β· πŸ“¦ 260 Β· ⏱️ 13.04.2022):

     pip install srsly
    
  • Conda (πŸ“₯ 920K Β· ⏱️ 14.04.2022):

     conda install -c conda-forge srsly
    
pysimdjson (πŸ₯‰26 Β· ⭐ 540) - Python bindings for the simdjson project. MIT
  • GitHub (πŸ‘¨β€πŸ’» 13 Β· πŸ”€ 41 Β· πŸ“¦ 310 Β· πŸ“‹ 77 - 15% open Β· ⏱️ 04.06.2022):

     git clone https://github.com/TkTech/pysimdjson
    
  • PyPi (πŸ“₯ 170K / month Β· πŸ“¦ 16 Β· ⏱️ 29.05.2022):

     pip install pysimdjson
    
  • Conda (πŸ“₯ 27K Β· ⏱️ 29.05.2022):

     conda install -c conda-forge pysimdjson
    
python-rapidjson (πŸ₯‰26 Β· ⭐ 450) - Python wrapper around rapidjson. MIT
  • GitHub (πŸ‘¨β€πŸ’» 18 Β· πŸ”€ 40 Β· πŸ“¦ 2.5K Β· πŸ“‹ 100 - 11% open Β· ⏱️ 19.02.2022):

     git clone https://github.com/python-rapidjson/python-rapidjson
    
  • PyPi (πŸ“₯ 1.1M / month Β· πŸ“¦ 240 Β· ⏱️ 19.02.2022):

     pip install python-rapidjson
    
  • Conda (πŸ“₯ 980K Β· ⏱️ 19.02.2022):

     conda install -c conda-forge python-rapidjson
    
hickle (πŸ₯‰23 Β· ⭐ 420) - a HDF5-based python pickle replacement. MIT
  • GitHub (πŸ‘¨β€πŸ’» 22 Β· πŸ”€ 67 Β· πŸ“¦ 380 Β· πŸ“‹ 99 - 8% open Β· ⏱️ 19.12.2021):

     git clone https://github.com/telegraphic/hickle
    
  • PyPi (πŸ“₯ 3.6K / month Β· πŸ“¦ 83 Β· ⏱️ 17.12.2021):

     pip install hickle
    
  • Conda (πŸ“₯ 19K Β· ⏱️ 11.07.2019):

     conda install -c conda-forge hickle
    
rtoml (πŸ₯‰21 Β· ⭐ 160) - A better TOML library for python implemented in rust. MIT
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 21 Β· πŸ“¦ 70 Β· πŸ“‹ 11 - 45% open Β· ⏱️ 11.05.2022):

     git clone https://github.com/samuelcolvin/rtoml
    
  • PyPi (πŸ“₯ 27K / month Β· πŸ“¦ 14 Β· ⏱️ 11.05.2022):

     pip install rtoml
    
Show 1 hidden projects...
  • pyasn1 (πŸ₯‰31 Β· ⭐ 210 Β· πŸ’€) - Generic ASN.1 library for Python. BSD-2

Data Containers & Dataframes

Back to top

General-purpose data containers as well as utilities & extensions for pandas.

pandas (πŸ₯‡52 Β· ⭐ 34K) - Flexible and powerful data analysis / manipulation library for.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 3K Β· πŸ”€ 15K Β· πŸ“₯ 150K Β· πŸ“¦ 750K Β· πŸ“‹ 23K - 15% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/pandas-dev/pandas
    
  • PyPi (πŸ“₯ 91M / month Β· πŸ“¦ 61K Β· ⏱️ 23.06.2022):

     pip install pandas
    
  • Conda (πŸ“₯ 27M Β· ⏱️ 23.06.2022):

     conda install -c conda-forge pandas
    
numpy (πŸ₯‡50 Β· ⭐ 21K) - The fundamental package for scientific computing with Python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 1.5K Β· πŸ”€ 6.9K Β· πŸ“₯ 530K Β· πŸ“¦ 1.1M Β· πŸ“‹ 11K - 20% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/numpy/numpy
    
  • PyPi (πŸ“₯ 120M / month Β· πŸ“¦ 120K Β· ⏱️ 22.06.2022):

     pip install numpy
    
  • Conda (πŸ“₯ 35M Β· ⏱️ 23.06.2022):

     conda install -c conda-forge numpy
    
h5py (πŸ₯‡41 Β· ⭐ 1.8K) - HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 180 Β· πŸ”€ 460 Β· πŸ“₯ 2K Β· πŸ“¦ 170K Β· πŸ“‹ 1.3K - 17% open Β· ⏱️ 23.06.2022):

     git clone https://github.com/h5py/h5py
    
  • PyPi (πŸ“₯ 13M / month Β· πŸ“¦ 14K Β· ⏱️ 24.05.2022):

     pip install h5py
    
  • Conda (πŸ“₯ 8.2M Β· ⏱️ 27.06.2022):

     conda install -c conda-forge h5py
    
xarray (πŸ₯ˆ38 Β· ⭐ 2.6K) - N-D labeled arrays and datasets in Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 380 Β· πŸ”€ 800 Β· πŸ“¦ 11K Β· πŸ“‹ 3.4K - 27% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/pydata/xarray
    
  • PyPi (πŸ“₯ 1.8M / month Β· πŸ“¦ 1.4K Β· ⏱️ 09.06.2022):

     pip install xarray
    
  • Conda (πŸ“₯ 5.4M Β· ⏱️ 02.03.2022):

     conda install -c conda-forge xarray
    
Modin (πŸ₯ˆ34 Β· ⭐ 7.5K) - Modin: Scale your Pandas workflows by changing a single line of.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 97 Β· πŸ”€ 530 Β· πŸ“₯ 200K Β· πŸ“¦ 680 Β· πŸ“‹ 2.8K - 33% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/modin-project/modin
    
  • PyPi (πŸ“₯ 210K / month Β· πŸ“¦ 26 Β· ⏱️ 25.06.2022):

     pip install modin
    
  • Conda (πŸ“₯ 110K Β· ⏱️ 28.06.2022):

     conda install -c conda-forge modin-core
    
polars (πŸ₯ˆ33 Β· ⭐ 6.6K) - Fast multi-threaded DataFrame library in Rust | Python | Node.js. MIT
  • GitHub (πŸ‘¨β€πŸ’» 99 Β· πŸ”€ 370 Β· πŸ“¦ 6 Β· πŸ“‹ 1.5K - 11% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/pola-rs/polars
    
  • PyPi (πŸ“₯ 90K / month Β· πŸ“¦ 30 Β· ⏱️ 29.06.2022):

     pip install polars
    
numexpr (πŸ₯ˆ33 Β· ⭐ 1.8K Β· πŸ“ˆ) - Fast numerical array expression evaluator for Python, NumPy,.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 61 Β· πŸ”€ 180 Β· πŸ“₯ 4 Β· πŸ“‹ 330 - 18% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/pydata/numexpr
    
  • PyPi (πŸ“₯ 2.3M / month Β· πŸ“¦ 3K Β· ⏱️ 25.06.2022):

     pip install numexpr
    
  • Conda (πŸ“₯ 4.4M Β· ⏱️ 11.04.2022):

     conda install -c conda-forge numexpr
    
zarr (πŸ₯ˆ33 Β· ⭐ 940) - An implementation of chunked, compressed, N-dimensional arrays for Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 62 Β· πŸ”€ 160 Β· πŸ“¦ 1.3K Β· πŸ“‹ 510 - 41% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/zarr-developers/zarr-python
    
  • PyPi (πŸ“₯ 480K / month Β· πŸ“¦ 250 Β· ⏱️ 23.06.2022):

     pip install zarr
    
  • Conda (πŸ“₯ 1.4M Β· ⏱️ 23.06.2022):

     conda install -c conda-forge zarr
    
PyTables (πŸ₯ˆ32 Β· ⭐ 1.1K) - A Python package to manage extremely large amounts of data. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 220 Β· πŸ“₯ 170 Β· πŸ“‹ 680 - 26% open Β· ⏱️ 19.04.2022):

     git clone https://github.com/PyTables/PyTables
    
  • PyPi (πŸ“₯ 990K / month Β· πŸ“¦ 2.3K Β· ⏱️ 28.12.2021):

     pip install tables
    
  • Conda (πŸ“₯ 4.4M Β· ⏱️ 25.01.2022):

     conda install -c conda-forge pytables
    
Bottleneck (πŸ₯ˆ32 Β· ⭐ 760) - Fast NumPy array functions written in C. BSD-2
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 84 Β· πŸ“¦ 34K Β· πŸ“‹ 230 - 17% open Β· ⏱️ 09.06.2022):

     git clone https://github.com/pydata/bottleneck
    
  • PyPi (πŸ“₯ 520K / month Β· πŸ“¦ 1.6K Β· ⏱️ 22.02.2022):

     pip install Bottleneck
    
  • Conda (πŸ“₯ 2.3M Β· ⏱️ 10.04.2022):

     conda install -c conda-forge bottleneck
    
Vaex (πŸ₯ˆ31 Β· ⭐ 7.1K) - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 68 Β· πŸ”€ 550 Β· πŸ“₯ 240 Β· πŸ“‹ 1.1K - 36% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/vaexio/vaex
    
  • PyPi (πŸ“₯ 72K / month Β· πŸ“¦ 17 Β· ⏱️ 03.06.2022):

     pip install vaex
    
  • Conda (πŸ“₯ 130K Β· ⏱️ 07.06.2022):

     conda install -c conda-forge vaex
    
Koalas (πŸ₯ˆ31 Β· ⭐ 3.2K Β· πŸ’€) - Koalas: pandas API on Apache Spark. Apache-2 spark
  • GitHub (πŸ‘¨β€πŸ’» 51 Β· πŸ”€ 330 Β· πŸ“₯ 1K Β· πŸ“¦ 210 Β· πŸ“‹ 590 - 17% open Β· ⏱️ 21.10.2021):

     git clone https://github.com/databricks/koalas
    
  • PyPi (πŸ“₯ 1.4M / month Β· πŸ“¦ 13 Β· ⏱️ 19.10.2021):

     pip install koalas
    
  • Conda (πŸ“₯ 150K Β· ⏱️ 20.10.2021):

     conda install -c conda-forge koalas
    
TinyDB (πŸ₯‰30 Β· ⭐ 5.2K) - TinyDB is a lightweight document oriented database optimized for your.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 77 Β· πŸ”€ 440 Β· πŸ“‹ 280 - 3% open Β· ⏱️ 23.05.2022):

     git clone https://github.com/msiemens/tinydb
    
  • PyPi (πŸ“₯ 380K / month Β· πŸ“¦ 790 Β· ⏱️ 19.02.2022):

     pip install tinydb
    
  • Conda (πŸ“₯ 180K Β· ⏱️ 19.02.2022):

     conda install -c conda-forge tinydb
    
pandera (πŸ₯‰30 Β· ⭐ 1.5K) - A light-weight, flexible, and expressive data validation library for.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 54 Β· πŸ”€ 110 Β· πŸ“¦ 260 Β· πŸ“‹ 410 - 25% open Β· ⏱️ 30.04.2022):

     git clone https://github.com/pandera-dev/pandera
    
  • PyPi (πŸ“₯ 530K / month Β· πŸ“¦ 23 Β· ⏱️ 01.05.2022):

     pip install pandera
    
  • Conda (πŸ“₯ 8.5K Β· ⏱️ 04.04.2022):

     conda install -c conda-forge pandera-core
    
datasketch (πŸ₯‰29 Β· ⭐ 1.7K) - MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog,.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 22 Β· πŸ”€ 240 Β· πŸ“₯ 19 Β· πŸ“¦ 400 Β· πŸ“‹ 140 - 24% open Β· ⏱️ 02.06.2022):

     git clone https://github.com/ekzhu/datasketch
    
  • PyPi (πŸ“₯ 710K / month Β· πŸ“¦ 54 Β· ⏱️ 04.02.2022):

     pip install datasketch
    
datatable (πŸ₯‰29 Β· ⭐ 1.5K) - A Python package for manipulating 2-dimensional tabular data.. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 33 Β· πŸ”€ 130 Β· πŸ“₯ 1.7K Β· πŸ“‹ 1.4K - 10% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/h2oai/datatable
    
  • PyPi (πŸ“₯ 71K / month Β· πŸ“¦ 12 Β· ⏱️ 01.07.2021):

     pip install datatable
    
  • Conda (πŸ“₯ 14K Β· ⏱️ 23.12.2020):

     conda install -c conda-forge datatable
    
docarray (πŸ₯‰28 Β· ⭐ 740 Β· 🐣) - The data structure for unstructured data. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 33 Β· πŸ”€ 68 Β· πŸ“¦ 71 Β· πŸ“‹ 120 - 21% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/jina-ai/docarray
    
  • PyPi (πŸ“₯ 95K / month Β· πŸ“¦ 1 Β· ⏱️ 29.06.2022):

     pip install docarray
    
  • Conda (πŸ“₯ 14K Β· ⏱️ 29.06.2022):

     conda install -c conda-forge docarray
    
swifter (πŸ₯‰27 Β· ⭐ 2K) - A package which efficiently applies any function to a pandas dataframe.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 15 Β· πŸ”€ 95 Β· πŸ“¦ 620 Β· πŸ“‹ 120 - 22% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/jmcarpenter2/swifter
    
  • PyPi (πŸ“₯ 220K / month Β· πŸ“¦ 30 Β· ⏱️ 29.06.2022):

     pip install swifter
    
  • Conda (πŸ“₯ 140K Β· ⏱️ 13.04.2022):

     conda install -c conda-forge swifter
    
PandaralΒ·lel (πŸ₯‰26 Β· ⭐ 2.2K) - A simple and efficient tool to parallelize Pandas.. BSD-3 jupyter
  • GitHub (πŸ‘¨β€πŸ’» 19 Β· πŸ”€ 140 Β· πŸ“‹ 160 - 48% open Β· ⏱️ 15.03.2022):

     git clone https://github.com/nalepae/pandarallel
    
  • PyPi (πŸ“₯ 480K / month Β· πŸ“¦ 20 Β· ⏱️ 15.03.2022):

     pip install pandarallel
    
  • Conda (πŸ“₯ 5.7K Β· ⏱️ 09.04.2022):

     conda install -c conda-forge pandarallel
    
StaticFrame (πŸ₯‰26 Β· ⭐ 300) - Immutable and grow-only Pandas-like DataFrames with a more explicit.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 20 Β· πŸ”€ 26 Β· πŸ“¦ 11 Β· πŸ“‹ 410 - 8% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/InvestmentSystems/static-frame
    
  • PyPi (πŸ“₯ 1.5K / month Β· πŸ“¦ 2 Β· ⏱️ 22.06.2022):

     pip install static-frame
    
  • Conda (πŸ“₯ 160K Β· ⏱️ 22.06.2022):

     conda install -c conda-forge static-frame
    
Pandas Summary (πŸ₯‰20 Β· ⭐ 420) - A library for managing, validating, summarizing, and.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 8 Β· πŸ”€ 41 Β· πŸ“‹ 13 - 46% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/polyaxon/datatile
    
  • PyPi (πŸ“₯ 46K / month Β· πŸ“¦ 57 Β· ⏱️ 25.11.2021):

     pip install pandas-summary
    
PandaPy (πŸ₯‰11 Β· ⭐ 510 Β· πŸ’€) - PandaPy has the speed of NumPy and the usability of Pandas 10x to.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 3 Β· πŸ”€ 58 Β· πŸ“¦ 1 Β· πŸ“‹ 3 - 66% open Β· ⏱️ 20.10.2021):

     git clone https://github.com/firmai/pandapy
    
  • PyPi (πŸ“₯ 43 / month Β· ⏱️ 25.01.2020):

     pip install pandapy
    
Show 8 hidden projects...
  • Blaze (πŸ₯ˆ31 Β· ⭐ 3.1K Β· πŸ’€) - NumPy and Pandas interface to Big Data. BSD-3
  • Arctic (πŸ₯‰29 Β· ⭐ 2.7K) - Arctic is a high performance datastore for numeric data. ❗️LGPL-2.1
  • sklearn-pandas (πŸ₯‰29 Β· ⭐ 2.6K Β· πŸ’€) - Pandas integration with sklearn. ❗️Zlib sklearn
  • pandasql (πŸ₯‰27 Β· ⭐ 1.1K Β· πŸ’€) - sqldf for pandas. MIT
  • bcolz (πŸ₯‰27 Β· ⭐ 940 Β· πŸ’€) - A columnar data container that can be compressed. BSD-3
  • pickleDB (πŸ₯‰22 Β· ⭐ 670 Β· πŸ’€) - pickleDB is an open source key-value store using Pythons json module. BSD-3
  • Bounter (πŸ₯‰18 Β· ⭐ 930 Β· πŸ’€) - Efficient Counter that uses a limited (bounded) amount of memory.. MIT
  • fletcher (πŸ₯‰18 Β· ⭐ 220 Β· πŸ’€) - Pandas ExtensionDType/Array backed by Apache Arrow. MIT

Data Structures

Back to top

pyrsistent (πŸ₯‡35 Β· ⭐ 1.7K) - Persistent/Immutable/Functional data structures for Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 65 Β· πŸ”€ 120 Β· πŸ“¦ 160K Β· πŸ“‹ 160 - 11% open Β· ⏱️ 14.06.2022):

     git clone https://github.com/tobgu/pyrsistent
    
  • PyPi (πŸ“₯ 38M / month Β· πŸ“¦ 2.1K Β· ⏱️ 14.01.2022):

     pip install pyrsistent
    
  • Conda (πŸ“₯ 10M Β· ⏱️ 03.04.2022):

     conda install -c conda-forge pyrsistent
    
multidict (πŸ₯‡31 Β· ⭐ 300) - The multidict implementation. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 41 Β· πŸ”€ 72 Β· πŸ“₯ 2.5K Β· πŸ“‹ 130 - 9% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/aio-libs/multidict
    
  • PyPi (πŸ“₯ 85M / month Β· πŸ“¦ 3K Β· ⏱️ 24.01.2022):

     pip install multidict
    
  • Conda (πŸ“₯ 5.1M Β· ⏱️ 02.04.2022):

     conda install -c conda-forge multidict
    
bidict (πŸ₯ˆ30 Β· ⭐ 1.1K) - The bidirectional mapping library for Python. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 47 Β· πŸ“¦ 7.9K Β· πŸ“‹ 48 - 4% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/jab/bidict
    
  • PyPi (πŸ“₯ 750K / month Β· πŸ“¦ 410 Β· ⏱️ 23.03.2022):

     pip install bidict
    
  • Conda (πŸ“₯ 130K Β· ⏱️ 24.03.2022):

     conda install -c conda-forge bidict
    
python-sortedcontainers (πŸ₯ˆ29 Β· ⭐ 2.6K Β· πŸ’€) - Python Sorted Container Types: Sorted List, Sorted.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 20 Β· πŸ”€ 170 Β· πŸ“‹ 150 - 13% open Β· ⏱️ 13.10.2021):

     git clone https://github.com/grantjenks/python-sortedcontainers
    
  • PyPi (πŸ“₯ 14M / month Β· πŸ“¦ 2K Β· ⏱️ 16.05.2021):

     pip install sortedcontainers
    
  • Conda (πŸ“₯ 6.6M Β· ⏱️ 17.05.2021):

     conda install -c conda-forge sortedcontainers
    
sqlitedict (πŸ₯ˆ28 Β· ⭐ 850) - Persistent dict, backed by sqlite3 and pickle, multithread-safe. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 34 Β· πŸ”€ 110 Β· πŸ“¦ 1.7K Β· πŸ“‹ 89 - 31% open Β· ⏱️ 22.04.2022):

     git clone https://github.com/RaRe-Technologies/sqlitedict
    
  • PyPi (πŸ“₯ 200K / month Β· πŸ“¦ 190 Β· ⏱️ 04.03.2022):

     pip install sqlitedict
    
  • Conda (πŸ“₯ 34K Β· ⏱️ 04.03.2022):

     conda install -c conda-forge sqlitedict
    
python-benedict (πŸ₯ˆ28 Β· ⭐ 400) - dict subclass with keylist/keypath support, normalized I/O.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 3 Β· πŸ”€ 28 Β· πŸ“¦ 940 Β· πŸ“‹ 67 - 10% open Β· ⏱️ 22.06.2022):

     git clone https://github.com/fabiocaccamo/python-benedict
    
  • PyPi (πŸ“₯ 490K / month Β· πŸ“¦ 13 Β· ⏱️ 27.04.2022):

     pip install python-benedict
    
  • Conda (πŸ“₯ 59K Β· ⏱️ 27.04.2022):

     conda install -c conda-forge python-benedict
    
ordered-set (πŸ₯ˆ28 Β· ⭐ 160) - A mutable set that remembers the order of its entries. One of Pythons.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 18 Β· πŸ”€ 38 Β· πŸ“‹ 38 - 7% open Β· ⏱️ 26.01.2022):

     git clone https://github.com/rspeer/ordered-set
    
  • PyPi (πŸ“₯ 5.1M / month Β· πŸ“¦ 280 Β· ⏱️ 26.01.2022):

     pip install ordered-set
    
  • Conda (πŸ“₯ 170K Β· ⏱️ 26.01.2022):

     conda install -c conda-forge ordered-set
    
immutables (πŸ₯‰27 Β· ⭐ 960) - A high-performance immutable mapping type for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 13 Β· πŸ”€ 47 Β· πŸ“¦ 4.3K Β· πŸ“‹ 41 - 24% open Β· ⏱️ 22.05.2022):

     git clone https://github.com/MagicStack/immutables
    
  • PyPi (πŸ“₯ 1.7M / month Β· πŸ“¦ 100 Β· ⏱️ 22.05.2022):

     pip install immutables
    
  • Conda (πŸ“₯ 820K Β· ⏱️ 22.05.2022):

     conda install -c conda-forge immutables
    
glom (πŸ₯‰26 Β· ⭐ 1.5K) - Pythons nested data operator (and CLI), for all your declarative.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 19 Β· πŸ”€ 50 Β· πŸ“¦ 480 Β· πŸ“‹ 160 - 59% open Β· ⏱️ 24.01.2022):

     git clone https://github.com/mahmoud/glom
    
  • PyPi (πŸ“₯ 840K / month Β· πŸ“¦ 76 Β· ⏱️ 24.01.2022):

     pip install glom
    
  • Conda (πŸ“₯ 10K Β· ⏱️ 11.11.2020):

     conda install -c conda-forge glom
    
janus (πŸ₯‰26 Β· ⭐ 620) - Thread-safe asyncio-aware queue for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 23 Β· πŸ”€ 36 Β· πŸ“‹ 35 - 8% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/aio-libs/janus
    
  • PyPi (πŸ“₯ 260K / month Β· πŸ“¦ 92 Β· ⏱️ 17.12.2021):

     pip install janus
    
  • Conda (πŸ“₯ 9.1K Β· ⏱️ 17.12.2021):

     conda install -c conda-forge janus
    
python-box (πŸ₯‰25 Β· ⭐ 2K) - Python dictionaries with advanced dot notation access. MIT
  • GitHub (πŸ‘¨β€πŸ’» 1 Β· πŸ”€ 82 Β· πŸ“₯ 30 Β· πŸ“‹ 140 - 12% open Β· ⏱️ 02.04.2022):

     git clone https://github.com/cdgriffith/Box
    
  • PyPi (πŸ“₯ 1.5M / month Β· πŸ“¦ 270 Β· ⏱️ 02.04.2022):

     pip install python-box
    
  • Conda (πŸ“₯ 260K Β· ⏱️ 02.04.2022):

     conda install -c conda-forge python-box
    
Show 4 hidden projects...
  • addict (πŸ₯ˆ29 Β· ⭐ 2.2K Β· πŸ’€) - The Python Dict thats better than heroin. MIT
  • anytree (πŸ₯‰26 Β· ⭐ 710 Β· πŸ’€) - Python tree data library. Apache-2
  • munch (πŸ₯‰26 Β· ⭐ 590 Β· πŸ’€) - A Munch is a Python dictionary that provides attribute-style access (a.. MIT
  • cleverdict (πŸ₯‰17 Β· ⭐ 87) - A JSON-friendly data structure which allows both object attributes and.. MIT

Data Validation

Back to top

pydantic (πŸ₯‡43 Β· ⭐ 10K) - Data parsing and validation using Python type hints. MIT
  • GitHub (πŸ‘¨β€πŸ’» 260 Β· πŸ”€ 940 Β· πŸ“¦ 75K Β· πŸ“‹ 1.9K - 28% open Β· ⏱️ 18.05.2022):

     git clone https://github.com/samuelcolvin/pydantic
    
  • PyPi (πŸ“₯ 27M / month Β· πŸ“¦ 3.4K Β· ⏱️ 19.05.2022):

     pip install pydantic
    
  • Conda (πŸ“₯ 2.3M Β· ⏱️ 20.05.2022):

     conda install -c conda-forge pydantic
    
jsonschema (πŸ₯‡40 Β· ⭐ 3.7K) - An implementation of the JSON Schema specification for Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 520 Β· πŸ“¦ 230K Β· πŸ“‹ 660 - 8% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/Julian/jsonschema
    
  • PyPi (πŸ“₯ 41M / month Β· πŸ“¦ 18K Β· ⏱️ 28.06.2022):

     pip install jsonschema
    
  • Conda (πŸ“₯ 12M Β· ⏱️ 28.06.2022):

     conda install -c conda-forge jsonschema
    
voluptuous (πŸ₯ˆ33 Β· ⭐ 1.7K) - CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 88 Β· πŸ”€ 200 Β· πŸ“¦ 5.1K Β· πŸ“‹ 240 - 17% open Β· ⏱️ 07.04.2022):

     git clone https://github.com/alecthomas/voluptuous
    
  • PyPi (πŸ“₯ 1.3M / month Β· πŸ“¦ 1.3K Β· ⏱️ 07.04.2022):

     pip install voluptuous
    
  • Conda (πŸ“₯ 180K Β· ⏱️ 07.04.2022):

     conda install -c conda-forge voluptuous
    
schema (πŸ₯ˆ32 Β· ⭐ 2.6K) - Schema validation just got Pythonic. MIT
  • GitHub (πŸ‘¨β€πŸ’» 62 Β· πŸ”€ 180 Β· πŸ“¦ 4.2K Β· πŸ“‹ 150 - 53% open Β· ⏱️ 01.12.2021):

     git clone https://github.com/keleshev/schema
    
  • PyPi (πŸ“₯ 4.3M / month Β· πŸ“¦ 780 Β· ⏱️ 01.12.2021):

     pip install schema
    
  • Conda (πŸ“₯ 52K Β· ⏱️ 02.12.2021):

     conda install -c conda-forge schema
    
param (πŸ₯ˆ31 Β· ⭐ 280) - Param: Make your Python code clearer and more reliable by declaring.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 31 Β· πŸ”€ 56 Β· πŸ“¦ 3.8K Β· πŸ“‹ 340 - 41% open Β· ⏱️ 21.06.2022):

     git clone https://github.com/holoviz/param
    
  • PyPi (πŸ“₯ 450K / month Β· πŸ“¦ 130 Β· ⏱️ 20.06.2022):

     pip install param
    
  • Conda (πŸ“₯ 620K Β· ⏱️ 22.06.2022):

     conda install -c conda-forge param
    
schematics (πŸ₯‰30 Β· ⭐ 2.5K Β· πŸ’€) - Python Data Structures for Humans. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 120 Β· πŸ”€ 300 Β· πŸ“¦ 1.1K Β· πŸ“‹ 340 - 31% open Β· ⏱️ 17.08.2021):

     git clone https://github.com/schematics/schematics
    
  • PyPi (πŸ“₯ 160K / month Β· πŸ“¦ 380 Β· ⏱️ 17.08.2021):

     pip install schematics
    
  • Conda (πŸ“₯ 24K Β· ⏱️ 17.07.2019):

     conda install -c conda-forge schematics
    
validators (πŸ₯‰30 Β· ⭐ 600) - Python Data Validation for Humans. MIT
  • GitHub (πŸ‘¨β€πŸ’» 42 Β· πŸ”€ 120 Β· πŸ“¦ 40K Β· πŸ“‹ 130 - 72% open Β· ⏱️ 06.06.2022):

     git clone https://github.com/kvesteri/validators
    
  • PyPi (πŸ“₯ 2.9M / month Β· πŸ“¦ 1.5K Β· ⏱️ 05.06.2022):

     pip install validators
    
  • Conda (πŸ“₯ 120K Β· ⏱️ 18.12.2020):

     conda install -c conda-forge validators
    
strictyaml (πŸ₯‰26 Β· ⭐ 1.1K) - Type-safe YAML parser and validator. MIT
  • GitHub (πŸ‘¨β€πŸ’» 19 Β· πŸ”€ 47 Β· πŸ“¦ 740 Β· πŸ“‹ 140 - 54% open Β· ⏱️ 05.12.2021):

     git clone https://github.com/crdoconnor/strictyaml
    
  • PyPi (πŸ“₯ 1.1M / month Β· πŸ“¦ 160 Β· ⏱️ 28.11.2021):

     pip install strictyaml
    
  • Conda (πŸ“₯ 150K Β· ⏱️ 28.11.2021):

     conda install -c conda-forge strictyaml
    
typical (πŸ₯‰19 Β· ⭐ 160) - Typical: Fast, simple, & correct data-validation using Python 3 typing. MIT
  • GitHub (πŸ‘¨β€πŸ’» 8 Β· πŸ”€ 9 Β· πŸ“‹ 95 - 13% open Β· ⏱️ 01.02.2022):

     git clone https://github.com/seandstewart/typical
    
  • PyPi (πŸ“₯ 23K / month Β· πŸ“¦ 3 Β· ⏱️ 23.12.2021):

     pip install typical
    
  • Conda (πŸ“₯ 8.7K Β· ⏱️ 23.12.2021):

     conda install -c conda-forge typical
    
validr (πŸ₯‰18 Β· ⭐ 210) - A simple, fast, extensible python library for data validation. MIT
  • GitHub (πŸ‘¨β€πŸ’» 7 Β· πŸ”€ 12 Β· πŸ“‹ 24 - 12% open Β· ⏱️ 03.05.2022):

     git clone https://github.com/guyskk/validr
    
  • PyPi (πŸ“₯ 8.7K / month Β· πŸ“¦ 4 Β· ⏱️ 10.03.2021):

     pip install validr
    
dirty-equals (πŸ₯‰16 Β· ⭐ 480 Β· 🐣) - Doing dirty (but extremely useful) things with equals. MIT
  • GitHub (πŸ‘¨β€πŸ’» 8 Β· πŸ”€ 17 Β· πŸ“‹ 12 - 58% open Β· ⏱️ 25.06.2022):

     git clone https://github.com/samuelcolvin/dirty-equals
    
  • PyPi (πŸ“₯ 8.8K / month Β· πŸ“¦ 4 Β· ⏱️ 18.04.2022):

     pip install dirty-equals
    
  • Conda (πŸ“₯ 7K Β· ⏱️ 29.04.2022):

     conda install -c conda-forge dirty-equals
    
Show 4 hidden projects...
  • cerberus (πŸ₯ˆ32 Β· ⭐ 2.8K Β· πŸ’€) - Lightweight, extensible data validation library for Python. ISC
  • python-email-validator (πŸ₯‰27 Β· ⭐ 590) - A robust email syntax and deliverability validation.. ❗️CC0-1.0
  • valideer (πŸ₯‰20 Β· ⭐ 260 Β· πŸ’€) - Lightweight data validation and adaptation Python library. MIT
  • dataklasses (πŸ₯‰6 Β· ⭐ 720 Β· 🐣) - A different spin on dataclasses. ❗Unlicensed

Algorithms & Design Patterns

Back to top

πŸ”—Β python-patterns ( ⭐ 34K) - Collection of design patterns/idioms in Python.

transitions (πŸ₯‡30 Β· ⭐ 4.4K) - A lightweight, object-oriented finite state machine implementation.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 71 Β· πŸ”€ 480 Β· πŸ“¦ 2.4K Β· πŸ“‹ 410 - 3% open Β· ⏱️ 08.03.2022):

     git clone https://github.com/pytransitions/transitions
    
  • PyPi (πŸ“₯ 270K / month Β· πŸ“¦ 250 Β· ⏱️ 24.02.2022):

     pip install transitions
    
  • Conda (πŸ“₯ 180K Β· ⏱️ 24.02.2022):

     conda install -c conda-forge transitions
    
algorithms (πŸ₯‰28 Β· ⭐ 21K) - Minimal examples of data structures and algorithms in Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 190 Β· πŸ”€ 4.3K Β· πŸ“¦ 67 Β· πŸ“‹ 290 - 67% open Β· ⏱️ 14.06.2022):

     git clone https://github.com/keon/algorithms
    
  • PyPi (πŸ“₯ 2.3K / month Β· πŸ“¦ 15 Β· ⏱️ 04.10.2020):

     pip install algorithms
    
  • Conda (πŸ“₯ 740 Β· ⏱️ 23.04.2021):

     conda install -c conda-forge algorithms
    
Show 1 hidden projects...
  • PyPattyrn (πŸ₯‰19 Β· ⭐ 1.5K Β· πŸ’€) - A simple library for implementing common design patterns. MIT

Date & Time Utilities

Back to top

arrow (πŸ₯‡38 Β· ⭐ 7.9K) - Better dates & times for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 260 Β· πŸ”€ 610 Β· πŸ“¦ 29K Β· πŸ“‹ 460 - 15% open Β· ⏱️ 25.06.2022):

     git clone https://github.com/arrow-py/arrow
    
  • PyPi (πŸ“₯ 6.9M / month Β· πŸ“¦ 4.5K Β· ⏱️ 27.01.2022):

     pip install arrow
    
  • Conda (πŸ“₯ 1M Β· ⏱️ 27.01.2022):

     conda install -c conda-forge arrow
    
python-dateutil (πŸ₯ˆ37 Β· ⭐ 1.8K) - Useful extensions to the standard Python datetime features. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 130 Β· πŸ”€ 400 Β· πŸ“₯ 35K Β· πŸ“¦ 740K Β· πŸ“‹ 650 - 42% open Β· ⏱️ 18.04.2022):

     git clone https://github.com/dateutil/dateutil
    
  • PyPi (πŸ“₯ 160M / month Β· πŸ“¦ 66K Β· ⏱️ 14.07.2021):

     pip install python-dateutil
    
  • Conda (πŸ“₯ 27M Β· ⏱️ 14.07.2021):

     conda install -c conda-forge python-dateutil
    
dateparser (πŸ₯ˆ34 Β· ⭐ 2.1K) - python parser for human readable dates. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 390 Β· πŸ“¦ 13K Β· πŸ“‹ 640 - 47% open Β· ⏱️ 20.06.2022):

     git clone https://github.com/scrapinghub/dateparser
    
  • PyPi (πŸ“₯ 4.7M / month Β· πŸ“¦ 1.1K Β· ⏱️ 17.03.2022):

     pip install dateparser
    
  • Conda (πŸ“₯ 71K Β· ⏱️ 18.03.2022):

     conda install -c conda-forge dateparser
    
holidays (πŸ₯ˆ33 Β· ⭐ 790) - Generate and work with holidays in Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 180 Β· πŸ”€ 330 Β· πŸ“₯ 160 Β· πŸ“‹ 280 - 7% open Β· ⏱️ 05.06.2022):

     git clone https://github.com/dr-prodigy/python-holidays
    
  • PyPi (πŸ“₯ 4.5M / month Β· πŸ“¦ 380 Β· ⏱️ 05.06.2022):

     pip install holidays
    
  • Conda (πŸ“₯ 1.4M Β· ⏱️ 15.02.2022):

     conda install -c conda-forge holidays
    
pytz (πŸ₯‰31 Β· ⭐ 200) - pytz Python historical timezone library and database. MIT
  • GitHub (πŸ‘¨β€πŸ’» 16 Β· πŸ”€ 62 Β· πŸ“¦ 1.1M Β· πŸ“‹ 52 - 42% open Β· ⏱️ 08.05.2022):

     git clone https://github.com/stub42/pytz
    
  • PyPi (πŸ“₯ 100M / month Β· πŸ“¦ 82K Β· ⏱️ 20.03.2022):

     pip install pytz
    
  • Conda (πŸ“₯ 25M Β· ⏱️ 22.03.2022):

     conda install -c conda-forge pytz
    
pendulum (πŸ₯‰30 Β· ⭐ 4.9K) - Python datetimes made easy. MIT
  • GitHub (πŸ‘¨β€πŸ’» 73 Β· πŸ”€ 280 Β· πŸ“‹ 440 - 47% open Β· ⏱️ 19.04.2022):

     git clone https://github.com/sdispater/pendulum
    
  • PyPi (πŸ“₯ 8.5M / month Β· πŸ“¦ 850 Β· ⏱️ 24.07.2020):

     pip install pendulum
    
  • Conda (πŸ“₯ 510K Β· ⏱️ 06.04.2022):

     conda install -c conda-forge pendulum
    
parsedatetime (πŸ₯‰28 Β· ⭐ 650 Β· πŸ’€) - Parse human-readable date/time strings. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 55 Β· πŸ”€ 100 Β· πŸ“¦ 4.5K Β· πŸ“‹ 160 - 39% open Β· ⏱️ 20.11.2021):

     git clone https://github.com/bear/parsedatetime
    
  • PyPi (πŸ“₯ 4.2M / month Β· πŸ“¦ 1.2K Β· ⏱️ 31.05.2020):

     pip install parsedatetime
    
  • Conda (πŸ“₯ 110K Β· ⏱️ 10.06.2020):

     conda install -c conda-forge parsedatetime
    
tzlocal (πŸ₯‰28 Β· ⭐ 160) - A Python module that tries to figure out what your local timezone is. MIT
  • GitHub (πŸ‘¨β€πŸ’» 26 Β· πŸ”€ 52 Β· πŸ“‹ 70 - 1% open Β· ⏱️ 02.06.2022):

     git clone https://github.com/regebro/tzlocal
    
  • PyPi (πŸ“₯ 21M / month Β· πŸ“¦ 3.6K Β· ⏱️ 02.04.2022):

     pip install tzlocal
    
  • Conda (πŸ“₯ 1.2M Β· ⏱️ 26.06.2022):

     conda install -c conda-forge tzlocal
    
isodate (πŸ₯‰28 Β· ⭐ 110) - ISO 8601 date/time parser. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 41 Β· πŸ“¦ 22K Β· πŸ“‹ 33 - 39% open Β· ⏱️ 13.03.2022):

     git clone https://github.com/gweis/isodate
    
  • PyPi (πŸ“₯ 54M / month Β· πŸ“¦ 2.1K Β· ⏱️ 13.12.2021):

     pip install isodate
    
  • Conda (πŸ“₯ 2.4M Β· ⏱️ 15.12.2021):

     conda install -c conda-forge isodate
    

File & Path Utilities

Back to top

watchdog (πŸ₯‡37 Β· ⭐ 5.3K) - Python library and shell utilities to monitor filesystem events. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 130 Β· πŸ”€ 640 Β· πŸ“¦ 57K Β· πŸ“‹ 580 - 28% open Β· ⏱️ 10.06.2022):

     git clone https://github.com/gorakhargosh/watchdog
    
  • PyPi (πŸ“₯ 6.7M / month Β· πŸ“¦ 7.8K Β· ⏱️ 10.06.2022):

     pip install watchdog
    
  • Conda (πŸ“₯ 1.2M Β· ⏱️ 10.06.2022):

     conda install -c conda-forge watchdog
    
filesystem_spec (πŸ₯ˆ36 Β· ⭐ 440) - A specification that python filesystems should adhere to. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 140 Β· πŸ”€ 190 Β· πŸ“¦ 29K Β· πŸ“‹ 450 - 37% open Β· ⏱️ 24.06.2022):

     git clone https://github.com/fsspec/filesystem_spec
    
  • PyPi (πŸ“₯ 41M / month Β· πŸ“¦ 370 Β· ⏱️ 19.05.2022):

     pip install fsspec
    
  • Conda (πŸ“₯ 6.4M Β· ⏱️ 20.05.2022):

     conda install -c conda-forge fsspec
    
pyfilesystem2 (πŸ₯ˆ31 Β· ⭐ 1.7K) - Pythons Filesystem abstraction layer. MIT
  • GitHub (πŸ‘¨β€πŸ’» 46 Β· πŸ”€ 170 Β· πŸ“‹ 340 - 23% open Β· ⏱️ 02.05.2022):

     git clone https://github.com/pyfilesystem/pyfilesystem2
    
  • PyPi (πŸ“₯ 480K / month Β· πŸ“¦ 560 Β· ⏱️ 02.05.2022):

     pip install fs
    
  • Conda (πŸ“₯ 460K Β· ⏱️ 02.03.2022):

     conda install -c conda-forge fs
    
filelock (πŸ₯ˆ31 Β· ⭐ 420) - A platform-independent file lock for Python. Unlicense
  • GitHub (πŸ‘¨β€πŸ’» 27 Β· πŸ”€ 75 Β· πŸ“‹ 75 - 22% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/tox-dev/py-filelock
    
  • PyPi (πŸ“₯ 37M / month Β· πŸ“¦ 2.3K Β· ⏱️ 31.05.2022):

     pip install filelock
    
  • Conda (πŸ“₯ 7.1M Β· ⏱️ 01.06.2022):

     conda install -c conda-forge filelock
    
aiofiles (πŸ₯‰30 Β· ⭐ 2K) - File support for asyncio. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 130 Β· πŸ“‹ 91 - 48% open Β· ⏱️ 13.01.2022):

     git clone https://github.com/Tinche/aiofiles
    
  • PyPi (πŸ“₯ 5.5M / month Β· πŸ“¦ 1.4K Β· ⏱️ 27.11.2021):

     pip install aiofiles
    
  • Conda (πŸ“₯ 230K Β· ⏱️ 15.12.2021):

     conda install -c conda-forge aiofiles
    
scandir (πŸ₯‰30 Β· ⭐ 500) - Better directory iterator and faster os.walk(), now in the Python 3.5.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 22 Β· πŸ”€ 62 Β· πŸ“¦ 14K Β· πŸ“‹ 100 - 10% open Β· ⏱️ 23.01.2022):

     git clone https://github.com/benhoyt/scandir
    
  • PyPi (πŸ“₯ 4.2M / month Β· πŸ“¦ 2.2K Β· ⏱️ 09.03.2019):

     pip install scandir
    
  • Conda (πŸ“₯ 1.2M Β· ⏱️ 08.04.2022):

     conda install -c conda-forge scandir
    
path (πŸ₯‰27 Β· ⭐ 990) - Object-oriented file system path manipulation. MIT
  • GitHub (πŸ‘¨β€πŸ’» 46 Β· πŸ”€ 140 Β· πŸ“‹ 130 - 0% open Β· ⏱️ 25.02.2022):

     git clone https://github.com/jaraco/path
    
  • PyPi (πŸ“₯ 750K / month Β· πŸ“¦ 96 Β· ⏱️ 25.02.2022):

     pip install path
    
  • Conda (πŸ“₯ 250K Β· ⏱️ 06.04.2022):

     conda install -c conda-forge path
    
Show 3 hidden projects...
  • appdirs (πŸ₯ˆ32 Β· ⭐ 880 Β· πŸ’€) - A small Python module for determining appropriate platform-specific.. MIT
  • zipp (πŸ₯‰27 Β· ⭐ 27) - Backport of pathlib-compatible object wrapper for zip files. MIT
  • Unipath (πŸ₯‰22 Β· ⭐ 500 Β· πŸ’€) - An object-oriented approach to Python file/directory operations. MIT

Compatiblity

Back to top

future (πŸ₯‡37 Β· ⭐ 1.1K Β· πŸ’€) - Easy, clean, reliable Python 2/3 compatibility. MIT
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 260 Β· πŸ“¦ 220K Β· πŸ“‹ 380 - 48% open Β· ⏱️ 30.11.2021):

     git clone https://github.com/PythonCharmers/python-future
    
  • PyPi (πŸ“₯ 35M / month Β· πŸ“¦ 17K Β· ⏱️ 31.10.2019):

     pip install future
    
  • Conda (πŸ“₯ 7.1M Β· ⏱️ 03.04.2022):

     conda install -c conda-forge future
    
six (πŸ₯ˆ35 Β· ⭐ 880 Β· πŸ’€) - Python 2 and 3 compatibility library. MIT
  • GitHub (πŸ‘¨β€πŸ’» 65 Β· πŸ”€ 240 Β· πŸ“¦ 1.2M Β· πŸ“‹ 280 - 38% open Β· ⏱️ 21.11.2021):

     git clone https://github.com/benjaminp/six
    
  • PyPi (πŸ“₯ 160M / month Β· πŸ“¦ 130K Β· ⏱️ 05.05.2021):

     pip install six
    
  • Conda (πŸ“₯ 26M Β· ⏱️ 05.05.2021):

     conda install -c conda-forge six
    
typing (πŸ₯ˆ34 Β· ⭐ 1.3K) - Python static typing home. Hosts the documentation and a user help.. Python-2.0
  • GitHub (πŸ‘¨β€πŸ’» 87 Β· πŸ”€ 210 Β· πŸ“‹ 660 - 13% open Β· ⏱️ 02.06.2022):

     git clone https://github.com/python/typing
    
  • PyPi (πŸ“₯ 13M / month Β· πŸ“¦ 5.7K Β· ⏱️ 01.05.2021):

     pip install typing
    
  • Conda (πŸ“₯ 1.1M Β· ⏱️ 01.05.2021):

     conda install -c conda-forge typing
    
dataclasses (πŸ₯‰27 Β· ⭐ 540) - A backport of the dataclasses module for Python 3.6. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 46 Β· πŸ“¦ 35K Β· πŸ“‹ 120 - 8% open Β· ⏱️ 22.03.2022):

     git clone https://github.com/ericvsmith/dataclasses
    
  • PyPi (πŸ“₯ 11M / month Β· πŸ“¦ 1.6K Β· ⏱️ 13.11.2020):

     pip install dataclasses
    
  • Conda (πŸ“₯ 6M Β· ⏱️ 14.08.2021):

     conda install -c conda-forge dataclasses
    
futures (πŸ₯‰27 Β· ⭐ 220) - Backport of the concurrent.futures package to Python 2.6 and 2.7. Python-2.0
  • GitHub (πŸ‘¨β€πŸ’» 19 Β· πŸ”€ 46 Β· πŸ“¦ 31K Β· πŸ“‹ 71 - 8% open Β· ⏱️ 11.01.2022):

     git clone https://github.com/agronholm/pythonfutures
    
  • PyPi (πŸ“₯ 15M / month Β· πŸ“¦ 8K Β· ⏱️ 09.10.2021):

     pip install futures
    
  • Conda (πŸ“₯ 1.2M Β· ⏱️ 18.03.2020):

     conda install -c conda-forge futures
    
Show 2 hidden projects...
  • pathlib2 (πŸ₯‰29 Β· ⭐ 69) - Backport of pathlib aiming to support the full stdlib Python API. MIT
  • contextlib2 (πŸ₯‰26 Β· ⭐ 34) - contextlib2 is a backport of the standard librarys contextlib.. ❗️psfrag

Cryptography

Back to top

cryptography (πŸ₯‡44 Β· ⭐ 4.9K) - cryptography is a package designed to expose cryptographic.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 260 Β· πŸ”€ 1K Β· πŸ“¦ 280K Β· πŸ“‹ 2K - 2% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/pyca/cryptography
    
  • PyPi (πŸ“₯ 110M / month Β· πŸ“¦ 20K Β· ⏱️ 21.06.2022):

     pip install cryptography
    
  • Conda (πŸ“₯ 23M Β· ⏱️ 19.05.2022):

     conda install -c conda-forge cryptography
    
pycryptodomex (πŸ₯ˆ38 Β· ⭐ 2K) - A self-contained cryptographic library for Python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 120 Β· πŸ”€ 380 Β· πŸ“¦ 45K Β· πŸ“‹ 490 - 16% open Β· ⏱️ 25.06.2022):

     git clone https://github.com/Legrandin/pycryptodome
    
  • PyPi (πŸ“₯ 26M / month Β· πŸ“¦ 1.3K Β· ⏱️ 22.06.2022):

     pip install pycryptodomex
    
  • Conda (πŸ“₯ 700K Β· ⏱️ 08.04.2022):

     conda install -c conda-forge pycryptodomex
    
tink (πŸ₯ˆ35 Β· ⭐ 12K) - Tink is a multi-language, cross-platform, open source library that.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 1.1K Β· πŸ“₯ 960 Β· πŸ“¦ 27 Β· πŸ“‹ 430 - 28% open Β· ⏱️ 24.06.2022):

     git clone https://github.com/google/tink
    
  • PyPi (πŸ“₯ 1.1M / month Β· πŸ“¦ 3 Β· ⏱️ 10.08.2021):

     pip install tink
    
  • npm (πŸ“₯ 920 / month Β· ⏱️ 25.08.2020):

     npm install tink-crypto
    
bcrypt (πŸ₯‰34 Β· ⭐ 870) - Modern(-ish) password hashing for your software and your servers. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 30 Β· πŸ”€ 120 Β· πŸ“‹ 97 - 2% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/pyca/bcrypt
    
  • PyPi (πŸ“₯ 28M / month Β· πŸ“¦ 7.9K Β· ⏱️ 01.05.2022):

     pip install bcrypt
    
  • Conda (πŸ“₯ 2M Β· ⏱️ 01.05.2022):

     conda install -c conda-forge bcrypt
    
asn1crypto (πŸ₯‰34 Β· ⭐ 270) - Python ASN.1 library with a focus on performance and a pythonic API. MIT
  • GitHub (πŸ‘¨β€πŸ’» 38 Β· πŸ”€ 110 Β· πŸ“¦ 90K Β· πŸ“‹ 150 - 20% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/wbond/asn1crypto
    
  • PyPi (πŸ“₯ 37M / month Β· πŸ“¦ 7K Β· ⏱️ 15.03.2022):

     pip install asn1crypto
    
  • Conda (πŸ“₯ 6.9M Β· ⏱️ 15.03.2022):

     conda install -c conda-forge asn1crypto
    
keyring (πŸ₯‰33 Β· ⭐ 860) - Store and access your passwords safely. MIT
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 120 Β· πŸ“‹ 450 - 9% open Β· ⏱️ 08.06.2022):

     git clone https://github.com/jaraco/keyring
    
  • PyPi (πŸ“₯ 25M / month Β· πŸ“¦ 3.7K Β· ⏱️ 08.06.2022):

     pip install keyring
    
  • Conda (πŸ“₯ 1.8M Β· ⏱️ 08.06.2022):

     conda install -c conda-forge keyring
    
rsa (πŸ₯‰30 Β· ⭐ 380) - Python-RSA is a pure-Python RSA implementation. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 38 Β· πŸ”€ 90 Β· πŸ“‹ 110 - 15% open Β· ⏱️ 13.03.2022):

     git clone https://github.com/sybrenstuvel/python-rsa
    
  • PyPi (πŸ“₯ 110M / month Β· πŸ“¦ 6.9K Β· ⏱️ 24.11.2021):

     pip install rsa
    
  • Conda (πŸ“₯ 6.9M Β· ⏱️ 24.11.2021):

     conda install -c conda-forge rsa
    

Infrastructure & DevOps

Back to top

ansible (πŸ₯‡48 Β· ⭐ 54K) - Ansible is a radically simple IT automation platform that makes your.. ❗️GPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 6.6K Β· πŸ”€ 22K Β· πŸ“¦ 22K Β· πŸ“‹ 31K - 3% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/ansible/ansible
    
  • PyPi (πŸ“₯ 4.9M / month Β· πŸ“¦ 4.1K Β· ⏱️ 28.06.2022):

     pip install ansible
    
  • Conda (πŸ“₯ 660K Β· ⏱️ 23.06.2022):

     conda install -c conda-forge ansible
    
awscli (πŸ₯‡44 Β· ⭐ 13K) - Universal Command Line Interface for Amazon Web Services. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 390 Β· πŸ”€ 3.3K Β· πŸ“₯ 900 Β· πŸ“¦ 1 Β· πŸ“‹ 4.1K - 14% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/aws/aws-cli
    
  • PyPi (πŸ“₯ 100M / month Β· πŸ“¦ 3K Β· ⏱️ 29.06.2022):

     pip install awscli
    
  • Conda (πŸ“₯ 13M Β· ⏱️ 30.06.2022):

     conda install -c conda-forge awscli
    
botocore (πŸ₯‡44 Β· ⭐ 1.1K) - The low-level, core functionality of boto 3. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 180 Β· πŸ”€ 920 Β· πŸ“¦ 140K Β· πŸ“‹ 940 - 15% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/boto/botocore
    
  • PyPi (πŸ“₯ 220M / month Β· πŸ“¦ 8.1K Β· ⏱️ 29.06.2022):

     pip install botocore
    
  • Conda (πŸ“₯ 14M Β· ⏱️ 30.06.2022):

     conda install -c conda-forge botocore
    
docker-compose (πŸ₯ˆ41 Β· ⭐ 26K Β· πŸ“‰) - Define and run multi-container applications with Docker. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 430 Β· πŸ”€ 4.4K Β· πŸ“₯ 160M Β· πŸ“‹ 6.4K - 7% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/docker/compose
    
  • PyPi (πŸ“₯ 1.8M / month Β· πŸ“¦ 1.2K Β· ⏱️ 10.05.2021):

     pip install docker-compose
    
  • Conda (πŸ“₯ 210K Β· ⏱️ 22.03.2022):

     conda install -c conda-forge docker-compose
    
paramiko (πŸ₯ˆ41 Β· ⭐ 7.7K) - The leading native Python SSHv2 protocol library. ❗️LGPL-2.1
  • GitHub (πŸ‘¨β€πŸ’» 180 Β· πŸ”€ 1.8K Β· πŸ“¦ 59K Β· πŸ“‹ 1.6K - 58% open Β· ⏱️ 10.06.2022):

     git clone https://github.com/paramiko/paramiko
    
  • PyPi (πŸ“₯ 27M / month Β· πŸ“¦ 13K Β· ⏱️ 17.05.2022):

     pip install paramiko
    
  • Conda (πŸ“₯ 2M Β· ⏱️ 17.05.2022):

     conda install -c conda-forge paramiko
    
pulumi (πŸ₯ˆ40 Β· ⭐ 13K) - Pulumi - Universal Infrastructure as Code. Your Cloud, Your Language,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 180 Β· πŸ”€ 700 Β· πŸ“₯ 38K Β· πŸ“¦ 1.6K Β· πŸ“‹ 4.9K - 28% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/pulumi/pulumi
    
  • PyPi (πŸ“₯ 140K / month Β· πŸ“¦ 120 Β· ⏱️ 30.06.2022):

     pip install pulumi
    
  • npm (πŸ“₯ 690K / month Β· πŸ“¦ 370 Β· ⏱️ 30.06.2022):

     npm install @pulumi/pulumi
    
docker (πŸ₯ˆ40 Β· ⭐ 5.8K Β· πŸ’€) - A Python library for the Docker Engine API. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 400 Β· πŸ”€ 1.6K Β· πŸ“¦ 40K Β· πŸ“‹ 1.6K - 32% open Β· ⏱️ 14.10.2021):

     git clone https://github.com/docker/docker-py
    
  • PyPi (πŸ“₯ 28M / month Β· πŸ“¦ 3.4K Β· ⏱️ 07.10.2021):

     pip install docker
    
  • Conda (πŸ“₯ 2.2M Β· ⏱️ 07.12.2021):

     conda install -c conda-forge docker-py
    
kubernetes (πŸ₯ˆ37 Β· ⭐ 4.9K) - Official Python client library for kubernetes. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 2.6K Β· πŸ“‹ 1.1K - 9% open Β· ⏱️ 23.06.2022):

     git clone https://github.com/kubernetes-client/python
    
  • PyPi (πŸ“₯ 11M / month Β· πŸ“¦ 1.2K Β· ⏱️ 22.06.2022):

     pip install kubernetes
    
  • Conda (πŸ“₯ 290K Β· ⏱️ 23.05.2022):

     conda install -c conda-forge kubernetes
    
netmiko (πŸ₯ˆ37 Β· ⭐ 2.8K) - Multi-vendor library to simplify Paramiko SSH connections to network.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 200 Β· πŸ”€ 1.1K Β· πŸ“¦ 2.4K Β· πŸ“‹ 1.7K - 13% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/ktbyers/netmiko
    
  • PyPi (πŸ“₯ 140K / month Β· πŸ“¦ 240 Β· ⏱️ 28.06.2022):

     pip install netmiko
    
schedule (πŸ₯‰35 Β· ⭐ 9.7K) - Python job scheduling for humans. MIT
  • GitHub (πŸ‘¨β€πŸ’» 51 Β· πŸ”€ 810 Β· πŸ“¦ 19K Β· πŸ“‹ 380 - 30% open Β· ⏱️ 23.04.2022):

     git clone https://github.com/dbader/schedule
    
  • PyPi (πŸ“₯ 1.8M / month Β· πŸ“¦ 1.3K Β· ⏱️ 10.04.2021):

     pip install schedule
    
  • Conda (πŸ“₯ 16K Β· ⏱️ 10.04.2021):

     conda install -c conda-forge schedule
    
fabric (πŸ₯‰31 Β· ⭐ 13K Β· πŸ“‰) - Simple, Pythonic remote execution and deployment. BSD-2
  • GitHub (πŸ‘¨β€πŸ’» 140 Β· πŸ”€ 1.9K Β· πŸ“‹ 1.7K - 25% open Β· ⏱️ 07.04.2022):

     git clone https://github.com/fabric/fabric
    
  • PyPi (πŸ“₯ 1.6M / month Β· ⏱️ 07.04.2022):

     pip install fabric
    
  • Conda (πŸ“₯ 49K Β· ⏱️ 28.03.2022):

     conda install -c conda-forge fabric
    
plumbum (πŸ₯‰31 Β· ⭐ 2.5K) - Plumbum: Shell Combinators. MIT
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 170 Β· πŸ“‹ 340 - 35% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/tomerfiliba/plumbum
    
  • PyPi (πŸ“₯ 2M / month Β· πŸ“¦ 440 Β· ⏱️ 23.12.2021):

     pip install plumbum
    
  • Conda (πŸ“₯ 810K Β· ⏱️ 23.12.2021):

     conda install -c conda-forge plumbum
    
pyinfra (πŸ₯‰30 Β· ⭐ 1.5K) - pyinfra automates infrastructure super fast at massive scale. It can be.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 69 Β· πŸ”€ 270 Β· πŸ“¦ 50 Β· πŸ“‹ 600 - 17% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/Fizzadar/pyinfra
    
  • PyPi (πŸ“₯ 21K / month Β· πŸ“¦ 11 Β· ⏱️ 30.06.2022):

     pip install pyinfra
    
pypyr (πŸ₯‰21 Β· ⭐ 410) - pypyr task-runner cli & api for automation pipelines. Automate anything.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 9 Β· πŸ”€ 20 Β· πŸ“¦ 62 Β· πŸ“‹ 120 - 15% open Β· ⏱️ 26.05.2022):

     git clone https://github.com/pypyr/pypyr
    
  • PyPi (πŸ“₯ 510 / month Β· πŸ“¦ 8 Β· ⏱️ 26.05.2022):

     pip install pypyr
    
  • Conda (πŸ“₯ 1.3K Β· ⏱️ 25.04.2022):

     conda install -c conda-forge pypyr
    
Show 5 hidden projects...
  • sshtunnel (πŸ₯‰28 Β· ⭐ 980 Β· πŸ’€) - SSH tunnels to remote server. MIT
  • storm (πŸ₯‰25 Β· ⭐ 3.9K Β· πŸ’€) - Manage your SSH like a boss. MIT
  • fabtools (πŸ₯‰25 Β· ⭐ 1.3K Β· πŸ’€) - Tools for writing awesome Fabric files. BSD-2
  • parallel-ssh (πŸ₯‰25 Β· ⭐ 1K) - Asynchronous parallel SSH client library. ❗️LGPL-2.1
  • wssh (πŸ₯‰17 Β· ⭐ 1.3K Β· πŸ’€) - SSH to WebSockets Bridge. MIT

Process Utilities

Back to top

pexpect (πŸ₯‡36 Β· ⭐ 2.2K) - A Python module for controlling interactive programs in a pseudo-terminal. ISC
  • GitHub (πŸ‘¨β€πŸ’» 94 Β· πŸ”€ 440 Β· πŸ“₯ 4.2K Β· πŸ“¦ 200K Β· πŸ“‹ 440 - 39% open Β· ⏱️ 06.02.2022):

     git clone https://github.com/pexpect/pexpect
    
  • PyPi (πŸ“₯ 26M / month Β· πŸ“¦ 16K Β· ⏱️ 15.12.2021):

     pip install pexpect
    
  • Conda (πŸ“₯ 8.4M Β· ⏱️ 12.10.2020):

     conda install -c conda-forge pexpect
    
supervisor (πŸ₯ˆ35 Β· ⭐ 7.4K) - Supervisor process control system for UNIX. ❗️Repoze Public License
  • GitHub (πŸ‘¨β€πŸ’» 160 Β· πŸ”€ 1.2K Β· πŸ“¦ 7.3K Β· πŸ“‹ 1.1K - 12% open Β· ⏱️ 30.04.2022):

     git clone https://github.com/Supervisor/supervisor
    
  • PyPi (πŸ“₯ 1.3M / month Β· πŸ“¦ 1.9K Β· ⏱️ 30.12.2021):

     pip install supervisor
    
  • Conda (πŸ“₯ 200K Β· ⏱️ 12.04.2022):

     conda install -c conda-forge supervisor
    
sh (πŸ₯‰33 Β· ⭐ 6.2K) - Python process launching. MIT
  • GitHub (πŸ‘¨β€πŸ’» 84 Β· πŸ”€ 450 Β· πŸ“¦ 9.6K Β· πŸ“‹ 410 - 2% open Β· ⏱️ 14.06.2022):

     git clone https://github.com/amoffat/sh
    
  • PyPi (πŸ“₯ 2.8M / month Β· πŸ“¦ 2.5K Β· ⏱️ 15.12.2021):

     pip install sh
    
  • Conda (πŸ“₯ 130K Β· ⏱️ 20.06.2022):

     conda install -c conda-forge sh
    
ptyprocess (πŸ₯‰26 Β· ⭐ 170 Β· πŸ’€) - Run a subprocess in a pseudo terminal. ISC
  • GitHub (πŸ‘¨β€πŸ’» 16 Β· πŸ”€ 61 Β· πŸ“‹ 34 - 50% open Β· ⏱️ 31.10.2021):

     git clone https://github.com/pexpect/ptyprocess
    
  • PyPi (πŸ“₯ 26M / month Β· πŸ“¦ 13K Β· ⏱️ 28.12.2020):

     pip install ptyprocess
    
  • Conda (πŸ“₯ 8.1M Β· ⏱️ 31.12.2020):

     conda install -c conda-forge ptyprocess
    

Asynchronous Programming

Back to top

uvloop (πŸ₯‡36 Β· ⭐ 8.7K Β· πŸ’€) - Ultra fast asyncio event loop. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 42 Β· πŸ”€ 500 Β· πŸ“₯ 350 Β· πŸ“¦ 46K Β· πŸ“‹ 300 - 24% open Β· ⏱️ 10.08.2021):

     git clone https://github.com/MagicStack/uvloop
    
  • PyPi (πŸ“₯ 9.2M / month Β· πŸ“¦ 1.7K Β· ⏱️ 10.08.2021):

     pip install uvloop
    
  • Conda (πŸ“₯ 450K Β· ⏱️ 02.11.2021):

     conda install -c conda-forge uvloop
    
greenlet (πŸ₯‡36 Β· ⭐ 1.4K) - Lightweight in-process concurrent programming. MIT
  • GitHub (πŸ‘¨β€πŸ’» 62 Β· πŸ”€ 220 Β· πŸ“¦ 140K Β· πŸ“‹ 180 - 12% open Β· ⏱️ 24.03.2022):

     git clone https://github.com/python-greenlet/greenlet
    
  • PyPi (πŸ“₯ 42M / month Β· πŸ“¦ 10K Β· ⏱️ 24.03.2022):

     pip install greenlet
    
  • Conda (πŸ“₯ 3.6M Β· ⏱️ 02.04.2022):

     conda install -c conda-forge greenlet
    
anyio (πŸ₯ˆ30 Β· ⭐ 920) - High level asynchronous concurrency and networking framework that works on.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 31 Β· πŸ”€ 73 Β· πŸ“‹ 240 - 14% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/agronholm/anyio
    
  • PyPi (πŸ“₯ 14M / month Β· πŸ“¦ 190 Β· ⏱️ 13.05.2022):

     pip install anyio
    
  • Conda (πŸ“₯ 2.1M Β· ⏱️ 13.05.2022):

     conda install -c conda-forge anyio
    
aiomisc (πŸ₯‰24 Β· ⭐ 270) - aiomisc - miscellaneous utils for asyncio. MIT
  • GitHub (πŸ‘¨β€πŸ’» 13 Β· πŸ”€ 18 Β· πŸ“¦ 210 Β· πŸ“‹ 15 - 33% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/aiokitchen/aiomisc
    
  • PyPi (πŸ“₯ 9.1K / month Β· πŸ“¦ 30 Β· ⏱️ 14.06.2022):

     pip install aiomisc
    
unsync (πŸ₯‰21 Β· ⭐ 760) - Unsynchronize asyncio. MIT
  • GitHub (πŸ‘¨β€πŸ’» 11 Β· πŸ”€ 47 Β· πŸ“¦ 120 Β· πŸ“‹ 27 - 11% open Β· ⏱️ 06.02.2022):

     git clone https://github.com/alex-sherman/unsync
    
  • PyPi (πŸ“₯ 9.8K / month Β· πŸ“¦ 15 Β· ⏱️ 21.10.2021):

     pip install unsync
    
  • Conda (πŸ“₯ 5.1K Β· ⏱️ 06.06.2022):

     conda install -c conda-forge unsync
    
asyncer (πŸ₯‰15 Β· ⭐ 660 Β· 🐣) - Asyncer, async and await, focused on developer experience. MIT
  • GitHub (πŸ‘¨β€πŸ’» 7 Β· πŸ”€ 24 Β· πŸ“‹ 5 - 60% open Β· ⏱️ 12.05.2022):

     git clone https://github.com/tiangolo/asyncer
    
  • PyPi (πŸ“₯ 35K / month Β· ⏱️ 04.01.2022):

     pip install asyncer
    
  • Conda (πŸ“₯ 290 Β· ⏱️ 10.01.2022):

     conda install -c conda-forge asyncer
    
Show 1 hidden projects...
  • stopit (πŸ₯‰20 Β· ⭐ 96 Β· πŸ’€) - Raise asynchronous exceptions in other thread, control the timeout of.. MIT

Configuration

Back to top

python-dotenv (πŸ₯‡36 Β· ⭐ 5.1K) - Reads key-value pairs from a .env file and can set them as.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 77 Β· πŸ”€ 310 Β· πŸ“¦ 250K Β· πŸ“‹ 230 - 14% open Β· ⏱️ 12.06.2022):

     git clone https://github.com/theskumar/python-dotenv
    
  • PyPi (πŸ“₯ 18M / month Β· πŸ“¦ 6.4K Β· ⏱️ 24.03.2022):

     pip install python-dotenv
    
  • Conda (πŸ“₯ 1.6M Β· ⏱️ 24.03.2022):

     conda install -c conda-forge python-dotenv
    
Dynaconf (πŸ₯ˆ33 Β· ⭐ 2.5K) - Configuration Management for Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 88 Β· πŸ”€ 220 Β· πŸ“¦ 2.9K Β· πŸ“‹ 360 - 27% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/rochacbruno/dynaconf
    
  • PyPi (πŸ“₯ 1.2M / month Β· πŸ“¦ 180 Β· ⏱️ 06.06.2022):

     pip install dynaconf
    
  • Conda (πŸ“₯ 19K Β· ⏱️ 19.04.2022):

     conda install -c conda-forge dynaconf
    
omegaconf (πŸ₯ˆ33 Β· ⭐ 1.2K) - Flexible Python configuration system. The last one you will ever need. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 64 Β· πŸ“¦ 4.7K Β· πŸ“‹ 450 - 12% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/omry/omegaconf
    
  • PyPi (πŸ“₯ 1.7M / month Β· πŸ“¦ 160 Β· ⏱️ 27.05.2022):

     pip install omegaconf
    
  • Conda (πŸ“₯ 510K Β· ⏱️ 08.06.2022):

     conda install -c conda-forge omegaconf
    
python-decouple (πŸ₯‰32 Β· ⭐ 2.1K) - Strict separation of config from code. MIT
  • GitHub (πŸ‘¨β€πŸ’» 32 Β· πŸ”€ 160 Β· πŸ“₯ 7 Β· πŸ“¦ 70K Β· πŸ“‹ 78 - 10% open Β· ⏱️ 11.05.2022):

     git clone https://github.com/henriquebastos/python-decouple
    
  • PyPi (πŸ“₯ 860K / month Β· πŸ“¦ 3.2K Β· ⏱️ 02.02.2022):

     pip install python-decouple
    
  • Conda (πŸ“₯ 43K Β· ⏱️ 02.02.2022):

     conda install -c conda-forge python-decouple
    
hydra (πŸ₯‰30 Β· ⭐ 6.1K) - Hydra is a framework for elegantly configuring complex applications. MIT
  • GitHub (πŸ‘¨β€πŸ’» 94 Β· πŸ”€ 480 Β· πŸ“¦ 10 Β· πŸ“‹ 1.1K - 14% open Β· ⏱️ 24.06.2022):

     git clone https://github.com/facebookresearch/hydra
    
  • PyPi (πŸ“₯ 8.4K / month Β· πŸ“¦ 6 Β· ⏱️ 03.08.2016):

     pip install hydra
    
  • Conda (πŸ“₯ 370K Β· ⏱️ 30.06.2022):

     conda install -c conda-forge hydra-core
    
gin-config (πŸ₯‰27 Β· ⭐ 1.6K) - Gin provides a lightweight configuration framework for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 22 Β· πŸ”€ 96 Β· πŸ“¦ 4.2K Β· πŸ“‹ 80 - 51% open Β· ⏱️ 27.05.2022):

     git clone https://github.com/google/gin-config
    
  • PyPi (πŸ“₯ 260K / month Β· πŸ“¦ 77 Β· ⏱️ 03.11.2021):

     pip install gin-config
    
  • Conda (πŸ“₯ 9.3K Β· ⏱️ 07.01.2022):

     conda install -c conda-forge gin-config
    
everett (πŸ₯‰23 Β· ⭐ 130) - configuration library for python projects. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 5 Β· πŸ”€ 29 Β· πŸ“¦ 450 Β· πŸ“‹ 70 - 5% open Β· ⏱️ 13.01.2022):

     git clone https://github.com/willkg/everett
    
  • PyPi (πŸ“₯ 99K / month Β· πŸ“¦ 45 Β· ⏱️ 13.01.2022):

     pip install everett
    
  • Conda (πŸ“₯ 21K Β· ⏱️ 13.01.2022):

     conda install -c conda-forge everett
    
Show 2 hidden projects...
  • traitlets (πŸ₯ˆ34 Β· ⭐ 500) - A lightweight Traits like module. ❗Unlicensed
  • configobj (πŸ₯‰28 Β· ⭐ 280 Β· πŸ’€) - Python 3+ compatible port of the configobj library. BSD-3

CLI Development

Back to top

click (πŸ₯‡45 Β· ⭐ 13K Β· πŸ“‰) - Python composable command line interface toolkit. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 330 Β· πŸ”€ 1.3K Β· πŸ“¦ 850K Β· πŸ“‹ 1.4K - 4% open Β· ⏱️ 01.06.2022):

     git clone https://github.com/pallets/click
    
  • PyPi (πŸ“₯ 140M / month Β· πŸ“¦ 69K Β· ⏱️ 28.04.2022):

     pip install click
    
  • Conda (πŸ“₯ 16M Β· ⏱️ 29.04.2022):

     conda install -c conda-forge click
    
rich (πŸ₯‡43 Β· ⭐ 38K) - Rich is a Python library for rich text and beautiful formatting in the terminal. MIT
  • GitHub (πŸ‘¨β€πŸ’» 170 Β· πŸ”€ 1.2K Β· πŸ“¦ 21K Β· πŸ“‹ 850 - 7% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/Textualize/rich
    
  • PyPi (πŸ“₯ 10M / month Β· πŸ“¦ 1.9K Β· ⏱️ 24.05.2022):

     pip install rich
    
  • Conda (πŸ“₯ 1.1M Β· ⏱️ 24.05.2022):

     conda install -c conda-forge rich
    
python-prompt-toolkit (πŸ₯ˆ37 Β· ⭐ 7.8K) - Library for building powerful interactive command.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 210 Β· πŸ”€ 630 Β· πŸ“‹ 1K - 50% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/prompt-toolkit/python-prompt-toolkit
    
  • PyPi (πŸ“₯ 21M / month Β· πŸ“¦ 1.1K Β· ⏱️ 27.06.2022):

     pip install prompt_toolkit
    
  • Conda (πŸ“₯ 7.9M Β· ⏱️ 27.06.2022):

     conda install -c conda-forge prompt-toolkit
    
python-fire (πŸ₯ˆ36 Β· ⭐ 23K) - Python Fire is a library for automatically generating command.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 49 Β· πŸ”€ 1.3K Β· πŸ“¦ 13K Β· πŸ“‹ 280 - 44% open Β· ⏱️ 16.04.2022):

     git clone https://github.com/google/python-fire
    
  • PyPi (πŸ“₯ 3.7M / month Β· πŸ“¦ 1.4K Β· ⏱️ 22.01.2021):

     pip install fire
    
  • Conda (πŸ“₯ 210K Β· ⏱️ 22.01.2021):

     conda install -c conda-forge fire
    
colorama (πŸ₯ˆ36 Β· ⭐ 2.9K) - Simple cross-platform colored terminal text in Python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 48 Β· πŸ”€ 210 Β· πŸ“‹ 240 - 49% open Β· ⏱️ 20.06.2022):

     git clone https://github.com/tartley/colorama
    
  • PyPi (πŸ“₯ 110M / month Β· πŸ“¦ 20K Β· ⏱️ 16.06.2022):

     pip install colorama
    
  • Conda (πŸ“₯ 11M Β· ⏱️ 16.06.2022):

     conda install -c conda-forge colorama
    
Typer (πŸ₯ˆ33 Β· ⭐ 8.1K) - Typer, build great CLIs. Easy to code. Based on Python type hints. MIT
  • GitHub (πŸ‘¨β€πŸ’» 17 Β· πŸ”€ 310 Β· πŸ“‹ 280 - 62% open Β· ⏱️ 12.05.2022):

     git clone https://github.com/tiangolo/typer
    
  • PyPi (πŸ“₯ 8.4M / month Β· πŸ“¦ 1.2K Β· ⏱️ 30.03.2022):

     pip install typer
    
  • Conda (πŸ“₯ 620K Β· ⏱️ 30.03.2022):

     conda install -c conda-forge typer
    
argcomplete (πŸ₯‰32 Β· ⭐ 1.1K) - Python and tab completion, better together. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 56 Β· πŸ”€ 100 Β· πŸ“₯ 160 Β· πŸ“¦ 18K Β· πŸ“‹ 200 - 22% open Β· ⏱️ 03.01.2022):

     git clone https://github.com/kislyuk/argcomplete
    
  • PyPi (πŸ“₯ 13M / month Β· πŸ“¦ 1.8K Β· ⏱️ 03.01.2022):

     pip install argcomplete
    
  • Conda (πŸ“₯ 600K Β· ⏱️ 04.01.2022):

     conda install -c conda-forge argcomplete
    
asciimatics (πŸ₯‰31 Β· ⭐ 3.1K) - A cross platform package to do curses-like operations, plus.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 40 Β· πŸ”€ 230 Β· πŸ“¦ 670 Β· πŸ“‹ 280 - 8% open Β· ⏱️ 13.06.2022):

     git clone https://github.com/peterbrittain/asciimatics
    
  • PyPi (πŸ“₯ 970K / month Β· πŸ“¦ 110 Β· ⏱️ 23.04.2022):

     pip install asciimatics
    
  • Conda (πŸ“₯ 100K Β· ⏱️ 15.11.2021):

     conda install -c conda-forge asciimatics
    
cleo (πŸ₯‰30 Β· ⭐ 870) - Cleo allows you to create beautiful and testable command-line interfaces. MIT
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 59 Β· πŸ“‹ 71 - 52% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/sdispater/cleo
    
  • PyPi (πŸ“₯ 6.6M / month Β· πŸ“¦ 210 Β· ⏱️ 03.06.2022):

     pip install cleo
    
  • Conda (πŸ“₯ 180K Β· ⏱️ 26.01.2022):

     conda install -c conda-forge cleo
    
wcwidth (πŸ₯‰30 Β· ⭐ 280 Β· πŸ’€) - Python library that measures the width of unicode strings rendered to.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 11 Β· πŸ”€ 43 Β· πŸ“¦ 290K Β· πŸ“‹ 32 - 37% open Β· ⏱️ 28.09.2021):

     git clone https://github.com/jquast/wcwidth
    
  • PyPi (πŸ“₯ 25M / month Β· πŸ“¦ 13K Β· ⏱️ 23.06.2020):

     pip install wcwidth
    
  • Conda (πŸ“₯ 11M Β· ⏱️ 24.09.2020):

     conda install -c conda-forge wcwidth
    
ConfigArgParse (πŸ₯‰28 Β· ⭐ 600 Β· πŸ’€) - A drop-in replacement for argparse that allows options to.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 48 Β· πŸ”€ 100 Β· πŸ“¦ 7.9K Β· πŸ“‹ 180 - 35% open Β· ⏱️ 06.10.2021):

     git clone https://github.com/bw2/ConfigArgParse
    
  • PyPi (πŸ“₯ 2M / month Β· πŸ“¦ 1.4K Β· ⏱️ 03.10.2021):

     pip install configargparse
    
  • Conda (πŸ“₯ 310K Β· ⏱️ 04.10.2021):

     conda install -c conda-forge configargparse
    
questionary (πŸ₯‰27 Β· ⭐ 890) - Python library to build pretty command line user prompts Easy to use.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 32 Β· πŸ”€ 55 Β· πŸ“‹ 97 - 23% open Β· ⏱️ 17.06.2022):

     git clone https://github.com/tmbo/questionary
    
  • PyPi (πŸ“₯ 1.7M / month Β· πŸ“¦ 240 Β· ⏱️ 15.07.2021):

     pip install questionary
    
  • Conda (πŸ“₯ 12K Β· ⏱️ 14.03.2022):

     conda install -c conda-forge questionary
    
colout (πŸ₯‰18 Β· ⭐ 1.1K) - Color text streams with a polished command line interface. ❗️GPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 30 Β· πŸ”€ 55 Β· πŸ“¦ 5 Β· πŸ“‹ 68 - 17% open Β· ⏱️ 12.05.2022):

     git clone https://github.com/nojhan/colout
    
  • PyPi (πŸ“₯ 520 / month Β· ⏱️ 21.06.2020):

     pip install colout
    
Show 5 hidden projects...
  • docopt (πŸ₯ˆ36 Β· ⭐ 7.6K Β· πŸ’€) - Pythonic command line arguments parser, that will make you smile. MIT
  • blessings (πŸ₯‰29 Β· ⭐ 1.3K Β· πŸ’€) - A thin, practical wrapper around terminal capabilities in Python. MIT
  • clint (πŸ₯‰25 Β· ⭐ 75 Β· πŸ’€) - Python Command-line Application Tools. ISC
  • bashplotlib (πŸ₯‰22 Β· ⭐ 1.7K Β· πŸ’€) - plotting in the terminal. MIT
  • docopt-ng (πŸ₯‰21 Β· ⭐ 87) - Humane command line arguments parser. Now with maintenance, typehints,.. MIT

Development Tools

Back to top

πŸ”—Β best-of-python-dev ( ⭐ 510) - A ranked list of awesome python developer tools and libraries. Updated..


Data Caching

Back to top

cachetools (πŸ₯‡33 Β· ⭐ 1.4K) - Extensible memoizing collections and decorators. MIT
  • GitHub (πŸ‘¨β€πŸ’» 7 Β· πŸ”€ 130 Β· πŸ“‹ 210 - 2% open Β· ⏱️ 29.05.2022):

     git clone https://github.com/tkem/cachetools
    
  • PyPi (πŸ“₯ 68M / month Β· πŸ“¦ 3K Β· ⏱️ 29.05.2022):

     pip install cachetools
    
  • Conda (πŸ“₯ 5.1M Β· ⏱️ 28.12.2021):

     conda install -c conda-forge cachetools
    
pylibmc (πŸ₯ˆ28 Β· ⭐ 450 Β· πŸ’€) - A Python wrapper around the libmemcached interface from TangentOrg. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 49 Β· πŸ”€ 120 Β· πŸ“¦ 4K Β· πŸ“‹ 190 - 13% open Β· ⏱️ 26.10.2021):

     git clone https://github.com/lericson/pylibmc
    
  • PyPi (πŸ“₯ 140K / month Β· πŸ“¦ 2.4K Β· ⏱️ 15.08.2019):

     pip install pylibmc
    
  • Conda (πŸ“₯ 180K Β· ⏱️ 13.04.2022):

     conda install -c conda-forge pylibmc
    
beaker (πŸ₯‰27 Β· ⭐ 480) - WSGI middleware for sessions and caching. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 86 Β· πŸ”€ 130 Β· πŸ“¦ 3.6K Β· πŸ“‹ 120 - 53% open Β· ⏱️ 07.12.2021):

     git clone https://github.com/bbangert/beaker
    
  • PyPi (πŸ“₯ 310K / month Β· πŸ“¦ 1.4K Β· ⏱️ 26.08.2019):

     pip install beaker
    
  • Conda (πŸ“₯ 60K Β· ⏱️ 27.08.2019):

     conda install -c conda-forge beaker
    
aiocache (πŸ₯‰26 Β· ⭐ 700) - Asyncio cache manager for redis, memcached and memory. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 32 Β· πŸ”€ 100 Β· πŸ“¦ 820 Β· πŸ“‹ 260 - 19% open Β· ⏱️ 12.05.2022):

     git clone https://github.com/aio-libs/aiocache
    
  • PyPi (πŸ“₯ 150K / month Β· πŸ“¦ 94 Β· ⏱️ 31.07.2019):

     pip install aiocache
    
cachier (πŸ₯‰21 Β· ⭐ 410) - Persistent, stale-free, local and cross-machine caching for Python.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 14 Β· πŸ”€ 46 Β· πŸ“¦ 260 Β· πŸ“‹ 53 - 39% open Β· ⏱️ 04.06.2022):

     git clone https://github.com/shaypal5/cachier
    
  • PyPi (πŸ“₯ 7.4K / month Β· πŸ“¦ 25 Β· ⏱️ 25.11.2021):

     pip install cachier
    
Show 1 hidden projects...
  • cached-property (πŸ₯ˆ30 Β· ⭐ 650 Β· πŸ’€) - A decorator for caching properties in classes. BSD-3

GUI Development

Back to top

πŸ”—Β best-of-web-python - Web UI ( ⭐ 1.6K) - Collection of libraries to implement web-based UIs.

kivy (πŸ₯‡40 Β· ⭐ 15K) - Open source UI framework written in Python, running on Windows, Linux, macOS,.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 570 Β· πŸ”€ 2.9K Β· πŸ“₯ 26K Β· πŸ“¦ 7.2K Β· πŸ“‹ 4.6K - 19% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/kivy/kivy
    
  • PyPi (πŸ“₯ 58K / month Β· πŸ“¦ 580 Β· ⏱️ 06.03.2022):

     pip install kivy
    
  • Conda (πŸ“₯ 240K Β· ⏱️ 13.04.2022):

     conda install -c conda-forge kivy
    
PySimpleGUI (πŸ₯ˆ38 Β· ⭐ 10K) - PySimpleGUI is a Python package that enables Python.. ❗️LGPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 18 Β· πŸ”€ 1.5K Β· πŸ“¦ 5.4K Β· πŸ“‹ 2.9K - 23% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/PySimpleGUI/PySimpleGUI
    
  • PyPi (πŸ“₯ 130K / month Β· πŸ“¦ 230 Β· ⏱️ 22.05.2022):

     pip install pysimplegui
    
  • Conda (πŸ“₯ 58K Β· ⏱️ 13.06.2022):

     conda install -c conda-forge pysimplegui
    
DearPyGui (πŸ₯ˆ32 Β· ⭐ 8.1K) - Dear PyGui: A fast and powerful Graphical User Interface Toolkit for.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 43 Β· πŸ”€ 410 Β· πŸ“¦ 430 Β· πŸ“‹ 1K - 20% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/hoffstadt/DearPyGui
    
  • PyPi (πŸ“₯ 6.6K / month Β· πŸ“¦ 15 Β· ⏱️ 06.05.2022):

     pip install dearpygui
    
Eel (πŸ₯ˆ30 Β· ⭐ 5K Β· πŸ’€) - A little Python library for making simple Electron-like HTML/JS GUI apps. MIT
  • GitHub (πŸ‘¨β€πŸ’» 38 Β· πŸ”€ 500 Β· πŸ“¦ 3.7K Β· πŸ“‹ 450 - 31% open Β· ⏱️ 19.10.2021):

     git clone https://github.com/ChrisKnott/Eel
    
  • PyPi (πŸ“₯ 62K / month Β· πŸ“¦ 60 Β· ⏱️ 17.08.2020):

     pip install eel
    
Gooey (πŸ₯‰28 Β· ⭐ 16K) - Turn (almost) any Python command line program into a full GUI application.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 860 Β· πŸ“₯ 250 Β· πŸ“¦ 580 Β· πŸ“‹ 560 - 20% open Β· ⏱️ 08.05.2022):

     git clone https://github.com/chriskiehl/Gooey
    
  • PyPi (πŸ“₯ 3.7K / month Β· πŸ“¦ 71 Β· ⏱️ 29.01.2022):

     pip install gooey
    
  • Conda (πŸ“₯ 48K Β· ⏱️ 29.12.2021):

     conda install -c conda-forge gooey
    
toga (πŸ₯‰28 Β· ⭐ 3.2K) - A Python native, OS native GUI toolkit. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 210 Β· πŸ”€ 530 Β· πŸ“‹ 580 - 23% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/beeware/toga
    
  • PyPi (πŸ“₯ 1.1K / month Β· πŸ“¦ 33 Β· ⏱️ 31.05.2022):

     pip install toga
    
  • npm (πŸ“₯ 20 / month Β· ⏱️ 23.04.2017):

     npm install @pybee/toga
    
flexx (πŸ₯‰27 Β· ⭐ 3K) - Write desktop and web apps in pure Python. BSD-2
  • GitHub (πŸ‘¨β€πŸ’» 37 Β· πŸ”€ 260 Β· πŸ“¦ 110 Β· πŸ“‹ 440 - 19% open Β· ⏱️ 12.04.2022):

     git clone https://github.com/flexxui/flexx
    
  • PyPi (πŸ“₯ 760 / month Β· πŸ“¦ 21 Β· ⏱️ 12.04.2022):

     pip install flexx
    
  • Conda (πŸ“₯ 88K Β· ⏱️ 12.04.2022):

     conda install -c conda-forge flexx
    
Show 2 hidden projects...
  • Phoenix (πŸ₯‰27 Β· ⭐ 1.8K) - wxPythons Project Phoenix. A new implementation of wxPython,.. ❗️wxWindows
  • enaml (πŸ₯‰27 Β· ⭐ 1.2K) - Declarative User Interfaces for Python. ❗Unlicensed

Computer & Machine Vision

Back to top

πŸ”—Β best-of-ml-python - Computer Vision ( ⭐ 11K) - Collection of computer vision and image processing..


Machine Learning & Data Engineering

Back to top

πŸ”—Β best-of-ml-python ( ⭐ 11K) - A ranked list of awesome machine learning Python libraries. Updated..


Text Data

Back to top

πŸ”—Β best-of-ml-python - NLP ( ⭐ 11K) - Collection of text processing and NLP libraries.

chardet (πŸ₯‡35 Β· ⭐ 1.7K Β· πŸ“ˆ) - Python character encoding detector. ❗️LGPL-2.1
  • GitHub (πŸ‘¨β€πŸ’» 48 Β· πŸ”€ 240 Β· πŸ“‹ 140 - 46% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/chardet/chardet
    
  • PyPi (πŸ“₯ 62M / month Β· πŸ“¦ 39K Β· ⏱️ 25.06.2022):

     pip install chardet
    
  • Conda (πŸ“₯ 17M Β· ⏱️ 25.06.2022):

     conda install -c conda-forge chardet
    
  • npm (πŸ“₯ 8 / month Β· πŸ“¦ 1 Β· ⏱️ 20.08.2017):

     npm install @pypi/chardet
    
emoji (πŸ₯‡35 Β· ⭐ 1.5K) - emoji terminal output for Python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 55 Β· πŸ”€ 240 Β· πŸ“¦ 40K Β· πŸ“‹ 120 - 13% open Β· ⏱️ 05.05.2022):

     git clone https://github.com/carpedm20/emoji
    
  • PyPi (πŸ“₯ 3.7M / month Β· πŸ“¦ 1.3K Β· ⏱️ 08.03.2022):

     pip install emoji
    
  • Conda (πŸ“₯ 25K Β· ⏱️ 08.03.2022):

     conda install -c conda-forge emoji
    
phonenumbers (πŸ₯ˆ34 Β· ⭐ 3K) - Python port of Googles libphonenumber. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 26 Β· πŸ”€ 390 Β· πŸ“‹ 150 - 3% open Β· ⏱️ 10.06.2022):

     git clone https://github.com/daviddrysdale/python-phonenumbers
    
  • PyPi (πŸ“₯ 3.8M / month Β· πŸ“¦ 1.3K Β· ⏱️ 10.06.2022):

     pip install phonenumbers
    
  • Conda (πŸ“₯ 570K Β· ⏱️ 10.06.2022):

     conda install -c conda-forge phonenumbers
    
humanize (πŸ₯ˆ32 Β· ⭐ 1.6K) - python humanize functions. MIT
  • GitHub (πŸ‘¨β€πŸ’» 64 Β· πŸ”€ 160 Β· ⏱️ 13.06.2022):

     git clone https://github.com/jmoiron/humanize
    
  • PyPi (πŸ“₯ 3.6M / month Β· πŸ“¦ 1.9K Β· ⏱️ 30.06.2022):

     pip install humanize
    
  • Conda (πŸ“₯ 250K Β· ⏱️ 30.06.2022):

     conda install -c conda-forge humanize
    
python-slugify (πŸ₯ˆ30 Β· ⭐ 1.2K) - Returns unicode slugs. MIT
  • GitHub (πŸ‘¨β€πŸ’» 30 Β· πŸ”€ 90 Β· πŸ“‹ 56 - 3% open Β· ⏱️ 27.04.2022):

     git clone https://github.com/un33k/python-slugify
    
  • PyPi (πŸ“₯ 8.1M / month Β· πŸ“¦ 2.7K Β· ⏱️ 27.04.2022):

     pip install python-slugify
    
  • Conda (πŸ“₯ 860K Β· ⏱️ 28.04.2022):

     conda install -c conda-forge python-slugify
    
inflect (πŸ₯‰29 Β· ⭐ 670) - Correctly generate plurals, ordinals, indefinite articles; convert numbers.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 41 Β· πŸ”€ 74 Β· πŸ“‹ 89 - 22% open Β· ⏱️ 01.05.2022):

     git clone https://github.com/jaraco/inflect
    
  • PyPi (πŸ“₯ 1.7M / month Β· πŸ“¦ 910 Β· ⏱️ 01.05.2022):

     pip install inflect
    
  • Conda (πŸ“₯ 220K Β· ⏱️ 01.05.2022):

     conda install -c conda-forge inflect
    
pyahocorasick (πŸ₯‰28 Β· ⭐ 730) - Python module (C extension and plain python) implementing Aho-.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 100 Β· πŸ“¦ 1.1K Β· πŸ“‹ 120 - 20% open Β· ⏱️ 04.05.2022):

     git clone https://github.com/WojciechMula/pyahocorasick
    
  • PyPi (πŸ“₯ 360K / month Β· πŸ“¦ 96 Β· ⏱️ 04.05.2022):

     pip install pyahocorasick
    
  • Conda (πŸ“₯ 150K Β· ⏱️ 15.04.2022):

     conda install -c conda-forge pyahocorasick
    
Show 4 hidden projects...
  • awesome-slugify (πŸ₯‰22 Β· ⭐ 460 Β· πŸ’€) - Python flexible slugify function. ❗️GPL-3.0
  • price-parser (πŸ₯‰20 Β· ⭐ 230 Β· πŸ’€) - Extract price amount and currency symbol from a raw text.. BSD-3
  • coolname (πŸ₯‰19 Β· ⭐ 93 Β· πŸ’€) - Random Name and Slug Generator. BSD-2
  • millify (πŸ₯‰15 Β· ⭐ 65 Β· πŸ’€) - Convert long numbers into a human-readable format in Python. MIT

Web Development

Back to top

πŸ”—Β best-of-web-python ( ⭐ 1.6K) - A ranked list of awesome python libraries for web development. Updated..


Database Clients

Back to top

Libraries for connecting to, operating, and querying databases.

boto3 (πŸ₯‡45 Β· ⭐ 7.4K) - AWS SDK for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 140 Β· πŸ”€ 1.6K Β· πŸ“¦ 180K Β· πŸ“‹ 2.7K - 8% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/boto/boto3
    
  • PyPi (πŸ“₯ 390M / month Β· πŸ“¦ 16K Β· ⏱️ 29.06.2022):

     pip install boto3
    
  • Conda (πŸ“₯ 10M Β· ⏱️ 30.06.2022):

     conda install -c conda-forge boto3
    
redis (πŸ₯‡44 Β· ⭐ 11K) - Redis Python Client. MIT
  • GitHub (πŸ‘¨β€πŸ’» 330 Β· πŸ”€ 2.2K Β· πŸ“¦ 150K Β· πŸ“‹ 1.2K - 11% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/redis/redis-py
    
  • PyPi (πŸ“₯ 27M / month Β· πŸ“¦ 27K Β· ⏱️ 27.06.2022):

     pip install redis
    
  • Conda (πŸ“₯ 720K Β· ⏱️ 27.06.2022):

     conda install -c conda-forge redis-py
    
SQLAlchemy (πŸ₯‡44 Β· ⭐ 5.6K) - The Database Toolkit for Python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 560 Β· πŸ”€ 900 Β· πŸ“₯ 38K Β· πŸ“¦ 410K Β· πŸ“‹ 6.7K - 2% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/sqlalchemy/sqlalchemy
    
  • PyPi (πŸ“₯ 52M / month Β· πŸ“¦ 45K Β· ⏱️ 24.06.2022):

     pip install SQLAlchemy
    
  • Conda (πŸ“₯ 7.9M Β· ⏱️ 25.06.2022):

     conda install -c conda-forge sqlalchemy
    
azure-storage-blob (πŸ₯‡42 Β· ⭐ 2.9K) - This repository is for active development of the Azure SDK.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 420 Β· πŸ”€ 1.8K Β· πŸ“¦ 2K Β· πŸ“‹ 6.9K - 12% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/Azure/azure-sdk-for-python
    
  • PyPi (πŸ“₯ 40M / month Β· πŸ“¦ 520 Β· ⏱️ 15.06.2022):

     pip install azure-storage-blob
    
  • Conda (πŸ“₯ 460K Β· ⏱️ 16.05.2022):

     conda install -c conda-forge azure-storage-blob
    
peewee (πŸ₯‡40 Β· ⭐ 9.2K) - a small, expressive orm -- supports postgresql, mysql and sqlite. MIT
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 1.3K Β· πŸ“¦ 17K Β· πŸ“‹ 2.1K - 0% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/coleifer/peewee
    
  • PyPi (πŸ“₯ 1.1M / month Β· πŸ“¦ 3.6K Β· ⏱️ 17.06.2022):

     pip install peewee
    
  • Conda (πŸ“₯ 400K Β· ⏱️ 20.06.2022):

     conda install -c conda-forge peewee
    
google-cloud-storage (πŸ₯‡40 Β· ⭐ 3.9K) - Google Cloud Client Library for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 320 Β· πŸ”€ 1.4K Β· πŸ“‹ 3.4K - 0% open Β· ⏱️ 18.05.2022):

     git clone https://github.com/googleapis/google-cloud-python
    
  • PyPi (πŸ“₯ 46M / month Β· πŸ“¦ 1.7K Β· ⏱️ 08.06.2022):

     pip install google-cloud-storage
    
  • Conda (πŸ“₯ 1.7M Β· ⏱️ 09.06.2022):

     conda install -c conda-forge google-cloud-storage
    
elasticsearch (πŸ₯‡40 Β· ⭐ 3.7K) - Official Elasticsearch client library for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 190 Β· πŸ”€ 1.1K Β· πŸ“₯ 2K Β· πŸ“¦ 29K Β· πŸ“‹ 970 - 3% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/elastic/elasticsearch-py
    
  • PyPi (πŸ“₯ 18M / month Β· πŸ“¦ 6K Β· ⏱️ 29.06.2022):

     pip install elasticsearch
    
  • Conda (πŸ“₯ 600K Β· ⏱️ 29.06.2022):

     conda install -c conda-forge elasticsearch
    
kafka-python (πŸ₯ˆ38 Β· ⭐ 4.9K) - Python client for Apache Kafka. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 210 Β· πŸ”€ 1.3K Β· πŸ“₯ 1.7K Β· πŸ“¦ 11K Β· πŸ“‹ 1.4K - 17% open Β· ⏱️ 27.03.2022):

     git clone https://github.com/dpkp/kafka-python
    
  • PyPi (πŸ“₯ 6.9M / month Β· πŸ“¦ 1.3K Β· ⏱️ 30.09.2020):

     pip install kafka-python
    
  • Conda (πŸ“₯ 300K Β· ⏱️ 30.09.2020):

     conda install -c conda-forge kafka-python
    
pymongo (πŸ₯ˆ38 Β· ⭐ 3.6K) - PyMongo - the Python driver for MongoDB. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 200 Β· πŸ”€ 1K Β· ⏱️ 29.06.2022):

     git clone https://github.com/mongodb/mongo-python-driver
    
  • PyPi (πŸ“₯ 19M / month Β· πŸ“¦ 20K Β· ⏱️ 13.04.2022):

     pip install pymongo
    
  • Conda (πŸ“₯ 680K Β· ⏱️ 14.04.2022):

     conda install -c conda-forge pymongo
    
PyMySQL (πŸ₯ˆ37 Β· ⭐ 7K) - Pure Python MySQL Client. MIT
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 1.3K Β· πŸ“¦ 120K Β· πŸ“‹ 610 - 4% open Β· ⏱️ 14.06.2022):

     git clone https://github.com/PyMySQL/PyMySQL
    
  • PyPi (πŸ“₯ 29M / month Β· πŸ“¦ 10K Β· ⏱️ 09.01.2021):

     pip install PyMySQL
    
  • Conda (πŸ“₯ 680K Β· ⏱️ 09.01.2021):

     conda install -c conda-forge pymysql
    
MongoEngine (πŸ₯ˆ37 Β· ⭐ 3.8K) - A Python Object-Document-Mapper for working with MongoDB. MIT
  • GitHub (πŸ‘¨β€πŸ’» 370 Β· πŸ”€ 1.2K Β· πŸ“¦ 17K Β· πŸ“‹ 1.6K - 22% open Β· ⏱️ 13.05.2022):

     git clone https://github.com/MongoEngine/mongoengine
    
  • PyPi (πŸ“₯ 810K / month Β· πŸ“¦ 3.5K Β· ⏱️ 21.03.2022):

     pip install mongoengine
    
  • Conda (πŸ“₯ 160K Β· ⏱️ 21.02.2022):

     conda install -c conda-forge mongoengine
    
alembic (πŸ₯ˆ37 Β· ⭐ 1.4K) - A database migrations tool for SQLAlchemy. MIT
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 150 Β· πŸ“¦ 110K Β· πŸ“‹ 880 - 10% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/sqlalchemy/alembic
    
  • PyPi (πŸ“₯ 20M / month Β· πŸ“¦ 11K Β· ⏱️ 31.05.2022):

     pip install alembic
    
  • Conda (πŸ“₯ 1.8M Β· ⏱️ 01.06.2022):

     conda install -c conda-forge alembic
    
python-bigquery (πŸ₯ˆ37 Β· ⭐ 450) - Google BigQuery API client library. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 180 Β· πŸ“¦ 13K Β· πŸ“‹ 460 - 15% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/googleapis/python-bigquery
    
  • PyPi (πŸ“₯ 40M / month Β· πŸ“¦ 980 Β· ⏱️ 09.06.2022):

     pip install google-cloud-bigquery
    
  • Conda (πŸ“₯ 1.9M Β· ⏱️ 09.06.2022):

     conda install -c conda-forge google-cloud-bigquery
    
confluent-kafka-python (πŸ₯ˆ36 Β· ⭐ 2.8K) - Confluents Kafka Python Client. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 93 Β· πŸ”€ 750 Β· πŸ“¦ 3.8K Β· πŸ“‹ 980 - 23% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/confluentinc/confluent-kafka-python
    
  • PyPi (πŸ“₯ 5.9M / month Β· πŸ“¦ 370 Β· ⏱️ 16.06.2022):

     pip install confluent-kafka
    
  • Conda (πŸ“₯ 410K Β· ⏱️ 10.06.2022):

     conda install -c conda-forge python-confluent-kafka
    
SQLAlchemy-Utils (πŸ₯ˆ36 Β· ⭐ 940) - Various utility functions and datatypes for SQLAlchemy. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 270 Β· πŸ“¦ 15K Β· πŸ“‹ 370 - 49% open Β· ⏱️ 19.06.2022):

     git clone https://github.com/kvesteri/sqlalchemy-utils
    
  • PyPi (πŸ“₯ 3.6M / month Β· πŸ“¦ 2K Β· ⏱️ 29.12.2021):

     pip install sqlalchemy-utils
    
  • Conda (πŸ“₯ 380K Β· ⏱️ 06.02.2022):

     conda install -c conda-forge sqlalchemy-utils
    
libcloud (πŸ₯ˆ35 Β· ⭐ 1.9K) - Apache Libcloud is a Python library which hides differences between.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 450 Β· πŸ”€ 890 Β· πŸ“¦ 2.4K Β· πŸ“‹ 170 - 35% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/apache/libcloud
    
  • PyPi (πŸ“₯ 130K / month Β· πŸ“¦ 840 Β· ⏱️ 26.05.2022):

     pip install apache-libcloud
    
Motor (πŸ₯ˆ34 Β· ⭐ 2K) - Motor - the async Python driver for MongoDB and Tornado or asyncio. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 39 Β· πŸ”€ 180 Β· πŸ“¦ 30K Β· ⏱️ 16.06.2022):

     git clone https://github.com/mongodb/motor
    
  • PyPi (πŸ“₯ 2.5M / month Β· πŸ“¦ 1.1K Β· ⏱️ 28.04.2022):

     pip install motor
    
  • Conda (πŸ“₯ 21K Β· ⏱️ 28.04.2022):

     conda install -c conda-forge motor
    
Ibis (πŸ₯ˆ34 Β· ⭐ 1.9K) - Expressive analytics in Python at any scale. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 320 Β· πŸ“₯ 24 Β· πŸ“‹ 1.7K - 3% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/ibis-project/ibis
    
  • PyPi (πŸ“₯ 650K / month Β· πŸ“¦ 39 Β· ⏱️ 28.04.2022):

     pip install ibis-framework
    
  • Conda (πŸ“₯ 230K Β· ⏱️ 02.05.2022):

     conda install -c conda-forge ibis-framework
    
Elasticsearch DSL (πŸ₯ˆ33 Β· ⭐ 3.5K) - High level Python client for Elasticsearch. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 130 Β· πŸ”€ 720 Β· πŸ“₯ 130 Β· πŸ“¦ 6.2K Β· πŸ“‹ 1.2K - 8% open Β· ⏱️ 31.05.2022):

     git clone https://github.com/elastic/elasticsearch-dsl-py
    
  • PyPi (πŸ“₯ 2.6M / month Β· πŸ“¦ 930 Β· ⏱️ 15.07.2021):

     pip install elasticsearch-dsl
    
  • Conda (πŸ“₯ 5.6K Β· ⏱️ 02.05.2022):

     conda install -c anaconda elasticsearch-dsl
    
AWS Data Wrangler (πŸ₯ˆ33 Β· ⭐ 2.9K) - Pandas on AWS - Easy integration with Athena, Glue,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 490 Β· πŸ“₯ 140K Β· πŸ“‹ 700 - 4% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/awslabs/aws-data-wrangler
    
  • PyPi (πŸ“₯ 12M / month Β· πŸ“¦ 33 Β· ⏱️ 28.06.2022):

     pip install awswrangler
    
  • Conda (πŸ“₯ 210K Β· ⏱️ 29.06.2022):

     conda install -c conda-forge awswrangler
    
mysqlclient (πŸ₯ˆ33 Β· ⭐ 2.1K) - MySQL database connector for Python (with Python 3 support). ❗️GPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 70 Β· πŸ”€ 360 Β· πŸ“₯ 5.2K Β· πŸ“‹ 290 - 5% open Β· ⏱️ 22.06.2022):

     git clone https://github.com/PyMySQL/mysqlclient
    
  • PyPi (πŸ“₯ 3.9M / month Β· πŸ“¦ 7.1K Β· ⏱️ 22.06.2022):

     pip install mysqlclient
    
  • Conda (πŸ“₯ 160K Β· ⏱️ 20.06.2022):

     conda install -c conda-forge mysqlclient
    
s3fs (πŸ₯ˆ33 Β· ⭐ 560) - S3 Filesystem. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 98 Β· πŸ”€ 190 Β· πŸ“¦ 8.9K Β· πŸ“‹ 330 - 24% open Β· ⏱️ 19.05.2022):

     git clone https://github.com/fsspec/s3fs
    
  • PyPi (πŸ“₯ 38M / month Β· πŸ“¦ 490 Β· ⏱️ 19.05.2022):

     pip install s3fs
    
  • Conda (πŸ“₯ 3.6M Β· ⏱️ 20.05.2022):

     conda install -c conda-forge s3fs
    
pandas-gbq (πŸ₯ˆ33 Β· ⭐ 310) - Google BigQuery connector for pandas. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 37 Β· πŸ”€ 100 Β· πŸ“₯ 260 Β· πŸ“¦ 4.2K Β· πŸ“‹ 270 - 19% open Β· ⏱️ 16.06.2022):

     git clone https://github.com/googleapis/python-bigquery-pandas
    
  • PyPi (πŸ“₯ 5.9M / month Β· πŸ“¦ 290 Β· ⏱️ 09.06.2022):

     pip install pandas-gbq
    
  • Conda (πŸ“₯ 1.4M Β· ⏱️ 16.06.2022):

     conda install -c conda-forge pandas-gbq
    
s3transfer (πŸ₯ˆ33 Β· ⭐ 140) - Amazon S3 Transfer Manager for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 33 Β· πŸ”€ 98 Β· πŸ“¦ 110K Β· πŸ“‹ 64 - 50% open Β· ⏱️ 23.06.2022):

     git clone https://github.com/boto/s3transfer
    
  • PyPi (πŸ“₯ 180M / month Β· πŸ“¦ 4.2K Β· ⏱️ 31.05.2022):

     pip install s3transfer
    
  • Conda (πŸ“₯ 10M Β· ⏱️ 31.05.2022):

     conda install -c conda-forge s3transfer
    
Databases (πŸ₯ˆ32 Β· ⭐ 2.9K) - Async database support for Python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 44 Β· πŸ”€ 200 Β· πŸ“¦ 5.1K Β· πŸ“‹ 290 - 38% open Β· ⏱️ 21.06.2022):

     git clone https://github.com/encode/databases
    
  • PyPi (πŸ“₯ 210K / month Β· πŸ“¦ 99 Β· ⏱️ 30.05.2022):

     pip install databases
    
  • Conda (πŸ“₯ 140K Β· ⏱️ 15.11.2021):

     conda install -c conda-forge databases
    
Prometheus Client (πŸ₯ˆ32 Β· ⭐ 2.8K) - Prometheus instrumentation library for Python.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 120 Β· πŸ”€ 650 Β· πŸ“‹ 420 - 11% open Β· ⏱️ 06.05.2022):

     git clone https://github.com/prometheus/client_python
    
  • PyPi (πŸ“₯ 19M / month Β· πŸ“¦ 490 Β· ⏱️ 08.04.2022):

     pip install prometheus_client
    
  • Conda (πŸ“₯ 6.1M Β· ⏱️ 08.04.2022):

     conda install -c conda-forge prometheus_client
    
PynamoDB (πŸ₯ˆ32 Β· ⭐ 1.9K) - A pythonic interface to Amazons DynamoDB. MIT
  • GitHub (πŸ‘¨β€πŸ’» 95 Β· πŸ”€ 400 Β· πŸ“¦ 1K Β· πŸ“‹ 560 - 45% open Β· ⏱️ 07.03.2022):

     git clone https://github.com/pynamodb/PynamoDB
    
  • PyPi (πŸ“₯ 1.4M / month Β· πŸ“¦ 150 Β· ⏱️ 09.02.2022):

     pip install pynamodb
    
  • Conda (πŸ“₯ 180K Β· ⏱️ 09.06.2022):

     conda install -c conda-forge pynamodb
    
PyPika (πŸ₯ˆ32 Β· ⭐ 1.7K) - PyPika is a python SQL query builder that exposes the full richness.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 90 Β· πŸ”€ 210 Β· πŸ“¦ 1.7K Β· πŸ“‹ 370 - 33% open Β· ⏱️ 15.03.2022):

     git clone https://github.com/kayak/pypika
    
  • PyPi (πŸ“₯ 1.8M / month Β· πŸ“¦ 64 Β· ⏱️ 15.03.2022):

     pip install pypika
    
  • Conda (πŸ“₯ 530 Β· ⏱️ 25.10.2021):

     conda install -c conda-forge pypika
    
minio (πŸ₯ˆ32 Β· ⭐ 520) - MinIO Client SDK for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 230 Β· πŸ“¦ 2.9K Β· πŸ“‹ 460 - 0% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/minio/minio-py
    
  • PyPi (πŸ“₯ 1.4M / month Β· πŸ“¦ 330 Β· ⏱️ 11.06.2022):

     pip install minio
    
  • Conda (πŸ“₯ 77K Β· ⏱️ 11.06.2022):

     conda install -c conda-forge minio
    
tortoise-orm (πŸ₯‰31 Β· ⭐ 2.9K) - Familiar asyncio ORM for python, built with relations in mind. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 260 Β· πŸ“₯ 9 Β· πŸ“‹ 760 - 43% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/tortoise/tortoise-orm
    
  • PyPi (πŸ“₯ 74K / month Β· πŸ“¦ 52 Β· ⏱️ 20.05.2022):

     pip install tortoise-orm
    
  • Conda (πŸ“₯ 3.4K Β· ⏱️ 23.05.2022):

     conda install -c conda-forge tortoise-orm
    
influxdb (πŸ₯‰31 Β· ⭐ 1.6K Β· πŸ’€) - Python client for InfluxDB. MIT
  • GitHub (πŸ‘¨β€πŸ’» 140 Β· πŸ”€ 490 Β· πŸ“¦ 5.7K Β· πŸ“‹ 520 - 27% open Β· ⏱️ 09.09.2021):

     git clone https://github.com/influxdata/influxdb-python
    
  • PyPi (πŸ“₯ 1.6M / month Β· πŸ“¦ 1.2K Β· ⏱️ 11.11.2020):

     pip install influxdb
    
  • Conda (πŸ“₯ 60K Β· ⏱️ 12.11.2020):

     conda install -c conda-forge influxdb
    
Cassandra Driver (πŸ₯‰31 Β· ⭐ 1.3K) - DataStax Python Driver for Apache Cassandra. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 180 Β· πŸ”€ 490 Β· πŸ“¦ 4K Β· ⏱️ 17.05.2022):

     git clone https://github.com/datastax/python-driver
    
  • PyPi (πŸ“₯ 1.1M / month Β· πŸ“¦ 670 Β· ⏱️ 18.03.2021):

     pip install cassandra-driver
    
  • Conda (πŸ“₯ 110K Β· ⏱️ 13.04.2022):

     conda install -c conda-forge cassandra-driver
    
cx-Oracle (πŸ₯‰31 Β· ⭐ 820) - Python interface to Oracle Database now superseded by python-oracledb. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 17 Β· πŸ”€ 330 Β· πŸ“¦ 6.3K Β· πŸ“‹ 610 - 6% open Β· ⏱️ 08.06.2022):

     git clone https://github.com/oracle/python-cx_Oracle
    
  • PyPi (πŸ“₯ 3.1M / month Β· πŸ“¦ 250 Β· ⏱️ 04.11.2021):

     pip install cx-Oracle
    
  • Conda (πŸ“₯ 290K Β· ⏱️ 09.04.2022):

     conda install -c conda-forge cx_oracle
    
neo4j-driver (πŸ₯‰31 Β· ⭐ 720) - Neo4j Bolt driver for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 37 Β· πŸ”€ 150 Β· πŸ“‹ 200 - 3% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/neo4j/neo4j-python-driver
    
  • PyPi (πŸ“₯ 200K / month Β· πŸ“¦ 230 Β· ⏱️ 02.06.2022):

     pip install neo4j-driver
    
  • Conda (πŸ“₯ 140K Β· ⏱️ 02.06.2022):

     conda install -c conda-forge neo4j-python-driver
    
Pony (πŸ₯‰30 Β· ⭐ 3K) - Pony Object Relational Mapper. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 23 Β· πŸ”€ 210 Β· πŸ“₯ 20 Β· πŸ“¦ 2.6K Β· πŸ“‹ 590 - 45% open Β· ⏱️ 25.05.2022):

     git clone https://github.com/ponyorm/pony
    
  • PyPi (πŸ“₯ 53K / month Β· πŸ“¦ 350 Β· ⏱️ 27.01.2022):

     pip install pony
    
  • Conda (πŸ“₯ 69K Β· ⏱️ 28.01.2022):

     conda install -c conda-forge pony
    
pygsheets (πŸ₯‰30 Β· ⭐ 1.3K) - Google Sheets Python API v4. MIT
  • GitHub (πŸ‘¨β€πŸ’» 78 Β· πŸ”€ 190 Β· πŸ“¦ 1.1K Β· πŸ“‹ 370 - 11% open Β· ⏱️ 01.05.2022):

     git clone https://github.com/nithinmurali/pygsheets
    
  • PyPi (πŸ“₯ 1.2M / month Β· πŸ“¦ 77 Β· ⏱️ 05.02.2021):

     pip install pygsheets
    
py2neo (πŸ₯‰30 Β· ⭐ 1.1K) - Py2neo is a comprehensive Neo4j driver library and toolkit for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 33 Β· πŸ”€ 220 Β· πŸ“‹ 770 - 1% open Β· ⏱️ 10.12.2021):

     git clone https://github.com/py2neo-org/py2neo
    
  • PyPi (πŸ“₯ 130K / month Β· πŸ“¦ 620 Β· ⏱️ 14.10.2021):

     pip install py2neo
    
  • Conda (πŸ“₯ 45K Β· ⏱️ 14.10.2021):

     conda install -c conda-forge py2neo
    
dataset (πŸ₯‰29 Β· ⭐ 4.2K) - Easy-to-use data handling for SQL data stores with support for implicit.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 76 Β· πŸ”€ 280 Β· πŸ“¦ 2.4K Β· πŸ“‹ 270 - 4% open Β· ⏱️ 03.06.2022):

     git clone https://github.com/pudo/dataset
    
  • PyPi (πŸ“₯ 81K / month Β· πŸ“¦ 560 Β· ⏱️ 16.12.2021):

     pip install dataset
    
  • Conda (πŸ“₯ 2K Β· ⏱️ 16.12.2021):

     conda install -c conda-forge dataset
    
redis-py-cluster (πŸ₯‰29 Β· ⭐ 1.1K) - Python cluster client for the official redis cluster. Redis.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 72 Β· πŸ”€ 300 Β· πŸ“₯ 3.2K Β· πŸ“¦ 1.2K Β· πŸ“‹ 280 - 9% open Β· ⏱️ 12.03.2022):

     git clone https://github.com/grokzen/redis-py-cluster
    
  • PyPi (πŸ“₯ 3.1M / month Β· πŸ“¦ 200 Β· ⏱️ 30.05.2021):

     pip install redis-py-cluster
    
pysolr (πŸ₯‰29 Β· ⭐ 620) - Pysolr Python Solr client. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 65 Β· πŸ”€ 320 Β· πŸ“¦ 2.6K Β· πŸ“‹ 150 - 21% open Β· ⏱️ 12.04.2022):

     git clone https://github.com/django-haystack/pysolr
    
  • PyPi (πŸ“₯ 170K / month Β· πŸ“¦ 1.3K Β· ⏱️ 01.06.2022):

     pip install pysolr
    
  • Conda (πŸ“₯ 18K Β· ⏱️ 28.04.2020):

     conda install -c conda-forge pysolr
    
cloudant (πŸ₯‰27 Β· ⭐ 170) - A Python library for Cloudant and CouchDB. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 32 Β· πŸ”€ 52 Β· πŸ“¦ 1.8K Β· πŸ“‹ 250 - 0% open Β· ⏱️ 10.03.2022):

     git clone https://github.com/cloudant/python-cloudant
    
  • PyPi (πŸ“₯ 110K / month Β· πŸ“¦ 290 Β· ⏱️ 26.08.2021):

     pip install cloudant
    
  • Conda (πŸ“₯ 93K Β· ⏱️ 26.08.2021):

     conda install -c conda-forge cloudant
    
piccolos (πŸ₯‰26 Β· ⭐ 780) - A fast, user friendly ORM and query builder which supports asyncio. MIT
  • GitHub (πŸ‘¨β€πŸ’» 28 Β· πŸ”€ 45 Β· πŸ“¦ 83 Β· πŸ“‹ 190 - 26% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/piccolo-orm/piccolo
    
  • PyPi (πŸ“₯ 5.7K / month Β· πŸ“¦ 8 Β· ⏱️ 21.06.2022):

     pip install piccolo
    
umongo (πŸ₯‰26 Β· ⭐ 410) - sync/async MongoDB ODM, yes. MIT
  • GitHub (πŸ‘¨β€πŸ’» 15 Β· πŸ”€ 64 Β· πŸ“¦ 5.6K Β· πŸ“‹ 200 - 20% open Β· ⏱️ 23.12.2021):

     git clone https://github.com/Scille/umongo
    
  • PyPi (πŸ“₯ 120K / month Β· πŸ“¦ 14 Β· ⏱️ 23.12.2021):

     pip install umongo
    
  • Conda (πŸ“₯ 860 Β· ⏱️ 23.12.2021):

     conda install -c conda-forge umongo
    
sqlmodel (πŸ₯‰25 Β· ⭐ 7.6K) - SQL databases in Python, designed for simplicity, compatibility,.. MIT pydantic
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 320 Β· πŸ“‹ 300 - 74% open Β· ⏱️ 16.04.2022):

     git clone https://github.com/tiangolo/sqlmodel
    
  • PyPi (πŸ“₯ 140K / month Β· πŸ“¦ 47 Β· ⏱️ 28.12.2021):

     pip install sqlmodel
    
  • Conda (πŸ“₯ 1.9K Β· ⏱️ 28.12.2021):

     conda install -c conda-forge sqlmodel
    
gino (πŸ₯‰25 Β· ⭐ 2.4K) - GINO Is Not ORM - a Python asyncio ORM on SQLAlchemy core. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 46 Β· πŸ”€ 140 Β· πŸ“‹ 310 - 16% open Β· ⏱️ 12.02.2022):

     git clone https://github.com/python-gino/gino
    
  • PyPi (πŸ“₯ 25K / month Β· πŸ“¦ 42 Β· ⏱️ 12.02.2022):

     pip install gino
    
prisma (πŸ₯‰24 Β· ⭐ 700) - Prisma Client Python is an auto-generated and fully type-safe database.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 31 Β· πŸ“¦ 48 Β· πŸ“‹ 230 - 50% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/RobertCraigie/prisma-client-py
    
  • PyPi (πŸ“₯ 3.5K / month Β· πŸ“¦ 1 Β· ⏱️ 21.05.2022):

     pip install prisma
    
ODMantic (πŸ₯‰21 Β· ⭐ 580) - Async ODM (Object Document Mapper) for MongoDB based on python type hints. ISC
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 56 Β· πŸ“‹ 110 - 60% open Β· ⏱️ 01.06.2022):

     git clone https://github.com/art049/odmantic
    
  • PyPi (πŸ“₯ 14K / month Β· πŸ“¦ 1 Β· ⏱️ 01.06.2022):

     pip install odmantic
    
filedepot (πŸ₯‰21 Β· ⭐ 140 Β· πŸ’€) - Toolkit for storing files and attachments in web applications. MIT
  • GitHub (πŸ‘¨β€πŸ’» 18 Β· πŸ”€ 36 Β· πŸ“¦ 540 Β· πŸ“‹ 41 - 14% open Β· ⏱️ 21.09.2021):

     git clone https://github.com/amol-/depot
    
  • PyPi (πŸ“₯ 3.9K / month Β· πŸ“¦ 51 Β· ⏱️ 27.07.2020):

     pip install filedepot
    
Queries (πŸ₯‰19 Β· ⭐ 240 Β· πŸ’€) - PostgreSQL database access simplified. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 11 Β· πŸ”€ 30 Β· πŸ“¦ 110 Β· πŸ“‹ 21 - 33% open Β· ⏱️ 16.11.2021):

     git clone https://github.com/gmr/queries
    
  • PyPi (πŸ“₯ 2.8K / month Β· πŸ“¦ 27 Β· ⏱️ 16.11.2021):

     pip install queries
    
aioprometheus (πŸ₯‰19 Β· ⭐ 120) - A Prometheus Python client library for asyncio-based applications. MIT
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 15 Β· πŸ“¦ 96 Β· πŸ“‹ 23 - 21% open Β· ⏱️ 24.05.2022):

     git clone https://github.com/claws/aioprometheus
    
  • PyPi (πŸ“₯ 57K / month Β· πŸ“¦ 12 Β· ⏱️ 24.05.2022):

     pip install aioprometheus
    
psycopg3 (πŸ₯‰18 Β· ⭐ 710) - New generation PostgreSQL database adapter for the Python.. ❗️LGPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 63 Β· πŸ“‹ 170 - 13% open Β· ⏱️ 15.06.2022):

     git clone https://github.com/psycopg/psycopg
    
PugSQL (πŸ₯‰16 Β· ⭐ 510) - A HugSQL-inspired database library for Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 18 Β· πŸ“‹ 36 - 44% open Β· ⏱️ 27.05.2022):

     git clone https://github.com/mcfunley/pugsql
    
  • PyPi (πŸ“₯ 3K / month Β· πŸ“¦ 1 Β· ⏱️ 13.03.2022):

     pip install pugsql
    
Show 12 hidden projects...
  • psycopg2 (πŸ₯ˆ37 Β· ⭐ 2.6K) - PostgreSQL database adapter for the Python.. ❗️BSD-3-Clause-Attribution
  • Records (πŸ₯‰30 Β· ⭐ 6.9K Β· πŸ’€) - SQL for Humans. ISC
  • pyodbc (πŸ₯‰30 Β· ⭐ 2.4K Β· πŸ“‰) - Python ODBC bridge. ❗️MIT-0
  • google-cloud-bigtable (πŸ₯‰30 Β· ⭐ 34) - Google Cloud Bigtable API client library. Apache-2
  • HappyBase (πŸ₯‰27 Β· ⭐ 590 Β· πŸ’€) - A developer-friendly Python library to interact with Apache HBase. MIT
  • mongo-connector (πŸ₯‰26 Β· ⭐ 1.8K Β· πŸ’€) - MongoDB data stream pipeline tools by YouGov (adopted.. Apache-2
  • pyhdb (πŸ₯‰24 Β· ⭐ 300 Β· πŸ’€) - SAP HANA Connector in pure Python. Apache-2
  • PyMODM (πŸ₯‰22 Β· ⭐ 340 Β· πŸ’€) - A Pythonic, object-oriented interface for working with MongoDB. Apache-2
  • db.py (πŸ₯‰21 Β· ⭐ 1.2K Β· πŸ’€) - db.py is an easier way to interact with your databases. BSD-2
  • gsheets-db-api (πŸ₯‰19 Β· ⭐ 180 Β· πŸ’€) - A Python DB-API and SQLAlchemy dialect to Google Spreasheets. MIT
  • lazydata (πŸ₯‰16 Β· ⭐ 630 Β· πŸ’€) - Lazydata: Scalable data dependencies for Python projects. Apache-2
  • SuperSQLite (πŸ₯‰15 Β· ⭐ 700 Β· πŸ’€) - A supercharged SQLite library for Python. MIT

Data Loading & Extraction

Back to top

Libraries for loading, collecting, and extracting data from a variety of data sources and formats.

Faker (πŸ₯‡42 Β· ⭐ 14K) - Faker is a Python package that generates fake data for you. MIT
  • GitHub (πŸ‘¨β€πŸ’» 460 Β· πŸ”€ 1.6K Β· πŸ“¦ 60K Β· πŸ“‹ 580 - 7% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/joke2k/faker
    
  • PyPi (πŸ“₯ 6M / month Β· πŸ“¦ 2.9K Β· ⏱️ 22.06.2022):

     pip install Faker
    
  • Conda (πŸ“₯ 590K Β· ⏱️ 22.06.2022):

     conda install -c conda-forge faker
    
Datasets (πŸ₯‡42 Β· ⭐ 14K) - The largest hub of ready-to-use datasets for ML models with fast,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 420 Β· πŸ”€ 1.7K Β· πŸ“¦ 5.1K Β· πŸ“‹ 1.7K - 30% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/huggingface/datasets
    
  • PyPi (πŸ“₯ 970K / month Β· πŸ“¦ 210 Β· ⏱️ 15.06.2022):

     pip install datasets
    
  • Conda (πŸ“₯ 22K Β· ⏱️ 20.06.2022):

     conda install -c conda-forge datasets
    
xlwings (πŸ₯‡37 Β· ⭐ 2.3K) - xlwings is a Python library that makes it easy to call Python from.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 57 Β· πŸ”€ 420 Β· πŸ“₯ 30K Β· πŸ“¦ 23K Β· πŸ“‹ 1.5K - 14% open Β· ⏱️ 08.06.2022):

     git clone https://github.com/xlwings/xlwings
    
  • PyPi (πŸ“₯ 630K / month Β· πŸ“¦ 620 Β· ⏱️ 08.06.2022):

     pip install xlwings
    
  • Conda (πŸ“₯ 430K Β· ⏱️ 05.06.2022):

     conda install -c conda-forge xlwings
    
xmltodict (πŸ₯ˆ36 Β· ⭐ 4.8K) - Python module that makes working with XML feel like you are working.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 49 Β· πŸ”€ 460 Β· πŸ“¦ 41K Β· πŸ“‹ 220 - 27% open Β· ⏱️ 08.05.2022):

     git clone https://github.com/martinblech/xmltodict
    
  • PyPi (πŸ“₯ 17M / month Β· πŸ“¦ 5.1K Β· ⏱️ 08.05.2022):

     pip install xmltodict
    
  • Conda (πŸ“₯ 1.7M Β· ⏱️ 08.05.2022):

     conda install -c conda-forge xmltodict
    
python-magic (πŸ₯ˆ36 Β· ⭐ 2.1K) - A python wrapper for libmagic. MIT
  • GitHub (πŸ‘¨β€πŸ’» 55 Β· πŸ”€ 250 Β· πŸ“¦ 28K Β· πŸ“‹ 180 - 17% open Β· ⏱️ 20.06.2022):

     git clone https://github.com/ahupp/python-magic
    
  • PyPi (πŸ“₯ 7.7M / month Β· πŸ“¦ 3.1K Β· ⏱️ 07.06.2022):

     pip install python-magic
    
  • Conda (πŸ“₯ 150K Β· ⏱️ 10.06.2022):

     conda install -c conda-forge python-magic
    
Tablib (πŸ₯ˆ33 Β· ⭐ 4.1K) - Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c. MIT
  • GitHub (πŸ‘¨β€πŸ’» 120 Β· πŸ”€ 570 Β· πŸ“¦ 15K Β· πŸ“‹ 240 - 14% open Β· ⏱️ 09.04.2022):

     git clone https://github.com/jazzband/tablib
    
  • PyPi (πŸ“₯ 1.2M / month Β· πŸ“¦ 1.3K Β· ⏱️ 09.04.2022):

     pip install tablib
    
  • Conda (πŸ“₯ 72K Β· ⏱️ 09.04.2022):

     conda install -c conda-forge tablib
    
smart-open (πŸ₯ˆ32 Β· ⭐ 2.5K) - Utils for streaming large files (S3, HDFS, gzip, bz2...). MIT
  • GitHub (πŸ‘¨β€πŸ’» 92 Β· πŸ”€ 320 Β· πŸ“‹ 350 - 17% open Β· ⏱️ 24.04.2022):

     git clone https://github.com/RaRe-Technologies/smart_open
    
  • PyPi (πŸ“₯ 11M / month Β· πŸ“¦ 460 Β· ⏱️ 24.04.2022):

     pip install smart-open
    
  • Conda (πŸ“₯ 1.1M Β· ⏱️ 24.04.2022):

     conda install -c conda-forge smart_open
    
xlrd (πŸ₯ˆ32 Β· ⭐ 2K Β· πŸ’€) - Please use openpyxl where you can... BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 51 Β· πŸ”€ 430 Β· πŸ“¦ 98K Β· ⏱️ 21.08.2021):

     git clone https://github.com/python-excel/xlrd
    
  • PyPi (πŸ“₯ 18M / month Β· πŸ“¦ 8.1K Β· ⏱️ 11.12.2020):

     pip install xlrd
    
  • Conda (πŸ“₯ 2.5M Β· ⏱️ 09.01.2021):

     conda install -c conda-forge xlrd
    
csvkit (πŸ₯ˆ31 Β· ⭐ 5K) - A suite of utilities for converting to and working with CSV, the king of.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 100 Β· πŸ”€ 570 Β· πŸ“¦ 1.1K Β· πŸ“‹ 850 - 7% open Β· ⏱️ 11.04.2022):

     git clone https://github.com/wireservice/csvkit
    
  • PyPi (πŸ“₯ 110K / month Β· πŸ“¦ 370 Β· ⏱️ 06.03.2022):

     pip install csvkit
    
  • Conda (πŸ“₯ 64K Β· ⏱️ 20.03.2022):

     conda install -c conda-forge csvkit
    
snorkel (πŸ₯ˆ30 Β· ⭐ 5.2K) - A system for quickly generating training data with weak supervision. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 77 Β· πŸ”€ 800 Β· πŸ“₯ 930 Β· πŸ“¦ 180 Β· πŸ“‹ 980 - 3% open Β· ⏱️ 01.06.2022):

     git clone https://github.com/snorkel-team/snorkel
    
  • PyPi (πŸ“₯ 80K / month Β· πŸ“¦ 10 Β· ⏱️ 19.11.2021):

     pip install snorkel
    
  • Conda (πŸ“₯ 27K Β· ⏱️ 23.11.2021):

     conda install -c conda-forge snorkel
    
gdown (πŸ₯ˆ30 Β· ⭐ 2.1K Β· πŸ“ˆ) - Download a large file from Google Drive (curl/wget fails because of the.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 14 Β· πŸ”€ 200 Β· πŸ“¦ 8.7K Β· πŸ“‹ 110 - 11% open Β· ⏱️ 26.06.2022):

     git clone https://github.com/wkentaro/gdown
    
  • PyPi (πŸ“₯ 310K / month Β· πŸ“¦ 200 Β· ⏱️ 26.06.2022):

     pip install gdown
    
  • Conda (πŸ“₯ 67K Β· ⏱️ 26.02.2022):

     conda install -c conda-forge gdown
    
pandas-datareader (πŸ₯ˆ29 Β· ⭐ 2.4K) - Extract data from a wide range of Internet sources into a.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 85 Β· πŸ”€ 580 Β· πŸ“‹ 490 - 20% open Β· ⏱️ 16.03.2022):

     git clone https://github.com/pydata/pandas-datareader
    
  • PyPi (πŸ“₯ 300K / month Β· πŸ“¦ 790 Β· ⏱️ 13.07.2021):

     pip install pandas-datareader
    
  • Conda (πŸ“₯ 170K Β· ⏱️ 14.07.2021):

     conda install -c conda-forge pandas-datareader
    
Intake (πŸ₯ˆ29 Β· ⭐ 780) - Intake is a lightweight package for finding, investigating, loading and.. BSD-2
  • GitHub (πŸ‘¨β€πŸ’» 75 Β· πŸ”€ 120 Β· πŸ“¦ 400 Β· πŸ“‹ 310 - 27% open Β· ⏱️ 13.06.2022):

     git clone https://github.com/intake/intake
    
  • PyPi (πŸ“₯ 9.5K / month Β· πŸ“¦ 93 Β· ⏱️ 09.01.2022):

     pip install intake
    
  • Conda (πŸ“₯ 190K Β· ⏱️ 10.01.2022):

     conda install -c conda-forge intake
    
textract (πŸ₯‰28 Β· ⭐ 3.3K) - extract text from any document. no muss. no fuss. MIT
  • GitHub (πŸ‘¨β€πŸ’» 40 Β· πŸ”€ 480 Β· πŸ“‹ 210 - 40% open Β· ⏱️ 10.03.2022):

     git clone https://github.com/deanmalmgren/textract
    
  • PyPi (πŸ“₯ 120K / month Β· πŸ“¦ 120 Β· ⏱️ 10.03.2022):

     pip install textract
    
  • Conda (πŸ“₯ 15K Β· ⏱️ 10.03.2022):

     conda install -c conda-forge textract
    
SDV (πŸ₯‰28 Β· ⭐ 920) - Synthetic Data Generation for tabular, relational and time series data. MIT
  • GitHub (πŸ‘¨β€πŸ’» 41 Β· πŸ”€ 150 Β· πŸ“¦ 67 Β· πŸ“‹ 560 - 30% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/sdv-dev/SDV
    
  • PyPi (πŸ“₯ 40K / month Β· πŸ“¦ 5 Β· ⏱️ 25.05.2022):

     pip install sdv
    
  • Conda (πŸ“₯ 1.3K Β· ⏱️ 27.05.2022):

     conda install -c conda-forge sdv
    
camelot (πŸ₯‰23 Β· ⭐ 1.6K Β· πŸ’€) - A Python library to extract tabular data from PDFs. MIT
  • GitHub (πŸ‘¨β€πŸ’» 38 Β· πŸ”€ 290 Β· πŸ“‹ 230 - 60% open Β· ⏱️ 11.07.2021):

     git clone https://github.com/camelot-dev/camelot
    
  • PyPi (πŸ“₯ 6K / month Β· πŸ“¦ 9 Β· ⏱️ 15.12.2021):

     pip install camelot
    
rows (πŸ₯‰23 Β· ⭐ 800) - A common, beautiful interface to tabular data, no matter the format. ❗️LGPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 31 Β· πŸ”€ 140 Β· πŸ“₯ 38 Β· πŸ“¦ 140 Β· πŸ“‹ 310 - 52% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/turicas/rows
    
  • PyPi (πŸ“₯ 910 / month Β· πŸ“¦ 29 Β· ⏱️ 14.02.2019):

     pip install rows
    
img2dataset (πŸ₯‰23 Β· ⭐ 730) - Easily turn large sets of image urls to an image dataset. Can.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 9 Β· πŸ”€ 57 Β· πŸ“₯ 230 Β· πŸ“¦ 9 Β· πŸ“‹ 100 - 32% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/rom1504/img2dataset
    
  • PyPi (πŸ“₯ 2K / month Β· πŸ“¦ 1 Β· ⏱️ 27.06.2022):

     pip install img2dataset
    
deepdish (πŸ₯‰22 Β· ⭐ 240 Β· πŸ’€) - Flexible HDF5 saving/loading and other data science tools from the.. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 53 Β· πŸ“¦ 610 Β· πŸ“‹ 39 - 38% open Β· ⏱️ 23.09.2021):

     git clone https://github.com/uchicago-cs/deepdish
    
  • PyPi (πŸ“₯ 16K / month Β· πŸ“¦ 80 Β· ⏱️ 24.09.2021):

     pip install deepdish
    
  • Conda (πŸ“₯ 69K Β· ⏱️ 24.09.2021):

     conda install -c conda-forge deepdish
    
datatest (πŸ₯‰20 Β· ⭐ 260) - Tools for test driven data-wrangling and data validation. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 7 Β· πŸ”€ 13 Β· πŸ“¦ 71 Β· πŸ“‹ 54 - 20% open Β· ⏱️ 05.12.2021):

     git clone https://github.com/shawnbrown/datatest
    
  • PyPi (πŸ“₯ 6.5K / month Β· πŸ“¦ 3 Β· ⏱️ 04.01.2021):

     pip install datatest
    
csvs-to-sqlite (πŸ₯‰16 Β· ⭐ 700 Β· πŸ’€) - Convert CSV files into a SQLite database. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 6 Β· πŸ”€ 55 Β· πŸ“‹ 66 - 56% open Β· ⏱️ 18.11.2021):

     git clone https://github.com/simonw/csvs-to-sqlite
    
  • PyPi (πŸ“₯ 2.7K / month Β· πŸ“¦ 5 Β· ⏱️ 18.11.2021):

     pip install csvs-to-sqlite
    
Squirrel (πŸ₯‰16 Β· ⭐ 220 Β· 🐣) - A Python library that enables ML teams to share, load, and.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 7 Β· πŸ”€ 3 Β· ⏱️ 29.06.2022):

     git clone https://github.com/merantix-momentum/squirrel-core
    
  • PyPi (πŸ“₯ 1.1K / month Β· ⏱️ 29.06.2022):

     pip install squirrel-core
    
  • Conda (πŸ“¦ 1 Β· ⏱️ 24.06.2022):

     conda install -c anaconda squirrel-core
    
Show 8 hidden projects...
  • PDFMiner (πŸ₯ˆ29 Β· ⭐ 4.8K Β· πŸ’€) - Python PDF Parser (Not actively maintained). Check out pdfminer.six. MIT
  • tabulator-py (πŸ₯‰27 Β· ⭐ 220 Β· πŸ’€) - Python library for reading and writing tabular data via streams. MIT
  • messytables (πŸ₯‰24 Β· ⭐ 380 Β· πŸ’€) - Tools for parsing messy tabular data. This is now superseded by.. MIT
  • Singer (πŸ₯‰23 Β· ⭐ 1K Β· πŸ’€) - Standard for moving data between databases, web APIs, files,.. ❗️AGPL-3.0
  • pyexcel-xlsx (πŸ₯‰23 Β· ⭐ 100 Β· πŸ’€) - A wrapper library to read, manipulate and write data in xlsx.. BSD-3
  • borb (πŸ₯‰19 Β· ⭐ 2.7K) - borb is a library for reading, creating and manipulating PDF files.. ❗Unlicensed
  • excalibur (πŸ₯‰19 Β· ⭐ 1.2K Β· πŸ’€) - A web interface to extract tabular data from PDFs. MIT
  • Upgini (πŸ₯‰17 Β· ⭐ 46 Β· 🐣) - Free automated data enrichment library for machine learning searches.. BSD-3

Data Pipelines & Streaming

Back to top

Libraries for data batch- and stream-processing, workflow automation, job scheduling, and other data pipeline tasks.

Airflow (πŸ₯‡45 Β· ⭐ 27K) - Platform to programmatically author, schedule, and monitor workflows. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 2.4K Β· πŸ”€ 11K Β· πŸ“₯ 310K Β· πŸ“‹ 5.9K - 14% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/apache/airflow
    
  • PyPi (πŸ“₯ 6.9M / month Β· πŸ“¦ 480 Β· ⏱️ 04.06.2022):

     pip install apache-airflow
    
  • Conda (πŸ“₯ 650K Β· ⏱️ 16.06.2022):

     conda install -c conda-forge airflow
    
  • Docker Hub (πŸ“₯ 76M Β· ⭐ 360 Β· ⏱️ 17.06.2022):

     docker pull apache/airflow
    
Celery (πŸ₯‡45 Β· ⭐ 20K Β· πŸ“‰) - Asynchronous task queue/job queue based on distributed message passing. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 1.2K Β· πŸ”€ 4.3K Β· πŸ“¦ 72K Β· πŸ“‹ 4.8K - 11% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/celery/celery
    
  • PyPi (πŸ“₯ 6M / month Β· πŸ“¦ 15K Β· ⏱️ 29.06.2022):

     pip install celery
    
  • Conda (πŸ“₯ 870K Β· ⏱️ 29.05.2022):

     conda install -c conda-forge celery
    
Beam (πŸ₯‡41 Β· ⭐ 5.6K) - Unified programming model to define and execute data processing.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 1.3K Β· πŸ”€ 3.5K Β· πŸ“‹ 4.1K - 93% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/apache/beam
    
  • PyPi (πŸ“₯ 5.8M / month Β· πŸ“¦ 160 Β· ⏱️ 27.06.2022):

     pip install apache-beam
    
  • Conda (πŸ“₯ 16K Β· ⏱️ 27.05.2022):

     conda install -c conda-forge apache-beam-with-aws
    
luigi (πŸ₯‡38 Β· ⭐ 16K Β· πŸ“ˆ) - Luigi is a Python module that helps you build complex pipelines of.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 590 Β· πŸ”€ 2.3K Β· πŸ“¦ 1.8K Β· πŸ“‹ 970 - 10% open Β· ⏱️ 24.06.2022):

     git clone https://github.com/spotify/luigi
    
  • PyPi (πŸ“₯ 620K / month Β· πŸ“¦ 400 Β· ⏱️ 20.06.2022):

     pip install luigi
    
  • Conda (πŸ“₯ 11K Β· πŸ“¦ 2 Β· ⏱️ 02.05.2022):

     conda install -c anaconda luigi
    
Prefect (πŸ₯‡38 Β· ⭐ 9.5K) - The easiest way to automate your data. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 330 Β· πŸ”€ 930 Β· πŸ“¦ 930 Β· πŸ“‹ 2.3K - 24% open Β· ⏱️ 21.06.2022):

     git clone https://github.com/PrefectHQ/prefect
    
  • PyPi (πŸ“₯ 290K / month Β· πŸ“¦ 70 Β· ⏱️ 22.06.2022):

     pip install prefect
    
  • Conda (πŸ“₯ 280K Β· ⏱️ 22.06.2022):

     conda install -c conda-forge prefect
    
rq (πŸ₯‡38 Β· ⭐ 8.4K) - Simple job queues for Python. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 260 Β· πŸ”€ 1.3K Β· πŸ“¦ 11K Β· πŸ“‹ 960 - 19% open Β· ⏱️ 30.05.2022):

     git clone https://github.com/rq/rq
    
  • PyPi (πŸ“₯ 590K / month Β· πŸ“¦ 1.7K Β· ⏱️ 07.12.2021):

     pip install rq
    
  • Conda (πŸ“₯ 73K Β· ⏱️ 30.06.2021):

     conda install -c conda-forge rq
    
Dagster (πŸ₯‡38 Β· ⭐ 4.9K) - An orchestration platform for the development, production, and.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 220 Β· πŸ”€ 620 Β· πŸ“¦ 420 Β· πŸ“‹ 4.3K - 23% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/dagster-io/dagster
    
  • PyPi (πŸ“₯ 430K / month Β· πŸ“¦ 91 Β· ⏱️ 24.06.2022):

     pip install dagster
    
  • Conda (πŸ“₯ 560K Β· ⏱️ 25.06.2022):

     conda install -c conda-forge dagster
    
Great Expectations (πŸ₯ˆ37 Β· ⭐ 6.8K) - Always know what to expect from your data. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 300 Β· πŸ”€ 980 Β· πŸ“‹ 1.3K - 15% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/great-expectations/great_expectations
    
  • PyPi (πŸ“₯ 6M / month Β· πŸ“¦ 35 Β· ⏱️ 22.06.2022):

     pip install great_expectations
    
  • Conda (πŸ“₯ 410K Β· ⏱️ 22.06.2022):

     conda install -c conda-forge great-expectations
    
joblib (πŸ₯ˆ37 Β· ⭐ 2.8K) - Computing with Python functions. BSD-3
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 320 Β· πŸ“¦ 190K Β· πŸ“‹ 730 - 45% open Β· ⏱️ 20.05.2022):

     git clone https://github.com/joblib/joblib
    
  • PyPi (πŸ“₯ 25M / month Β· πŸ“¦ 4.9K Β· ⏱️ 07.10.2021):

     pip install joblib
    
  • Conda (πŸ“₯ 9.7M Β· ⏱️ 07.10.2021):

     conda install -c conda-forge joblib
    
Kedro (πŸ₯ˆ35 Β· ⭐ 7.3K) - A Python framework for creating reproducible, maintainable and modular.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 660 Β· πŸ“¦ 920 Β· πŸ“‹ 800 - 14% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/kedro-org/kedro
    
  • PyPi (πŸ“₯ 390K / month Β· πŸ“¦ 38 Β· ⏱️ 09.05.2022):

     pip install kedro
    
dbt (πŸ₯ˆ35 Β· ⭐ 5.1K) - dbt enables data analysts and engineers to transform their data using the.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 220 Β· πŸ”€ 920 Β· πŸ“₯ 400 Β· πŸ“¦ 540 Β· πŸ“‹ 2.9K - 11% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/dbt-labs/dbt-core
    
  • PyPi (πŸ“₯ 220K / month Β· πŸ“¦ 30 Β· ⏱️ 06.12.2021):

     pip install dbt
    
  • Conda (πŸ“₯ 200K Β· ⏱️ 09.12.2021):

     conda install -c conda-forge dbt
    
Activeloop (πŸ₯ˆ31 Β· ⭐ 4.7K) - Dataset format for AI. Build, manage, query & visualize datasets.. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 98 Β· πŸ”€ 380 Β· πŸ“‹ 380 - 14% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/activeloopai/Hub
    
  • PyPi (πŸ“₯ 4.3K / month Β· πŸ“¦ 53 Β· ⏱️ 28.06.2022):

     pip install hub
    
ploomber (πŸ₯ˆ31 Β· ⭐ 2.5K) - The fastest way to build data pipelines. Develop iteratively,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 53 Β· πŸ”€ 160 Β· πŸ“¦ 43 Β· πŸ“‹ 730 - 28% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/ploomber/ploomber
    
  • PyPi (πŸ“₯ 6.8K / month Β· πŸ“¦ 5 Β· ⏱️ 02.06.2022):

     pip install ploomber
    
  • Conda (πŸ“₯ 13K Β· ⏱️ 02.06.2022):

     conda install -c conda-forge ploomber
    
petl (πŸ₯ˆ31 Β· ⭐ 1K) - Python Extract Transform and Load Tables of Data. MIT
  • GitHub (πŸ‘¨β€πŸ’» 55 Β· πŸ”€ 180 Β· πŸ“¦ 750 Β· πŸ“‹ 440 - 17% open Β· ⏱️ 08.06.2022):

     git clone https://github.com/petl-developers/petl
    
  • PyPi (πŸ“₯ 210K / month Β· πŸ“¦ 78 Β· ⏱️ 08.06.2022):

     pip install petl
    
  • Conda (πŸ“₯ 98K Β· ⏱️ 08.06.2022):

     conda install -c conda-forge petl
    
huey (πŸ₯ˆ30 Β· ⭐ 4.1K) - a little task queue for python. MIT
  • GitHub (πŸ‘¨β€πŸ’» 66 Β· πŸ”€ 340 Β· πŸ“¦ 950 Β· ⏱️ 28.06.2022):

     git clone https://github.com/coleifer/huey
    
  • PyPi (πŸ“₯ 140K / month Β· πŸ“¦ 160 Β· ⏱️ 28.12.2021):

     pip install huey
    
  • Conda (πŸ“₯ 24K Β· ⏱️ 16.10.2019):

     conda install -c conda-forge huey
    
mleap (πŸ₯ˆ30 Β· ⭐ 1.4K) - MLeap: Deploy ML Pipelines to Production. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 75 Β· πŸ”€ 300 Β· πŸ“¦ 190 Β· πŸ“‹ 440 - 20% open Β· ⏱️ 03.05.2022):

     git clone https://github.com/combust/mleap
    
  • PyPi (πŸ“₯ 260K / month Β· πŸ“¦ 26 Β· ⏱️ 04.04.2022):

     pip install mleap
    
  • Conda (πŸ“₯ 48K Β· ⏱️ 05.04.2022):

     conda install -c conda-forge mleap
    
zenml (πŸ₯‰27 Β· ⭐ 2.1K) - ZenML : Build portable, production-ready MLOps pipelines... Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 40 Β· πŸ”€ 170 Β· πŸ“‹ 95 - 22% open Β· ⏱️ 30.06.2022):

     git clone https://github.com/zenml-io/zenml
    
  • PyPi (πŸ“₯ 1.5K / month Β· ⏱️ 28.06.2022):

     pip install zenml
    
streamparse (πŸ₯‰27 Β· ⭐ 1.5K) - Run Python in Apache Storm topologies. Pythonic API, CLI.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 42 Β· πŸ”€ 220 Β· πŸ“¦ 55 Β· πŸ“‹ 330 - 21% open Β· ⏱️ 10.01.2022):

     git clone https://github.com/Parsely/streamparse
    
  • PyPi (πŸ“₯ 5.7K / month Β· πŸ“¦ 27 Β· ⏱️ 10.01.2022):

     pip install streamparse
    
Optimus (πŸ₯‰27 Β· ⭐ 1.2K) - Agile Data Preparation Workflows madeeasy with Pandas, Dask,.. Apache-2 spark
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 210 Β· πŸ“‹ 230 - 13% open Β· ⏱️ 21.06.2022):

     git clone https://github.com/hi-primus/optimus
    
  • PyPi (πŸ“₯ 48K / month Β· ⏱️ 30.05.2019):

     pip install optimuspyspark
    
dbnd (πŸ₯‰27 Β· ⭐ 230) - DBND is an agile pipeline framework that helps data engineering teams.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 59 Β· πŸ”€ 25 Β· πŸ“¦ 27 Β· πŸ“‹ 5 - 20% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/databand-ai/dbnd
    
  • PyPi (πŸ“₯ 150K / month Β· πŸ“¦ 23 Β· ⏱️ 30.06.2022):

     pip install dbnd
    
PyFunctional (πŸ₯‰26 Β· ⭐ 2K) - Python library for creating data pipelines with chain functional.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 120 Β· πŸ“¦ 450 Β· πŸ“‹ 130 - 6% open Β· ⏱️ 04.06.2022):

     git clone https://github.com/EntilZha/PyFunctional
    
  • PyPi (πŸ“₯ 210K / month Β· πŸ“¦ 15 Β· ⏱️ 12.01.2021):

     pip install pyfunctional
    
whylogs (πŸ₯‰26 Β· ⭐ 1.6K) - Open standard for end-to-end data and ML monitoring for any scale in.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 21 Β· πŸ”€ 67 Β· πŸ“₯ 50 Β· πŸ“‹ 210 - 29% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/whylabs/whylogs
    
  • PyPi (πŸ“₯ 22K / month Β· πŸ“¦ 2 Β· ⏱️ 28.06.2022):

     pip install whylogs
    
arq (πŸ₯‰25 Β· ⭐ 1.2K) - Fast job queuing and RPC in python with asyncio and redis. MIT
  • GitHub (πŸ‘¨β€πŸ’» 39 Β· πŸ”€ 100 Β· πŸ“¦ 240 Β· πŸ“‹ 140 - 28% open Β· ⏱️ 28.03.2022):

     git clone https://github.com/samuelcolvin/arq
    
  • PyPi (πŸ“₯ 25K / month Β· πŸ“¦ 11 Β· ⏱️ 09.03.2022):

     pip install arq
    
  • Conda (πŸ“₯ 2.6K Β· ⏱️ 03.09.2021):

     conda install -c conda-forge arq
    
pdpipe (πŸ₯‰23 Β· ⭐ 670) - Easy pipelines for pandas DataFrames. MIT
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 40 Β· πŸ“¦ 41 Β· πŸ“‹ 47 - 29% open Β· ⏱️ 27.06.2022):

     git clone https://github.com/pdpipe/pdpipe
    
  • PyPi (πŸ“₯ 2K / month Β· πŸ“¦ 6 Β· ⏱️ 23.06.2022):

     pip install pdpipe
    
  • Conda (πŸ“₯ 6.2K Β· ⏱️ 24.06.2022):

     conda install -c conda-forge pdpipe
    
Pypeline (πŸ₯‰21 Β· ⭐ 1.3K) - Concurrent data pipelines in Python . MIT
  • GitHub (πŸ‘¨β€πŸ’» 13 Β· πŸ”€ 80 Β· πŸ“‹ 59 - 25% open Β· ⏱️ 23.06.2022):

     git clone https://github.com/cgarciae/pypeln
    
  • PyPi (πŸ“₯ 7.4K / month Β· πŸ“¦ 9 Β· ⏱️ 06.01.2022):

     pip install pypeln
    
  • Conda (πŸ“₯ 7.5K Β· ⏱️ 06.01.2022):

     conda install -c conda-forge pypeln
    
TaskTiger (πŸ₯‰21 Β· ⭐ 1.1K) - Python task queue using Redis. MIT
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 62 Β· πŸ“¦ 22 Β· πŸ“‹ 69 - 47% open Β· ⏱️ 25.04.2022):

     git clone https://github.com/closeio/tasktiger
    
  • PyPi (πŸ“₯ 1.4K / month Β· πŸ“¦ 10 Β· ⏱️ 02.12.2021):

     pip install tasktiger
    
BatchFlow (πŸ₯‰21 Β· ⭐ 180) - BatchFlow helps you conveniently work with random or sequential.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 30 Β· πŸ”€ 40 Β· πŸ“¦ 2 Β· πŸ“‹ 100 - 30% open Β· ⏱️ 29.06.2022):

     git clone https://github.com/analysiscenter/batchflow
    
  • PyPi (πŸ“₯ 140 / month Β· ⏱️ 20.06.2022):

     pip install batchflow
    
bodywork-core (πŸ₯‰20 Β· ⭐ 350) - ML pipeline orchestration and model deployments on.. ❗️AGPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 4 Β· πŸ”€ 17 Β· πŸ“¦ 10 Β· πŸ“‹ 60 - 5% open Β· ⏱️ 22.06.2022):

     git clone https://github.com/bodywork-ml/bodywork-core
    
  • PyPi (πŸ“₯ 380 / month Β· ⏱️ 22.06.2022):

     pip install bodywork
    
spark-deep-learning (πŸ₯‰19 Β· ⭐ 1.9K) - Deep Learning Pipelines for Apache Spark. Apache-2 spark
  • GitHub (πŸ‘¨β€πŸ’» 17 Β· πŸ”€ 460 Β· πŸ“¦ 22 Β· πŸ“‹ 100 - 74% open Β· ⏱️ 21.03.2022):

     git clone https://github.com/databricks/spark-deep-learning
    
riko (πŸ₯‰18 Β· ⭐ 1.6K) - A Python stream processing engine modeled after Yahoo! Pipes. MIT
  • GitHub (πŸ‘¨β€πŸ’» 18 Β· πŸ”€ 75 Β· πŸ“‹ 30 - 73% open Β· ⏱️ 28.12.2021):

     git clone https://github.com/nerevu/riko
    
  • PyPi (πŸ“₯ 210 / month Β· πŸ“¦ 1 Β· ⏱️ 28.12.2021):

     pip install riko
    
Databolt Flow (πŸ₯‰18 Β· ⭐ 940 Β· πŸ’€) - Python library for building highly effective data science.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 71 Β· πŸ“¦ 20 Β· πŸ“‹ 23 - 43% open Β· ⏱️ 28.09.2021):

     git clone https://github.com/d6t/d6tflow
    
  • PyPi (πŸ“₯ 180 / month Β· ⏱️ 06.10.2021):

     pip install d6tflow
    
Mara Pipelines (πŸ₯‰17 Β· ⭐ 1.9K) - A lightweight opinionated ETL framework, halfway between plain.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 17 Β· πŸ”€ 94 Β· πŸ“‹ 38 - 63% open Β· ⏱️ 19.06.2022):

     git clone https://github.com/mara/mara-pipelines
    
  • PyPi (πŸ“₯ 330 / month Β· ⏱️ 29.05.2022):

     pip install mara-pipelines
    
kale (πŸ₯‰17 Β· ⭐ 540 Β· πŸ’€) - Kubeflows superfood for Data Scientists. Apache-2 jupyter
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 110 Β· πŸ“‹ 160 - 53% open Β· ⏱️ 20.10.2021):

     git clone https://github.com/kubeflow-kale/kale
    
  • PyPi (πŸ“₯ 1.1K / month Β· ⏱️ 19.05.2021):

     pip install kubeflow-kale
    
flupy (πŸ₯‰17 Β· ⭐ 170) - Fluent data pipelines for python and your shell. MIT
  • GitHub (πŸ‘¨β€πŸ’» 6 Β· πŸ”€ 12 Β· πŸ“‹ 12 - 25% open Β· ⏱️ 17.02.2022):

     git clone https://github.com/olirice/flupy
    
  • PyPi (πŸ“₯ 69K / month Β· πŸ“¦ 1 Β· ⏱️ 15.10.2021):

     pip install flupy
    
RasgoQL (πŸ₯‰15 Β· ⭐ 260 Β· 🐣) - Write python locally, execute SQL in your data warehouse. ❗️AGPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 11 Β· πŸ“‹ 26 - 42% open Β· ⏱️ 28.06.2022):

     git clone https://github.com/rasgointelligence/RasgoQL
    
  • PyPi (πŸ“₯ 580 / month Β· ⏱️ 28.06.2022):

     pip install rasgoql
    
Show 8 hidden projects...
  • mrjob (πŸ₯ˆ31 Β· ⭐ 2.6K Β· πŸ’€) - Run MapReduce jobs on Hadoop or Amazon Web Services. Apache-2
  • faust (πŸ₯ˆ30 Β· ⭐ 6.2K Β· πŸ’€) - Python Stream Processing. BSD-3
  • bonobo (πŸ₯‰24 Β· ⭐ 1.5K Β· πŸ’€) - Extract Transform Load for Python 3.5+. Apache-2
  • dpark (πŸ₯‰22 Β·