Python-Blosc2

A fast & compressed ndarray library with a flexible compute engine

Author:	The Blosc development team
Contact:	blosc@blosc.org
Github:	https://github.com/Blosc/python-blosc2
Actions:
PyPi:
NumFOCUS:
Code of Conduct:

What is Python-Blosc2?

Python-Blosc2 is a high-performance compressed ndarray library with a flexible compute engine, using C-Blosc2 as its compression backend. It allows complex calculations on compressed data, whether stored in memory, on disk, or over the network (e.g., via Caterva2). It uses the C-Blosc2 simple and open format for storing compressed data.

More info: https://www.blosc.org/python-blosc2/getting_started/overview.html

Installing

Binary packages are available for major OSes (Win, Mac, Linux) and platforms. Install from PyPi using pip:

pip install blosc2 --upgrade

Conda users can install from conda-forge:

conda install -c conda-forge python-blosc2

Documentation

The documentation is available here:

https://blosc.org/python-blosc2/python-blosc2.html

You can find examples at:

https://github.com/Blosc/python-blosc2/tree/main/examples

A tutorial from PyData Global 2024 is available at:

https://github.com/Blosc/Python-Blosc2-3.0-tutorial

It contains Jupyter notebooks explaining the main features of Python-Blosc2.

License

This software is licensed under a 3-Clause BSD license. A copy of the python-blosc2 license can be found in LICENSE.txt.

Discussion forum

Discussion about this package is welcome at:

https://github.com/Blosc/python-blosc2/discussions

Social feeds

Stay informed about the latest developments by following us in Mastodon, Bluesky or LinkedIn.

Thanks

Blosc2 is supported by the NumFOCUS foundation, the LEAPS-INNOV project and ironArray SLU, among many other donors. This allowed the following people have contributed in an important way to the core development of the Blosc2 library:

• Francesc Alted
• Marta Iborra
• Aleix Alcacer
• Oscar Guiñón
• Juan David Ibáñez
• Ivan Vilata i Balaguer
• Oumaima Ech.Chdig

In addition, other people have participated to the project in different aspects:

• Jan Sellner, contributed the mmap support for NDArray/SChunk objects.
• Dimitri Papadopoulos, contributed a large bunch of improvements to the in many aspects of the project. His attention to detail is remarkable.
• And many others that have contributed with bug reports, suggestions and improvements.

Citing Blosc

You can cite our work on the various libraries under the Blosc umbrella as follows:

@ONLINE{blosc,
  author = {{Blosc Development Team}},
  title = "{A fast, compressed and persistent data store library}",
  year = {2009-2025},
  note = {https://blosc.org}
}

Donate

If you find Blosc useful and want to support its development, please consider making a donation via the NumFOCUS organization, which is a non-profit that supports many open-source projects. Thank you!

Compress Better, Compute Bigger