airfs brings standard Python I/O to various storages (like cloud objects storage, remote file-systems, ...) by providing:
- Abstract classes of Cloud objects with the complete
io.RawIOBase
andio.BufferedIOBase
standard interfaces. - Features equivalent to the standard library (
io
,os
,os.path
,shutil
) for seamlessly managing storage objects and local files.
These functions are source agnostic and always provide the same interface for all files from storage or local file systems.
Buffered storage objects also support the following features:
- Buffered asynchronous writing of any object size.
- Buffered asynchronous preloading in reading mode.
- Write or read lock depending on memory usage limitation.
- Maximization of bandwidth using parallels connections.
For more information, refer to the documentation.
airfs is compatible with the following storage services:
- Alibaba Cloud OSS
- AWS S3 / MinIO
- GitHub (Read Only)
- Microsoft Azure Blobs Storage
- Microsoft Azure Files Storage
- OpenStack Swift Object Store
airfs can also access any publicly accessible file via HTTP/HTTPS (Read only).
"airfs" is a fork of the unmaintained "Pycosio" project by its main developer.