Apache OpenDAL™: One Layer, All Storage.

OpenDAL (/ˈoʊ.pən.dæl/, pronounced "OH-puhn-dal") is an Open Data Access Layer that enables seamless interaction with diverse storage services.

OpenDAL's development is guided by its vision of One Layer, All Storage and its core principles: Open Community, Solid Foundation, Fast Access, Object Storage First, and Extensible Architecture. Read the explained vision at OpenDAL Vision.

For ANY languages

Name	Release	Docs
Rust Core
C Binding	-
Cpp Binding	-
D Binding	-	-
Dotnet Binding	-	-
Go Binding
Haskell Binding	-	-
Java Binding
Lua Binding	-	-
Node.js Binding
Ocaml Binding	-	-
PHP Binding	-	-
Python Binding
Ruby Binding	-	-
Swift Binding	-	-
Zig Binding	-	-

For ANY methods

Name	Description	Release
oay	Access data via API Gateway
oli	Access data via Command Line (alternative to s3cmd, s3cli, azcopy)
ofs	Access data via POSIX file system API (alternative to s3fs)

For ANY integrations

Name	Description	Release	Docs
dav-server-opendalfs	a dav-server-rs implementation using opendal.
object_store_opendal	an object_store implementation using opendal.
fuse3_opendal	Access data via integrations to fuse3
virtiofs_opendal	Access data via integrations to vhost-user-backend
unftp-sbe-opendal	an unftp storage backend implementation using opendal.
parquet_opendal	Provides `parquet` efficient IO utilities

For ANY services

Type	Services
Standard Storage Protocols	ftp http sftp webdav
Object Storage Services	azblob cos gcs obs oss s3 b2 openstack_swift upyun vercel_blob
File Storage Services	fs alluxio azdls azfile chainsafe compfs dbfs gridfs hdfs hdfs_native ipfs webhdfs
Consumer Cloud Storage Service	aliyun_drive gdrive onedrive dropbox icloud koofr pcloud seafile yandex_disk
Key-Value Storage Services	cacache cloudflare_kv dashmap memory etcd foundationdb persy redis rocksdb sled redb tikv atomicserver
Database Storage Services	d1 mongodb mysql postgresql sqlite surrealdb
Cache Storage Services	ghac memcached mini_moka moka vercel_artifacts
Git Based Storage Services	huggingface

Examples

The examples are available at here.

Documentation

The documentation is available at https://opendal.apache.org.

Contribute

OpenDAL is an active open-source project. We are always open to people who want to use it or contribute to it. Here are some ways to go.

Start with Contributing Guide.
Submit Issues for bug report or feature requests.
Start Discussions for questions or ideas.
Talk to community directly at Discord.
Report security vulnerabilities to private mailing list

Who is using OpenDAL?

Rust Core

apache/iceberg-rust: Native Rust implementation of Apache Iceberg, the open table format for analytic datasets.
Databend: A modern Elasticity and Performance cloud data warehouse.
deepeth/mars: The powerful analysis platform to explore and visualize data from blockchain.
GreptimeDB: An open-source, cloud-native, distributed time-series database.
mozilla/sccache: sccache is ccache with cloud storage
OctoBase: the open-source database behind AFFiNE, local-first, yet collaborative.
ParadeDB: Postgres for Search and Analytics - fast full-text search and analytics in Postgres and over cloud storage. Built as an extension.
Pants: A fast, scalable, user-friendly build system for codebases of all sizes.
QuestDB: An open-source time-series database for high throughput ingestion and fast SQL queries with operational simplicity.
RisingWave: A Distributed SQL Database for Stream Processing
Vector: A high-performance observability data pipeline.

C Binding

Milvus: A cloud-native vector database, storage for next generation AI applications

Java Binding

QuestDB: An open-source time-series database for high throughput ingestion and fast SQL queries with operational simplicity.
CrateDB: An open-source, distributed SQL database for Real-Time Analytics and Hybrid Search

Branding

The first and most prominent mentions must use the full form: Apache OpenDAL™ of the name for any individual usage (webpage, handout, slides, etc.) Depending on the context and writing style, you should use the full form of the name sufficiently often to ensure that readers clearly understand the association of both the OpenDAL project and the OpenDAL software product to the ASF as the parent organization.

For more details, see the Apache Product Name Usage Guide.

License and Trademarks

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Apache OpenDAL, OpenDAL, and Apache are either registered trademarks or trademarks of the Apache Software Foundation.

License

splitgraph/opendal

ErrorLooks like something went wrong!

About

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Languages

Error
Looks like something went wrong!

Packages