Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 23 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,11 +62,14 @@ and data distribution capabilities.
performance or structure.

## Use Cases:
- Distributed Databases: Efficiently maintain and synchronize indexes across distributed systems.
- Version Control Systems: Enable verifiable diff, sync, and merge operations for large datasets.
- Blockchain and P2P Networks: Manage and synchronize data with verifiable integrity.
- Real-time Collaborative Editing: Support multiple users making simultaneous changes with efficient merging.
- Cloud Storage Services: Manage file versions and ensure efficient data retrieval and synchronization.
- AI Agent Memory & Long-Term Context: Serve as a structured, versioned memory store for AI agents, enabling efficient diffing, rollback, and verifiable state transitions.
- Versioned Vector Indexes for GenAI: Manage evolving embedding databases in RAG systems or vector search pipelines with Git-like tracking and time-travel queries.
- Prompt and Model Versioning: Track changes to prompts, fine-tuned adapters, or LoRA modules, supporting collaborative AI workflows with history and merge capabilities.
- Real-time Collaborative Editing: Support multiple users or agents making simultaneous changes with efficient merging and conflict resolution.
- Version Control Databases: Enable verifiable diff, sync, and merge operations for large structured datasets, similar to Git but for tabular or document-based data.
- Distributed Databases: Maintain and synchronize ordered indexes efficiently across distributed nodes with structural consistency.
- Blockchain and P2P Networks: Provide verifiable, tamper-proof data structures for syncing state and ensuring data integrity.
- Cloud Storage Services: Manage file versions and enable efficient synchronization, deduplication, and data retrieval across clients.

## Usage

Expand Down Expand Up @@ -186,7 +189,21 @@ The following features are for Prolly tree library for Version 0.1.0:
The following features are for Prolly tree library for Version 0.2.0:
- [X] Arrow block encoding and decoding
- [X] Parquet/Avro block encoding and decoding
- [ ] Advanced probabilistic tree balancing

The following features are for Prolly tree library for Version 0.2.1:
- [ ] tree diffing and merging
- [ ] show history of changes of the tree (git logs style) using `gitoxide` crate
- [ ] support build database index using Prolly Tree

The following features are for Prolly tree library for Version 0.2.2:
- [ ] version-controlled databases
- [ ] prolly tree backend for git databases using `gitoxide` crate
- [ ] support for IPFS (InterPlanetary File System) for distributed storage
- [ ] advanced probabilistic splitting algorithms
- [ ] decentralized databases
- [ ] add support for cryptographic hash functions like SHA-256, BLAKE3, etc.
- [ ] support ZK-friendly hashes such as Poseidon, MiMC, etc.
- [ ] supporting a rollup-style L2 for a decentralized database

## Contributing

Expand Down