Skip to content
Apache DistributedLog
Branch: master
Clone or download
sijie Upgrade nokogiri to version 1.8.2 (#246)
*Motivation*

Version <1.8.2 contain a security vulnerability.
Latest commit 083eddb Jul 10, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github ISSUE #144: add template for github issue and pull request Aug 15, 2017
deploy/kubernetes/gke ISSUE #197: Provide a guide for running on k8s Oct 11, 2017
distributedlog-benchmark [maven-release-plugin] prepare for next development iteration Sep 7, 2017
distributedlog-build-tools ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-common ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-core-twitter ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-core Make distributedlog compiled with latest bookkeeper version Nov 30, 2017
distributedlog-dist [maven-release-plugin] prepare for next development iteration Sep 7, 2017
distributedlog-io DLFS - A FileSystem API wrapper over dlog API Oct 30, 2017
distributedlog-protocol ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-proxy-client ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-proxy-protocol ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-proxy-server ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
distributedlog-tutorials ISSUE164: Move findbug settings files to distributedlog-build-tools Oct 23, 2017
docker Include `nc` command in distributedlog docker image Nov 30, 2017
scripts ISSUE #146: Update merge script to use bk merge script Aug 16, 2017
src/assemble Issue 141: graduation changes, remove/change incubate related things Aug 15, 2017
tests [maven-release-plugin] prepare for next development iteration Sep 7, 2017
vagrant DL-204: Bump libthrift to latest version for distributedlog-core Jun 12, 2017
website Upgrade nokogiri to version 1.8.2 (#246) Jul 10, 2018
.gitignore DL-204: Bump libthrift to latest version for distributedlog-core Jun 12, 2017
.travis.yml DL-141: Fix broken scripts in tutorials and add integration test to t… Dec 16, 2016
ChangeLog Initial Check-in for distributedlog oss May 9, 2016
LICENSE Initial Check-in for distributedlog oss May 9, 2016
NOTICE Issue 141: graduation changes, remove/change incubate related things Aug 15, 2017
README.md Update README status about distributedlog project (#245) Mar 28, 2018
Vagrantfile Clean up and fix a few shell scripts Dec 16, 2016
pom.xml Make distributedlog compiled with latest bookkeeper version Nov 30, 2017

README.md

logo

Build Status Build Status Coverage Status

Apache DistributedLog

Apache DistributedLog (DL) is a high-throughput, low-latency replicated log service, offering durability, replication and strong consistency as essentials for building reliable real-time applications.

Status

Apache DistributedLog project graduated from Incubator at July 2017. It is now a sub-project of Apache BookKeeper.

The core components of Apache DistributedLog has been merged as part of Apache BookKeeper. The development of Apache DistributedLog has been moved under BookKeeper. See BP-26: Move distributedlog library as part of bookkeeper for more details.

Features

High Performance

DL is able to provide milliseconds latency on durable writes with a large number of concurrent logs, and handle high volume reads and writes per second from thousands of clients.

Durable and Consistent

Messages are persisted on disk and replicated to store multiple copies to prevent data loss. They are guaranteed to be consistent among writers and readers in terms of strict ordering.

Efficient Fan-in and Fan-out

DL provides an efficient service layer that is optimized for running in a multi- tenant datacenter environment such as Mesos or Yarn. The service layer is able to support large scale writes (fan-in) and reads (fan-out).

Various Workloads

DL supports various workloads from latency-sensitive online transaction processing (OLTP) applications (e.g. WAL for distributed database and in-memory replicated state machines), real-time stream ingestion and computing, to analytical processing.

Multi Tenant

To support a large number of logs for multi-tenants, DL is designed for I/O isolation in real-world workloads.

Layered Architecture

DL has a modern layered architecture design, which separates the stateless service tier from the stateful storage tier. To support large scale writes (fan- in) and reads (fan-out), DL allows scaling storage independent of scaling CPU and memory.

First Steps

Next Steps

Get In Touch

Report a Bug

For filing bugs, suggesting improvements, or requesting new features, help us out by opening a jira.

Need Help?

Subscribe or mail the distributedlog-user@bookkeeper.apache.org list - Ask questions, find answers, and also help other users.

Subscribe or mail the distributedlog-dev@bookkeeper.apache.org list - Join developement discussions, propose new ideas and connect with contributors.

Join us on Slack - This is the most immediate way to connect with DistributedLog committers and contributors.

Contributing

We feel that a welcoming open community is important and welcome contributions.

Contributing Code

  1. See Developer Guide to get your local environment setup.

  2. Take a look at our open issues.

  3. Review our coding style and follow our code reviews to learn about our conventions.

  4. Make your changes according to our code review workflow.

  5. Checkout the list of project ideas to contribute more features or improvements.

Improving Website and Documentation

  1. See website/README.md on how to build the website.

  2. See docs/README.md on how to build the documentation.

About

Apache DistributedLog is an open source project of The Apache Software Foundation (ASF). The Apache DistributedLog project originated from Twitter.

You can’t perform that action at this time.