Mirror of Apache crail (Incubating)
Clone or download
PepperJo [Documentation] release doc add docker check
Add step to update verions in Dockerfiles.
Remove statement about renaming, it is not needed anymore.

https://jira.apache.org/jira/projects/CRAIL/issues/CRAIL-90

Signed-off-by: Jonas Pfefferle <pepperjo@apache.org>
Latest commit f0afadc Nov 26, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
assembly [maven-release-plugin] prepare for next development iteration Nov 26, 2018
bin Scripts: add crail-env.sh Jun 20, 2018
client [maven-release-plugin] prepare for next development iteration Nov 26, 2018
conf Scripts: add crail-env.sh Jun 20, 2018
doc [Documentation] release doc add docker check Nov 26, 2018
docker Docker: fix base image url/tag and DiSNI version Oct 22, 2018
hdfs [maven-release-plugin] prepare for next development iteration Nov 26, 2018
libexec Scripts: fix log/pid file for multiple datanodes Jun 21, 2018
licenses [LICENSE] cleanup category X licenses Nov 19, 2018
namenode [maven-release-plugin] prepare for next development iteration Nov 26, 2018
rpc-darpc [maven-release-plugin] prepare for next development iteration Nov 26, 2018
rpc-narpc [maven-release-plugin] prepare for next development iteration Nov 26, 2018
rpc [maven-release-plugin] prepare for next development iteration Nov 26, 2018
storage-narpc [maven-release-plugin] prepare for next development iteration Nov 26, 2018
storage-nvmf [maven-release-plugin] prepare for next development iteration Nov 26, 2018
storage-rdma [maven-release-plugin] prepare for next development iteration Nov 26, 2018
storage [maven-release-plugin] prepare for next development iteration Nov 26, 2018
.gitignore [Git] add gitignore Oct 24, 2018
CREDITS Move IBM copyright NOTICE to CREDITS file May 15, 2018
DISCLAIMER Apache incubator disclaimer May 15, 2018
HISTORY.md [Documentation] update HISTORY Nov 26, 2018
LICENSE [LICENSE] cleanup category X licenses Nov 19, 2018
LICENSE-binary [LICENSE] cleanup category X licenses Nov 19, 2018
NOTICE Move IBM copyright NOTICE to CREDITS file May 15, 2018
README.md [Documentation] Change README to be used in binary Nov 15, 2018
checkstyle.xml Fix checkstyle xml header Oct 18, 2018
pom.xml [maven-release-plugin] prepare for next development iteration Nov 26, 2018

README.md

license Documentation Status

Apache Crail (incubating)

Apache Crail is a fast multi-tiered distributed storage system designed from ground up for high-performance network and storage hardware. It marks the backbone of the Crail I/O architecture, which is described in more detail on crail.incubator.apache.org. The unique features of Crail include:

  • Zero-copy network access from userspace
  • Integration of multiple storage tiers such DRAM, flash and disaggregated shared storage
  • Ultra-low latencies for both meta data and data operations. For instance: opening, reading and closing a small file residing in the distributed DRAM tier less than 10 microseconds, which is in the same ballpark as some of the fastest RDMA-based key/value stores
  • High-performance sequential read/write operations: For instance: read operations on large files residing in the distributed DRAM tier are typically limited only by the performance of the network
  • Very low CPU consumption: a single core sharing both application and file system client can drive sequential read/write operations at the speed of up to 100Gbps and more
  • Asynchronous API leveraging the asynchronous nature of RDMA-based networking hardware
  • Extensible plugin architecture: new storage tiers tailored to specific hardware can be added easily

Crail is implemented in Java offering a Java API which integrates directly with the Java off-heap memory. Crail is designed for performance critical temporary data within a scope of a rack or two.

Documentation

For information about how to deploy, run, test and program against Crail:

Community

Please join the Crail developer mailing list for discussions and notifications. The list is at:

dev@crail.incubator.apache.org.

Disclaimer

Apache Crail is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator PMC. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.