Question: Is there any open design doc?

[leiysky]

I'm trying to understand this project.

It will be nice if you guys can paste a link to the API doc or a architecture introduction in README,

[tisonkun]

You may refer to this draft: #687.

Several offline discussion happened to cover design details. If you're interested in any part of engula's concepts or design decisions, feel free to ask a concrete question.

BTW, I think this thread should be better to convert to a general discussion - will do it now.

[leiysky]

Thanks for the link @tisonkun

I've read the design doc https://github.com/huachaohuang/engula/blob/design/docs/design.md

Correct me if I am wrong, engula is a distributed Key-Value database, which provides automatic data sharding.

The cluster scheme is similar to CockroachDB, which will bootstrap with a meta0 range that maintains the sharding information.

AFAIK, engula aims to provide a cloud-native storage engine, but the design doc doesn't involve this part. I'd like to know how will you leverage with the cloud infrastructure?

[tisonkun]

IIRC @huachaohuang regards accessing cloud storage as a root cause of unacceptable latency, while Engula is aimed at building a low latency and high stability transaction KV storage.

However, there are several consideration about running Engula on cloud platform, which can be more similar to treat cloud platform as another vm environment. @w41ter can have more concrete inputs on this side.

[huachaohuang]

We are refactoring the architecture and not working on the "cloud" part yet.