Benchmark Dgraph against Cayley

[manishrjain]

This is the most popular page on discuss:
https://discuss.dgraph.io/t/differences-between-dgraph-and-cayley/23

This is also the most popular question on Reddit:
https://www.reddit.com/comments/4fs7qm/why_we_built_dgraph/

And again:
https://www.reddit.com/r/golang/comments/3uyj8m/announcing_alpha_release_of_open_source/

And again on HN:
https://news.ycombinator.com/item?id=11322444

So, it's about time we do a real benchmark. @ashwin95r has written some code to benchmark Dgraph for his final year thesis. So, he will be the coordinator for this project.

We can reuse that code to throw similar queries at Cayley and see how it compares.

[patilvikram]

Hi Manish I would like to pick it up this one

[ashwin95r]

Hey Vikram,
Go ahead. Let me know if you want some help!

[manishrjain]

Awesome! @ashwin95r has some benchmarking scripts that he built for his performance report. You might want to talk to him before you begin.

If you finish this, we can send some Dgraph swag your way 👍 .

[dmarcelino]

Hey, I've just recently found out Dgraph and sounds like an exciting project!

Regarding the benchmark, another GraphDB vendor created an open source graph/NoSQL benchmark some time ago and they accept contributions, here's the link: https://github.com/weinberger/nosql-tests. They've already used it to comparare ArangoDB, Neo4j, OrientDB, MongoDB and PostgreSQL: https://www.arangodb.com/performance/. Using it may save you some time and provide a wider comparison.

[manishrjain]

Interesting. Not sure if we support all of the functionality required by the benchmark, but surely worth a look to determine if we can fit in their cast.

[manishrjain]

Hey @patilvikram -- Any updates about this?

[faddat]

I think I can give you real-world stats without too much hardship. I have an app that uses cayley, and speed's real important for it. Does dgraph support a fully-in-memory mode?

[manishrjain]

Hey @faddat,

To run Dgraph fully in-memory, you'd have to run it on RAMFS or TMPFS. Put all the directories (postings, uids and mutations) under those.

[faddat]

Thanks for that! This is what I'll be working on next, once this kernel finishes compiling.

[robbert229]

Still looking for help? If nobody has had the time to work on somthing for this I could dedicate some time to make it happend...

[manishrjain]

Hey @robbert229, Yes, still looking for someone to take it up. Would be great if you could do this. We're going to do a release next week; so maybe pick that version. It's going to be v0.7.

[santhukumar]

@manishrjain did anyone pick this up? If it can be done in 2-3 weeks I can take this up.

[manishrjain]

Please do. We really need those benchmarks for an upcoming talk. Sent from Nexus 6P On Dec 25, 2016 4:15 PM, "santhukumar" <notifications@github.com> wrote: @manishrjain <https://github.com/manishrjain> did anyone pick this up? If it can be done in 2-3 weeks I can take this up. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#101 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABsyNPPJZcr6ewa0B7z3PxZtPubZh9kmks5rLfwHgaJpZM4ItIN2> .