Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Janusgraph Filter queries highly inefficient at medium to large scale #891

Closed
etiennedi opened this issue Jun 5, 2019 · 0 comments
Closed
Labels
Architecture elasticsearch janusgraph performance Urgent / Blocker Highest priority of an issue. Use sparingly, for major bugs or issues blocking many users

Comments

@etiennedi
Copy link
Member

Reproduce

  1. Import 50k to 100k things/actions of different classes
  2. Perform simple GQL queries for those things/action classes

Expected behavior

At the above scale all queries should be fast, even list queries which aren't the strength of the NoSQL based setup

Actual Behavior

Depending on which class is used, queries are very slow, for example "Get 100 of Thing Foo" takes around 20 seconds

Analysis

Setting Janusgraph to debug mode, we can see that the queries to the index backend (ES) aren't restrictive at all:
image
They should be much more narrowed down, instead it seems janus is iterating over every single thing out there.

@etiennedi etiennedi added Architecture elasticsearch janusgraph performance Urgent / Blocker Highest priority of an issue. Use sparingly, for major bugs or issues blocking many users labels Jun 5, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Architecture elasticsearch janusgraph performance Urgent / Blocker Highest priority of an issue. Use sparingly, for major bugs or issues blocking many users
Projects
None yet
Development

No branches or pull requests

1 participant