Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Historicals can't work with multiple druid.segmentCache.locations #8667

Closed
Laboltus opened this issue Oct 13, 2019 · 3 comments
Closed

Historicals can't work with multiple druid.segmentCache.locations #8667

Laboltus opened this issue Oct 13, 2019 · 3 comments
Labels

Comments

@Laboltus
Copy link

Historicals can't work with multiple druid.segmentCache.locations after upgrade from 0.12.3 to 0.16.0

Affected Version

At least 0.16.0

Description

We use from 3 to 6 volumes on historicals with such configs:
druid.segmentCache.locations=[{"path": "/storage1", "maxSize": 1360000000000},{"path": "/storage2", "maxSize": 1360000000000},{"path": "/storage3", "maxSize": 1360000000000}]

After the upgrade I see that the usage of /storage1 is growing, but all other locations do not change.

@Laboltus
Copy link
Author

I just realized that historical process reads from all segmentCache locations during startup. So the problem is only with segments saving from deep storage.

@jihoonson
Copy link
Contributor

Hi @Laboltus, this bug is fixed in #8038 which will be included in 0.17.0.

@jihoonson
Copy link
Contributor

I'm going to close this issue but please feel free to open it again if you have more issues about this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants