Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Resolver caches suffers from races and http server overload during the cold start #227

Closed
voropaevp opened this issue Feb 17, 2023 · 0 comments
Closed

Resolver caches suffers from races and http server overload during the cold start #227

voropaevp opened this issue Feb 17, 2023 · 0 comments

Comments

@voropaevp
Copy link
Contributor

voropaevp commented Feb 17, 2023 •
edited
Loading

In the rdb transformer PR we run into the following exceptions

java.net.http.HttpConnectTimeoutException: HTTP connect timed out (Utils.scala:185)

Jdk's http client debug shows large number of duplicate requests overloading the client.

  • Iglu should have a lock that prevents sending requests for the same schema if another one is currently running.
  • Output also shows evidence of lru-map races erasing values in cache, as successful schemas are being requested multiple times.
@voropaevp voropaevp changed the title Resolver caches suffer for races and http server overload during the cold start Resolver caches suffers from races and http server overload during the cold start Feb 17, 2023
istreeter added a commit that referenced this issue Feb 22, 2023
@istreeter
Resolver caches suffers from races and http server overload during th…
a84d975 
…e cold start (close #227)
istreeter added a commit that referenced this issue Feb 22, 2023
@istreeter
Resolver caches suffers from races and http server overload during th…
bf9e25f 
…e cold start (close #227)
istreeter added a commit that referenced this issue Feb 22, 2023
@istreeter
Resolver caches suffers from races and http server overload during th…
5777ec3 
…e cold start (close #227)
istreeter added a commit that referenced this issue Feb 22, 2023
@istreeter
Resolver caches suffers from races and http server overload during th…
70c3e80 
…e cold start (close #227)
istreeter added a commit that referenced this issue May 25, 2023
@istreeter
Resolver caches suffers from races and http server overload during th…
7a1e58b 
…e cold start (close #227)
@istreeter istreeter mentioned this issue Jun 6, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@voropaevp