Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-9852: Change the max duration that calls to the buffer pool can block from 2000ms to 10ms #8464

Merged
merged 1 commit into from
Apr 23, 2020

Conversation

soenkeliebau
Copy link
Contributor

This is to reduce overall test runtime, as this is wallclock time.

Adjusted one assert condition on a testcase as the success was dependant on thread runtimes and the much lower tolerances due to the reduced time broke this test.

Ran a couple thousand iterations of the test class on my machine without failed test cases.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

… block from 2000ms to 10ms to reduce overall test runtime, as this is wallclock time.

Adjusted one assert condition on a testcase as the success was dependant on thread runtimes and the much lower tolerances due to the reduced time broke this test.
@soenkeliebau
Copy link
Contributor Author

retest this please

@ijuma
Copy link
Contributor

ijuma commented Apr 18, 2020

retest this please. What impact did this have on test running time?

@soenkeliebau
Copy link
Contributor Author

There is three tests in this test class that block until that timeout has been reached, for those, the block time drops from 2s to 10ms. The rest of the tests is not much impacted in a regular run.
If something goes wrong additional cases might block for that time (or more) I guess..

I dug out the results from my test runs when I created the PR. Each test ran about 10 times, duration is in milliseconds.
image

@soenkeliebau
Copy link
Contributor Author

retest this please

@ijuma
Copy link
Contributor

ijuma commented Apr 23, 2020

Unrelated failed flaky test:

kafka.api.ConsumerBounceTest.testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

Copy link
Contributor

@ijuma ijuma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ijuma ijuma merged commit 0397740 into apache:trunk Apr 23, 2020
ijuma added a commit to ijuma/kafka that referenced this pull request Apr 29, 2020
…t-for-generated-requests

* apache-github/trunk: (366 commits)
  MINOR: Improve producer test BufferPoolTest#testCloseNotifyWaiters. (apache#7982)
  MINOR: document how to escape json parameters to ducktape tests (apache#8546)
  KAFKA-9885; Evict last members of a group when the maximum allowed is reached (apache#8525)
  KAFKA-9866: Avoid election for topics where preferred leader is not in ISR (apache#8524)
  KAFKA-9839; Broker should accept control requests with newer broker epoch (apache#8509)
  KAKFA-9612: Add an option to kafka-configs.sh to add configs from a prop file (KIP-574)
  MINOR: Partition is under reassignment when adding and removing (apache#8364)
  MINOR: reduce allocations in log start and recovery checkpoints (apache#8467)
  MINOR: Remove unused foreign-key join class (apache#8547)
  HOTFIX: Fix broker bounce system tests (apache#8532)
  KAFKA-9704: Fix the issue z/OS won't let us resize file when mmap. (apache#8224)
  KAFKA-8639: Replace AddPartitionsToTxn with Automated Protocol  (apache#8326)
  MINOR: equals() should compare all fields for generated classes (apache#8539)
  KAFKA-9844; Fix race condition which allows more than maximum number of members(apache#8454)
  KAFKA-9823: Remember the sent generation for the coordinator request (apache#8445)
  KAFKA-9883: Add better error message when REST API forwards a request and leader is not known (apache#8536)
  KAFKA-9907: Switch default build to Scala 2.13 (apache#8537)
  MINOR: Some html fixes in Streams DSL documentation (apache#8503)
  MINOR: Enable fatal warnings with scala 2.13 (apache#8429)
  KAFKA-9852: Change the max duration that calls to the buffer pool can block from 2000ms to 10ms to reduce overall test runtime (apache#8464)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants