Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky test cases in sentinel-parameter-flow-control module #1752

Open
liqiangz opened this issue Sep 22, 2020 · 1 comment
Open

Flaky test cases in sentinel-parameter-flow-control module #1752

liqiangz opened this issue Sep 22, 2020 · 1 comment
Labels
area/test Issue or PR related to test cases good first issue Good for newcomers help wanted Extra attention is needed

Comments

@liqiangz
Copy link
Contributor

Issue Description

Type: bug report

Describe what happened (or what feature you want)

Flaky unstable test in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest

[ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 4.823 s <<< FAILURE! - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest
[ERROR] testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads(com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest)  Time elapsed: 4.063 s  <<< FAILURE!
java.lang.AssertionError: expected:<6> but was:<5>
	at com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest.testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads(ParamFlowDefaultCheckerTest.java:323)

[INFO] Running com.alibaba.csp.sentinel.slots.statistic.metric.HotParameterLeapArrayTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 s - in com.alibaba.csp.sentinel.slots.statistic.metric.HotParameterLeapArrayTest
[INFO] Running com.alibaba.csp.sentinel.slots.statistic.data.ParamMapBucketTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s - in com.alibaba.csp.sentinel.slots.statistic.data.ParamMapBucketTest
[INFO] 
[INFO] Results:
[INFO] 
[ERROR] Failures: 
[ERROR]   ParamFlowDefaultCheckerTest.testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads:323 expected:<6> but was:<5>
[INFO] 
[ERROR] Tests run: 32, Failures: 1, Errors: 0, Skipped: 0

Describe what you expected to happen

The test case should not fail.

How to reproduce it (as minimally and precisely as possible)

Tell us your environment

https://app.circleci.com/pipelines/github/alibaba/Sentinel/473/workflows/ce91869c-8bf7-457e-ba0e-7c0f43dc3c1e/jobs/2520

Anything else we need to know?

@sczyh30 sczyh30 added area/test Issue or PR related to test cases good first issue Good for newcomers labels Sep 22, 2020
@sczyh30 sczyh30 added the help wanted Extra attention is needed label Feb 7, 2021
@sczyh30
Copy link
Member

sczyh30 commented Feb 7, 2021

[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest
testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads: sleep for 3 seconds
[ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.463 s <<< FAILURE! - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest
[ERROR] testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads(com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest)  Time elapsed: 4.538 s  <<< FAILURE!
java.lang.AssertionError: expected:<6> but was:<5>
	at com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowDefaultCheckerTest.testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads(ParamFlowDefaultCheckerTest.java:323)

[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowRuleManagerTest
INFO: Sentinel log output type is: file
INFO: Sentinel log charset is: utf-8
INFO: Sentinel log base directory is: /home/circleci/logs/csp/
INFO: Sentinel log name use pid is: false
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.185 s - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowRuleManagerTest
[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowRuleUtilTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 s - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowRuleUtilTest
[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowSlotTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.213 s - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowSlotTest
[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowCheckerTest
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.035 s - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowCheckerTest
[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowThrottleRateLimitingCheckerTest
com.alibaba.csp.sentinel.slots.statistic.cache.ConcurrentLinkedHashMapWrapper@14a54ef6
testSingleValueThrottleCheckQps: sleep for 3 seconds
[ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 5.359 s <<< FAILURE! - in com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowThrottleRateLimitingCheckerTest
[ERROR] testSingleValueThrottleCheckQpsMultipleThreads(com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowThrottleRateLimitingCheckerTest)  Time elapsed: 0.368 s  <<< FAILURE!
java.lang.AssertionError: expected:<2> but was:<1>
	at com.alibaba.csp.sentinel.slots.block.flow.param.ParamFlowThrottleRateLimitingCheckerTest.testSingleValueThrottleCheckQpsMultipleThreads(ParamFlowThrottleRateLimitingCheckerTest.java:127)

[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParameterMetricStorageTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 s - in com.alibaba.csp.sentinel.slots.block.flow.param.ParameterMetricStorageTest
[INFO] Running com.alibaba.csp.sentinel.slots.block.flow.param.ParameterMetricTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in com.alibaba.csp.sentinel.slots.block.flow.param.ParameterMetricTest
[INFO] 
[INFO] Results:
[INFO] 
[ERROR] Failures: 
[ERROR]   ParamFlowDefaultCheckerTest.testParamFlowDefaultCheckSingleValueCheckQpsMultipleThreads:323 expected:<6> but was:<5>
[ERROR]   ParamFlowThrottleRateLimitingCheckerTest.testSingleValueThrottleCheckQpsMultipleThreads:127 expected:<2> but was:<1>
[INFO] 
[ERROR] Tests run: 33, Failures: 2, Errors: 0, Skipped: 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/test Issue or PR related to test cases good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants