Skip to content

Conversation

@victorusu
Copy link
Contributor

The test is inconclusive. I am still making the PR in order to discuss
possible solutions.

The allocation times fluctuate from 1.90735e-06 to ~2.5 sec.
I am not sure if this is because of the OS memory load by the time of
the execution of if this is related to the small memory allocation of
the test.

@victorusu victorusu self-assigned this Nov 23, 2018
@victorusu victorusu changed the title WIP [test] Add Allocation Speed Test WIP [test] Add Allocation Speed check Nov 23, 2018
@victorusu
Copy link
Contributor Author

@toxa81, can you help me with your thoughts on the test? I am not sure why I am getting a huge fluctuation in both checks.

The worst results of huge pages are consistently 10 times smaller than the worst results of no hugepages.

But both fluctuate by 6 orders of magnitude.

The test is inconclusive. I am still making the PR in order to discuss
possible solutions.

The allocation times fluctuate from 1.90735e-06 to ~2.5 sec.
I am not sure if this is because of the OS memory load by the time of
the execution of if this is related to the small memory allocation of
the test.
Copy link
Contributor

@toxa81 toxa81 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I post a modification line in the code review to avoid potential over-optimisations. Regarding the fluctuations: I don't have an explanation, but the time 1.90735e-06 sec. seems too short. Somebody familiar with Linux architecture may give an advise.

@codecov-io
Copy link

codecov-io commented Nov 30, 2018

Codecov Report

Merging #597 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #597   +/-   ##
=======================================
  Coverage   91.52%   91.52%           
=======================================
  Files          72       72           
  Lines        9142     9142           
=======================================
  Hits         8367     8367           
  Misses        775      775

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2d43f1b...4e45cae. Read the comment docs.

Copy link
Contributor

@teojgo teojgo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm now

@teojgo teojgo changed the title WIP [test] Add Allocation Speed check [test] Add Allocation Speed check Dec 12, 2018
@vkarak vkarak changed the title [test] Add Allocation Speed check [test] Add allocation speed check Dec 17, 2018
Copy link
Contributor

@vkarak vkarak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart from my specific comments, this PR should fix also the following two problems:

  • The test must be placed under microbenchmarks
  • The reference values seem completely wrong. Please verify.
2018-12-17T16:48:58|reframe 2.16-dev0|AllocSpeedTest_2M on dom:gpu using PrgEnv-gnu|jobid=906488|perf=0.106014|ref=0.16 (l=None, u=0.1)|None
2018-12-17T16:49:01|reframe 2.16-dev0|AllocSpeedTest_2M on dom:mc using PrgEnv-gnu|jobid=906489|perf=0.189877|ref=0.5 (l=None, u=0.1)|None
  • Please use units in the reference tuple.

Theofilos Manitaras and others added 2 commits January 7, 2019 16:59
@vkarak
Copy link
Contributor

vkarak commented Jan 8, 2019

@jenkins-cscs retry kesch

@vkarak vkarak merged commit 7159fd4 into reframe-hpc:master Jan 8, 2019
@victorusu victorusu deleted the test/alloc_speed branch October 6, 2020 19:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants