New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Etc ci performance run locally #12946
Merged
bors-servo
merged 17 commits into
servo:master
from
asajeffrey:etc-ci-performance-run-locally
Sep 6, 2016
+144
−80
Merged
Changes from 1 commit
Commits
Show all changes
17 commits
Select commit
Hold shift + click to select a range
4a77ef0
Added tp5n prefix to URLs in manifest.
asajeffrey 53c0765
Diabled missing tp6 test from manifest.
asajeffrey 1096351
Diabled never-terminating photobucket test from manifest.
asajeffrey eb18665
Removed shell option from subprocess.
asajeffrey a2a45a7
Removed extra space from --userscripts option.
asajeffrey 8e78371
Only include [PERF] lines in report.
asajeffrey 900518a
Filter reports for ones with title Error report.
asajeffrey 08d15e9
Fixed formatting of timeout argument.
asajeffrey 2857dba
Include document title in report.
asajeffrey f81e32e
Added --local option to test_all.sh.
asajeffrey 425b44f
Made test-tidy happy.
asajeffrey fb28981
Added test differ.
asajeffrey 0bd05e5
Ooops, checked in a test version.
asajeffrey 9ebd156
Updated format string for test_differ.py.
asajeffrey 646d9c8
Disabled xunlei.com perf testcase.
asajeffrey bc07d99
Making test-tidy happy.
asajeffrey 105b11f
Made local perf testing the default.
asajeffrey File filter...
Filter file types
Jump to…
Jump to file
Failed to load files.
Added --local option to test_all.sh.
- Loading branch information
commit f81e32e3341c3c867a2392bd37a8cb51adaa618d
| @@ -8,19 +8,29 @@ set -o errexit | ||
| set -o nounset | ||
| set -o pipefail | ||
|
|
||
| case "${1}" in | ||
| while (( "$#" )) | ||
| do | ||
| case "$1" in | ||
| --servo) | ||
| engine="--engine servo" | ||
| ;; | ||
| --gecko) | ||
| engine="--engine gecko" | ||
| ;; | ||
| --local) | ||
asajeffrey
Author
Member
|
||
| local=1 | ||
| ;; | ||
| *) | ||
| # This branch should never be reached with set -o nounset | ||
| echo "You didn't specify the engine to run." | ||
| echo "Unknown option $1." | ||
| exit | ||
| ;; | ||
| esac | ||
| shift | ||
| done | ||
|
|
||
| if [ -z "${engine:-}" ]; | ||
| then echo "You didn't specify the engine to run: either --servo or --gecko."; exit; | ||
| fi | ||
|
|
||
| echo "Starting the local server" | ||
| python3 -m http.server > /dev/null 2>&1 & | ||
| @@ -33,15 +43,18 @@ MANIFEST="page_load_test/tp5n/20160509.manifest" # A manifest that excludes | ||
| PERF_FILE="output/perf-$(date --iso-8601=seconds).json" | ||
|
|
||
| echo "Running tests" | ||
| python3 runner.py "${engine}" --runs 3 "${MANIFEST}" "${PERF_FILE}" | ||
|
|
||
| echo "Submitting to Perfherder" | ||
| # Perfherder SSL check will fail if time is not accurate, | ||
| # sync time before you submit | ||
| # TODO: we are using Servo's revision hash for Gecko's result to make both | ||
| # results appear on the same date. Use the correct result when Perfherder | ||
| # allows us to change the date. | ||
| python3 submit_to_perfherder.py "${engine}" "${PERF_FILE}" servo/revision.json | ||
|
|
||
| # Kill the http server | ||
| python3 runner.py ${engine} --runs 3 "${MANIFEST}" "${PERF_FILE}" | ||
|
|
||
| if [ -z "${local:-}" ]; | ||
| then | ||
| echo "Submitting to Perfherder" | ||
| # Perfherder SSL check will fail if time is not accurate, | ||
| # sync time before you submit | ||
| # TODO: we are using Servo's revision hash for Gecko's result to make both | ||
| # results appear on the same date. Use the correct result when Perfherder | ||
| # allows us to change the date. | ||
| python3 submit_to_perfherder.py "${output:-}" "${engine}" "${PERF_FILE}" servo/revision.json | ||
| fi | ||
|
|
||
| echo "Stopping the local server" | ||
| trap 'kill $(jobs -pr)' SIGINT SIGTERM EXIT | ||
ProTip!
Use n and p to navigate between commits in a pull request.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Since most people trying this out will be running it locally, would you mind inverting the flag? Let's NOT submit to perfherder by default, and trigger the
submit_to_perfherder.pyonly if we specify--upload-result.