Skip to content

Add arch info to benchmark report #37719

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 1, 2021
Merged

Conversation

shahmishal
Copy link
Member

No description provided.

@shahmishal
Copy link
Member Author

shahmishal commented Jun 1, 2021

@swift-ci Apple Silicon benchmark

@shahmishal
Copy link
Member Author

@swift-ci smoke test

@swift-ci
Copy link
Contributor

swift-ci commented Jun 1, 2021

Performance (arm64): -O

Regression OLD NEW DELTA RATIO
DictionaryOfAnyHashableStrings_insert 1288 2338 +81.5% 0.55x
Set.isDisjoint.Box25 117 199 +70.1% 0.59x (?)
Set.isDisjoint.Int50 89 131 +47.2% 0.68x (?)
DictionaryKeysContainsNative 12 15 +25.0% 0.80x (?)
DictionaryBridgeToObjC_Bridge 4 5 +25.0% 0.80x (?)
StringRemoveDupes 123 147 +19.5% 0.84x (?)
DictionarySubscriptDefaultMutationOfObjects 420 480 +14.3% 0.88x (?)
DictionaryGroup 115 131 +13.9% 0.88x (?)
Set.isStrictSubset.Box25 87 98 +12.6% 0.89x (?)
SetIsSubsetBox25 87 98 +12.6% 0.89x (?)
DictionarySwap 528 592 +12.1% 0.89x (?)
Histogram 252 280 +11.1% 0.90x (?)
DictionaryRemoveOfObjects 6000 6600 +10.0% 0.91x (?)
SetSubtractingInt50 57 62 +8.8% 0.92x (?)
DictionaryRemove 1840 2000 +8.7% 0.92x (?)
Set.isSuperset.Seq.Int50 83 90 +8.4% 0.92x (?)
Set.subtracting.Seq.Box0 488 529 +8.4% 0.92x (?)
SetSubtractingInt0 37 40 +8.1% 0.93x (?)
Set.isStrictSubset.Int50 87 94 +8.0% 0.93x (?)
DictionarySwapAt 424 456 +7.5% 0.93x (?)
 
Improvement OLD NEW DELTA RATIO
Set.filter.Int100.24k 877 811 -7.5% 1.08x
Dict.CopyKeyValue.24k 889 823 -7.4% 1.08x
Set.filter.Int100.20k 752 699 -7.0% 1.08x

Code size: -O

Performance (arm64): -Osize

Regression OLD NEW DELTA RATIO
StringEnumRawValueInitialization 260 280 +7.7% 0.93x
 
Improvement OLD NEW DELTA RATIO
CharacterPropertiesStashed 670 610 -9.0% 1.10x (?)

Code size: -Osize

Performance (arm64): -Onone

Improvement OLD NEW DELTA RATIO
ArrayAppendOptionals 440 400 -9.1% 1.10x (?)

Code size: -swiftlibs

How to read the data The tables contain differences in performance which are larger than 8% and differences in code size which are larger than 1%.

If you see any unexpected regressions, you should consider fixing the
regressions before you merge the PR.

Noise: Sometimes the performance results (not code size!) contain false
alarms. Unexpected regressions which are marked with '(?)' are probably noise.
If you see regressions which you cannot explain you can try to run the
benchmarks again. If regressions still show up, please consult with the
performance team (@eeckstein).

Hardware Overview
  Model Name: Mac mini
  Model Identifier: Macmini9,1
  Total Number of Cores: 8 (4 performance and 4 efficiency)
  Memory: 16 GB

@shahmishal
Copy link
Member Author

@swift-ci smoke test macOS

@swift-ci
Copy link
Contributor

swift-ci commented Jun 1, 2021

Performance (arm64): -O

Regression OLD NEW DELTA RATIO
DictionaryOfAnyHashableStrings_insert 1288 2282 +77.2% 0.56x
Set.isDisjoint.Box25 117 199 +70.1% 0.59x (?)
Set.isDisjoint.Int25 89 135 +51.7% 0.66x (?)
Set.isDisjoint.Int50 89 131 +47.2% 0.68x (?)
DictionaryKeysContainsNative 11 13 +18.2% 0.85x (?)
SetIsSubsetBox25 86 98 +14.0% 0.88x (?)
Set.isStrictSubset.Box25 87 98 +12.6% 0.89x (?)
DictionarySwap 528 592 +12.1% 0.89x (?)
DictionaryGroup 117 131 +12.0% 0.89x (?)
DictionarySubscriptDefaultMutation 136 152 +11.8% 0.89x (?)
DictionarySubscriptDefaultMutationOfObjects 440 480 +9.1% 0.92x (?)
CharacterPropertiesStashed 570 620 +8.8% 0.92x (?)
DictionaryRemoveOfObjects 6100 6600 +8.2% 0.92x (?)
DictionarySwapAt 424 456 +7.5% 0.93x (?)
 
Improvement OLD NEW DELTA RATIO
SortArrayInClass 69787 59949 -14.1% 1.16x (?)
StringToDataLargeUnicode 1300 1150 -11.5% 1.13x (?)
Set.filter.Int100.24k 876 809 -7.6% 1.08x
Dict.CopyKeyValue.24k 888 823 -7.3% 1.08x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 36000 33500 -6.9% 1.07x (?)

Code size: -O

Performance (arm64): -Osize

Improvement OLD NEW DELTA RATIO
DataAppendDataLargeToLarge 14200 11000 -22.5% 1.29x (?)

Code size: -Osize

Performance (arm64): -Onone

Regression OLD NEW DELTA RATIO
DropLastAnyCollectionLazy 19747 21357 +8.2% 0.92x (?)

Code size: -swiftlibs

How to read the data The tables contain differences in performance which are larger than 8% and differences in code size which are larger than 1%.

If you see any unexpected regressions, you should consider fixing the
regressions before you merge the PR.

Noise: Sometimes the performance results (not code size!) contain false
alarms. Unexpected regressions which are marked with '(?)' are probably noise.
If you see regressions which you cannot explain you can try to run the
benchmarks again. If regressions still show up, please consult with the
performance team (@eeckstein).

Hardware Overview
  Model Name: Mac mini
  Model Identifier: Macmini9,1
  Total Number of Cores: 8 (4 performance and 4 efficiency)
  Memory: 16 GB

@shahmishal shahmishal merged commit 6e1ca99 into main Jun 1, 2021
@shahmishal shahmishal deleted the apple-silicon-support-perf branch June 1, 2021 22:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants