Skip to content

Commit

Permalink
Update benchmark results for NET 8 (#1691)
Browse files Browse the repository at this point in the history
  • Loading branch information
@lahma
lahma committed Nov 24, 2023
1 parent 0a58535 commit 4ad19bc
Show file tree
Hide file tree
Showing 2 changed files with 73 additions and 73 deletions.
2 changes: 1 addition & 1 deletion Directory.Packages.props
View file
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
<PackageVersion Include="Test262Harness" Version="0.0.22" />
<PackageVersion Include="xunit" Version="2.6.2" />
<PackageVersion Include="xunit.runner.visualstudio" Version="2.5.4" PrivateAssets="all" />
<PackageVersion Include="YantraJS.Core" Version="1.2.203" />
<PackageVersion Include="YantraJS.Core" Version="1.2.206" />
</ItemGroup>
<ItemGroup>
<GlobalPackageReference Include="GitHubActionsTestLogger" Version="2.3.3" />
Expand Down
144 changes: 72 additions & 72 deletions Jint.Benchmark/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -14,82 +14,82 @@ Last updated 2023-11-05
* Jint main
* Jurassic 3.2.7
* NiL.JS 2.5.1674
* YantraJS.Core 1.2.203
* YantraJS.Core 1.2.206

```
BenchmarkDotNet v0.13.10, Windows 11 (10.0.23580.1000)
BenchmarkDotNet v0.13.10, Windows 11 (10.0.23590.1000)
AMD Ryzen 9 5950X, 1 CPU, 32 logical and 16 physical cores
.NET SDK 8.0.100-rc.2.23502.2
[Host] : .NET 6.0.24 (6.0.2423.51814), X64 RyuJIT AVX2
DefaultJob : .NET 6.0.24 (6.0.2423.51814), X64 RyuJIT AVX2
.NET SDK 8.0.100
[Host] : .NET 8.0.0 (8.0.23.53103), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.0 (8.0.23.53103), X64 RyuJIT AVX2
```
| Method | FileName | Mean | StdDev | Rank | Allocated |
|------------------ |--------------------- |-----------------:|----------------:|-----:|---------------:|
| NilJS | array-stress | 7,618.410 μs | 9.6261 μs | 1 | 4533.76 KB |
| YantraJS | array-stress | 7,634.348 μs | 154.1204 μs | 1 | 8080.23 KB |
| Jint | array-stress | 10,189.119 μs | 100.0517 μs | 2 | 7112.02 KB |
| Jint_ParsedScript | array-stress | 10,829.737 μs | 29.7168 μs | 3 | 7090.84 KB |
| Jurassic | array-stress | 13,478.434 μs | 134.6721 μs | 4 | 11646.94 KB |
| | | | | | |
| YantraJS | dromaeo-3d-cube | 6,903.873 μs | 29.0353 μs | 1 | 11426.85 KB |
| NilJS | dromaeo-3d-cube | 11,520.118 μs | 12.9132 μs | 2 | 4694.63 KB |
| Jint_ParsedScript | dromaeo-3d-cube | 25,403.787 μs | 76.2460 μs | 3 | 5934.53 KB |
| Jint | dromaeo-3d-cube | 26,214.383 μs | 19.9661 μs | 4 | 6191.84 KB |
| Jurassic | dromaeo-3d-cube | 49,227.408 μs | 112.1937 μs | 5 | 10670.73 KB |
| | | | | | |
| NilJS | dromaeo-core-eval | 2,688.083 μs | 7.5997 μs | 1 | 1598.78 KB |
| Jint_ParsedScript | dromaeo-core-eval | 5,404.308 μs | 11.9911 μs | 2 | 333.82 KB |
| Jint | dromaeo-core-eval | 5,745.384 μs | 10.9482 μs | 3 | 350.86 KB |
| YantraJS | dromaeo-core-eval | 10,070.410 μs | 26.0609 μs | 4 | 70662.5 KB |
| Jurassic | dromaeo-core-eval | 12,145.734 μs | 44.3013 μs | 5 | 2884.85 KB |
| | | | | | |
| Jurassic | dromaeo-object-array | 50,713.787 μs | 105.2239 μs | 1 | 25814.89 KB |
| YantraJS | dromaeo-object-array | 63,932.521 μs | 830.2901 μs | 2 | 29485.54 KB |
| Jint | dromaeo-object-array | 65,413.838 μs | 508.2830 μs | 3 | 100793.32 KB |
| Jint_ParsedScript | dromaeo-object-array | 66,591.951 μs | 140.1417 μs | 4 | 100754.12 KB |
| NilJS | dromaeo-object-array | 75,914.511 μs | 126.7804 μs | 5 | 17698.17 KB |
| | | | | | |
| Jint | droma(...)egexp [21] | 285,685.732 μs | 7,488.3067 μs | 1 | 170207.95 KB |
| Jint_ParsedScript | droma(...)egexp [21] | 289,626.408 μs | 1,896.8981 μs | 1 | 167049.52 KB |
| NilJS | droma(...)egexp [21] | 614,280.120 μs | 7,612.4833 μs | 2 | 766193.08 KB |
| Jurassic | droma(...)egexp [21] | 807,573.300 μs | 14,825.6620 μs | 3 | 825805.82 KB |
| YantraJS | droma(...)egexp [21] | 1,229,769.600 μs | 16,340.3960 μs | 4 | 1254750.68 KB |
| | | | | | |
| NilJS | droma(...)tring [21] | 426,125.000 μs | 7,684.4889 μs | 1 | 1377812.93 KB |
| Jint_ParsedScript | droma(...)tring [21] | 608,204.631 μs | 58,027.2350 μs | 2 | 1322143.68 KB |
| Jint | droma(...)tring [21] | 617,734.935 μs | 39,573.9870 μs | 2 | 1322326.65 KB |
| Jurassic | droma(...)tring [21] | 619,546.013 μs | 9,041.0940 μs | 2 | 1458038.6 KB |
| YantraJS | droma(...)tring [21] | 4,197,768.766 μs | 343,801.2590 μs | 3 | 29822200.57 KB |
| | | | | | |
| NilJS | droma(...)ase64 [21] | 49,243.377 μs | 108.4628 μs | 1 | 19604.8 KB |
| Jint_ParsedScript | droma(...)ase64 [21] | 59,677.164 μs | 177.0683 μs | 2 | 6722.79 KB |
| Jint | droma(...)ase64 [21] | 63,301.808 μs | 318.1747 μs | 3 | 6806.58 KB |
| YantraJS | droma(...)ase64 [21] | 78,283.727 μs | 991.5219 μs | 4 | 1492785.6 KB |
| Jurassic | droma(...)ase64 [21] | 83,485.030 μs | 198.9519 μs | 5 | 74319.52 KB |
| | | | | | |
| Jint_ParsedScript | evaluation | 13.500 μs | 0.0247 μs | 1 | 27.48 KB |
| Jint | evaluation | 33.419 μs | 0.0412 μs | 2 | 36.05 KB |
| NilJS | evaluation | 59.750 μs | 0.1541 μs | 3 | 23.47 KB |
| YantraJS | evaluation | 159.699 μs | 0.6218 μs | 4 | 931 KB |
| Jurassic | evaluation | 1,582.755 μs | 2.5897 μs | 5 | 420.41 KB |
| | | | | | |
| Jint_ParsedScript | linq-js | 111.636 μs | 0.2424 μs | 1 | 226.52 KB |
| YantraJS | linq-js | 461.542 μs | 0.4869 μs | 2 | 1453.9 KB |
| Jint | linq-js | 2,208.746 μs | 12.8004 μs | 3 | 1276.1 KB |
| NilJS | linq-js | 10,450.782 μs | 73.1973 μs | 4 | 4127.79 KB |
| Jurassic | linq-js | 44,781.543 μs | 394.7200 μs | 5 | 9302.34 KB |
| | | | | | |
| Jint_ParsedScript | minimal | 3.382 μs | 0.0078 μs | 1 | 12.99 KB |
| Jint | minimal | 5.334 μs | 0.0174 μs | 2 | 14.38 KB |
| NilJS | minimal | 5.891 μs | 0.0096 μs | 3 | 4.81 KB |
| YantraJS | minimal | 153.890 μs | 0.8023 μs | 4 | 925.48 KB |
| Jurassic | minimal | 294.178 μs | 0.3525 μs | 5 | 386.24 KB |
| | | | | | |
| YantraJS | stopwatch | 112,865.841 μs | 223.3235 μs | 1 | 224277.02 KB |
| Jurassic | stopwatch | 254,529.440 μs | 839.9853 μs | 2 | 156937.17 KB |
| NilJS | stopwatch | 297,948.830 μs | 1,345.9144 μs | 3 | 97363.1 KB |
| Jint_ParsedScript | stopwatch | 394,136.840 μs | 3,882.0490 μs | 4 | 53015.98 KB |
| Jint | stopwatch | 457,053.953 μs | 1,630.9870 μs | 5 | 53045.23 KB |
| Method | FileName | Mean | StdDev | Median | Rank | Allocated |
|------------------ |--------------------- |-----------------:|---------------:|-----------------:|-----:|--------------:|
| Jint_ParsedScript | array-stress | 5,743.534 μs | 7.3172 μs | 5,745.281 μs | 1 | 6994.68 KB |
| Jint | array-stress | 6,057.026 μs | 20.8293 μs | 6,053.305 μs | 2 | 7015.86 KB |
| NilJS | array-stress | 6,439.544 μs | 51.8156 μs | 6,411.337 μs | 3 | 4533.76 KB |
| YantraJS | array-stress | 7,788.618 μs | 90.7911 μs | 7,762.502 μs | 4 | 8073.6 KB |
| Jurassic | array-stress | 11,360.976 μs | 35.3027 μs | 11,350.166 μs | 5 | 11647.14 KB |
| | | | | | | |
| YantraJS | dromaeo-3d-cube | 5,193.282 μs | 14.8710 μs | 5,194.805 μs | 1 | 11412.17 KB |
| NilJS | dromaeo-3d-cube | 7,770.177 μs | 6.6077 μs | 7,769.502 μs | 2 | 4693.22 KB |
| Jint | dromaeo-3d-cube | 21,327.081 μs | 64.2045 μs | 21,320.428 μs | 3 | 6221.67 KB |
| Jint_ParsedScript | dromaeo-3d-cube | 22,275.834 μs | 48.3428 μs | 22,297.088 μs | 4 | 5964.35 KB |
| Jurassic | dromaeo-3d-cube | 53,870.773 μs | 75.4553 μs | 53,884.650 μs | 5 | 10671.29 KB |
| | | | | | | |
| NilJS | dromaeo-core-eval | 1,576.585 μs | 6.4653 μs | 1,573.083 μs | 1 | 1598.62 KB |
| Jint_ParsedScript | dromaeo-core-eval | 3,678.113 μs | 10.0864 μs | 3,675.353 μs | 2 | 332.16 KB |
| Jint | dromaeo-core-eval | 3,681.029 μs | 14.6248 μs | 3,679.859 μs | 2 | 349.21 KB |
| YantraJS | dromaeo-core-eval | 6,366.414 μs | 57.4589 μs | 6,366.488 μs | 3 | 36528.17 KB |
| Jurassic | dromaeo-core-eval | 10,197.244 μs | 41.9562 μs | 10,196.675 μs | 4 | 2883.96 KB |
| | | | | | | |
| Jint | dromaeo-object-array | 41,313.413 μs | 55.8197 μs | 41,316.171 μs | 1 | 100409.09 KB |
| Jint_ParsedScript | dromaeo-object-array | 43,203.196 μs | 411.2464 μs | 43,182.583 μs | 2 | 100368.9 KB |
| Jurassic | dromaeo-object-array | 43,495.683 μs | 252.0098 μs | 43,432.125 μs | 2 | 25812.61 KB |
| YantraJS | dromaeo-object-array | 61,354.141 μs | 482.3533 μs | 61,399.233 μs | 3 | 29478.4 KB |
| NilJS | dromaeo-object-array | 69,506.941 μs | 353.6867 μs | 69,678.650 μs | 4 | 17697.94 KB |
| | | | | | | |
| Jint_ParsedScript | droma(...)egexp [21] | 161,815.086 μs | 2,069.4489 μs | 161,312.500 μs | 1 | 170563.44 KB |
| Jint | droma(...)egexp [21] | 178,719.583 μs | 3,296.4427 μs | 178,220.700 μs | 2 | 166374.76 KB |
| NilJS | droma(...)egexp [21] | 682,594.680 μs | 12,026.0148 μs | 680,779.900 μs | 3 | 767253.88 KB |
| Jurassic | droma(...)egexp [21] | 769,271.481 μs | 13,898.9774 μs | 768,696.800 μs | 4 | 822217.41 KB |
| YantraJS | droma(...)egexp [21] | 1,222,190.085 μs | 14,714.3112 μs | 1,226,884.600 μs | 5 | 1156481.56 KB |
| | | | | | | |
| Jint | droma(...)tring [21] | 281,911.294 μs | 11,500.7817 μs | 275,857.700 μs | 1 | 1322546.26 KB |
| Jint_ParsedScript | droma(...)tring [21] | 283,360.189 μs | 13,196.6995 μs | 289,888.500 μs | 1 | 1322259.13 KB |
| NilJS | droma(...)tring [21] | 293,451.562 μs | 9,299.1813 μs | 292,627.800 μs | 2 | 1378002.01 KB |
| Jurassic | droma(...)tring [21] | 294,483.175 μs | 5,379.5117 μs | 292,301.200 μs | 2 | 1458171.62 KB |
| YantraJS | droma(...)tring [21] | 998,437.664 μs | 11,452.5169 μs | 996,547.500 μs | 3 | 15730070.8 KB |
| | | | | | | |
| NilJS | droma(...)ase64 [21] | 33,371.183 μs | 600.4889 μs | 33,236.238 μs | 1 | 19604.34 KB |
| YantraJS | droma(...)ase64 [21] | 46,639.004 μs | 560.7072 μs | 46,511.677 μs | 2 | 760382.48 KB |
| Jint_ParsedScript | droma(...)ase64 [21] | 49,046.433 μs | 159.2847 μs | 49,076.973 μs | 3 | 6720.18 KB |
| Jint | droma(...)ase64 [21] | 53,332.563 μs | 86.6296 μs | 53,336.920 μs | 4 | 6804.01 KB |
| Jurassic | droma(...)ase64 [21] | 72,535.076 μs | 149.4006 μs | 72,556.157 μs | 5 | 73295.9 KB |
| | | | | | | |
| Jint_ParsedScript | evaluation | 10.408 μs | 0.0391 μs | 10.407 μs | 1 | 27.39 KB |
| Jint | evaluation | 24.182 μs | 0.1142 μs | 24.183 μs | 2 | 35.96 KB |
| NilJS | evaluation | 37.611 μs | 0.0868 μs | 37.595 μs | 3 | 23.47 KB |
| YantraJS | evaluation | 148.389 μs | 2.2671 μs | 148.973 μs | 4 | 923.46 KB |
| Jurassic | evaluation | 1,419.913 μs | 5.1742 μs | 1,416.831 μs | 5 | 420.34 KB |
| | | | | | | |
| Jint_ParsedScript | linq-js | 86.047 μs | 0.1106 μs | 86.063 μs | 1 | 225.04 KB |
| YantraJS | linq-js | 447.064 μs | 2.5265 μs | 447.306 μs | 2 | 1443.82 KB |
| Jint | linq-js | 1,657.159 μs | 5.9514 μs | 1,655.432 μs | 3 | 1273.81 KB |
| NilJS | linq-js | 6,464.907 μs | 24.8496 μs | 6,454.286 μs | 4 | 4121.1 KB |
| Jurassic | linq-js | 34,559.331 μs | 107.6734 μs | 34,576.087 μs | 5 | 9252.69 KB |
| | | | | | | |
| Jint_ParsedScript | minimal | 2.823 μs | 0.0219 μs | 2.825 μs | 1 | 12.95 KB |
| NilJS | minimal | 3.865 μs | 0.0120 μs | 3.866 μs | 2 | 4.81 KB |
| Jint | minimal | 4.026 μs | 0.0270 μs | 4.021 μs | 3 | 14.34 KB |
| YantraJS | minimal | 141.911 μs | 2.0400 μs | 142.566 μs | 4 | 918.04 KB |
| Jurassic | minimal | 257.933 μs | 0.9659 μs | 257.808 μs | 5 | 386.21 KB |
| | | | | | | |
| YantraJS | stopwatch | 86,849.358 μs | 572.5135 μs | 86,760.983 μs | 1 | 224269.43 KB |
| NilJS | stopwatch | 178,338.578 μs | 1,337.6320 μs | 178,821.267 μs | 2 | 97360.8 KB |
| Jurassic | stopwatch | 189,956.560 μs | 315.0817 μs | 189,865.650 μs | 3 | 156935.97 KB |
| Jint | stopwatch | 279,388.597 μs | 1,913.7346 μs | 279,178.250 μs | 4 | 53039.87 KB |
| Jint_ParsedScript | stopwatch | 288,838.154 μs | 851.9774 μs | 288,601.800 μs | 5 | 53015.34 KB |

0 comments on commit 4ad19bc

Please sign in to comment.