Skip to content

Add the abilty to run compilations against the AST#1368

Merged
idavis merged 5 commits into
mainfrom
iadavis/compile-ast
Apr 22, 2024
Merged

Add the abilty to run compilations against the AST#1368
idavis merged 5 commits into
mainfrom
iadavis/compile-ast

Conversation

@idavis
Copy link
Copy Markdown
Collaborator

@idavis idavis commented Apr 8, 2024

No description provided.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 8, 2024

Benchmark for c90199c

Click to view benchmark
Test Base PR %
Array append evaluation 339.6±2.71µs 343.3±20.58µs +1.09%
Array literal evaluation 181.7±3.29µs 179.8±5.39µs -1.05%
Array update evaluation 421.5±2.80µs 426.3±19.17µs +1.14%
Core + Standard library compilation 16.9±0.23ms 16.8±0.17ms -0.59%
Deutsch-Jozsa evaluation 5.0±0.04ms 5.1±0.08ms +2.00%
Large file parity evaluation 33.7±0.22ms 33.6±0.22ms -0.30%
Large input file compilation 11.4±0.59ms 11.4±0.24ms 0.00%
Large input file compilation (interpreter) 44.0±0.96ms 47.4±1.05ms +7.73%
Large nested iteration 33.0±0.18ms 33.4±1.93ms +1.21%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1497.2±32.36µs 1496.9±30.29µs -0.02%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.7±0.07ms 7.7±0.07ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1413.4±50.90µs 1409.8±31.62µs -0.25%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.3±0.18ms 21.2±1.38ms -0.47%
Teleport evaluation 79.9±3.35µs 81.0±5.18µs +1.38%

@idavis idavis force-pushed the iadavis/compile-ast branch from d4f445f to ed943cb Compare April 8, 2024 22:55
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 8, 2024

Benchmark for 50439af

Click to view benchmark
Test Base PR %
Array append evaluation 350.0±1.53µs 337.2±2.30µs -3.66%
Array literal evaluation 196.0±1.80µs 174.7±6.63µs -10.87%
Array update evaluation 434.7±8.01µs 421.6±5.66µs -3.01%
Core + Standard library compilation 16.9±0.94ms 16.8±0.24ms -0.59%
Deutsch-Jozsa evaluation 5.1±0.04ms 5.0±0.05ms -1.96%
Large file parity evaluation 33.7±0.09ms 33.4±0.09ms -0.89%
Large input file compilation 11.4±0.09ms 11.4±0.16ms 0.00%
Large input file compilation (interpreter) 44.0±1.05ms 43.4±0.95ms -1.36%
Large nested iteration 34.4±0.86ms 33.0±2.03ms -4.07%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1515.9±29.02µs 1497.5±36.27µs -1.21%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.08ms 7.7±0.20ms -1.28%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1424.5±30.97µs 1411.9±44.32µs -0.88%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.4±0.21ms 21.0±0.19ms -1.87%
Teleport evaluation 79.8±3.47µs 79.8±4.52µs 0.00%

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 8, 2024

Benchmark for 333bf9d

Click to view benchmark
Test Base PR %
Array append evaluation 350.3±7.66µs 334.8±5.86µs -4.42%
Array literal evaluation 187.1±3.38µs 175.2±3.48µs -6.36%
Array update evaluation 427.9±2.01µs 420.5±13.06µs -1.73%
Core + Standard library compilation 16.8±0.20ms 16.8±0.16ms 0.00%
Deutsch-Jozsa evaluation 5.1±0.10ms 5.0±0.04ms -1.96%
Large file parity evaluation 33.8±0.14ms 33.6±1.24ms -0.59%
Large input file compilation 11.4±0.11ms 11.3±0.28ms -0.88%
Large input file compilation (interpreter) 43.1±0.94ms 44.4±2.08ms +3.02%
Large nested iteration 33.6±1.12ms 32.6±0.36ms -2.98%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1507.3±53.36µs 1495.7±37.32µs -0.77%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.13ms 7.7±0.08ms -1.28%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1412.8±55.51µs 1411.4±31.91µs -0.10%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.2±0.17ms 21.2±0.72ms 0.00%
Teleport evaluation 80.6±6.67µs 79.8±5.06µs -0.99%

@idavis idavis force-pushed the iadavis/compile-ast branch from 654eb17 to 797ac80 Compare April 15, 2024 16:37
@github-actions
Copy link
Copy Markdown

Benchmark for e7c26e3

Click to view benchmark
Test Base PR %
Array append evaluation 345.6±2.65µs 344.4±2.90µs -0.35%
Array literal evaluation 189.7±0.85µs 189.8±1.89µs +0.05%
Array update evaluation 425.9±1.75µs 424.8±9.67µs -0.26%
Core + Standard library compilation 16.9±0.17ms 16.9±0.26ms 0.00%
Deutsch-Jozsa evaluation 5.1±0.04ms 5.2±0.05ms +1.96%
Large file parity evaluation 34.1±0.31ms 34.2±0.49ms +0.29%
Large input file compilation 11.4±0.13ms 11.4±0.20ms 0.00%
Large input file compilation (interpreter) 44.7±1.21ms 44.4±1.07ms -0.67%
Large nested iteration 33.9±0.29ms 33.7±0.21ms -0.59%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1496.0±34.96µs 1493.7±52.25µs -0.15%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.7±0.07ms 7.7±0.07ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1413.4±43.16µs 1408.0±42.45µs -0.38%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.2±0.15ms 21.2±0.44ms 0.00%
Teleport evaluation 81.9±3.91µs 82.8±3.49µs +1.10%

@github-actions
Copy link
Copy Markdown

Benchmark for 1a56504

Click to view benchmark
Test Base PR %
Array append evaluation 347.6±2.78µs 353.7±2.86µs +1.75%
Array literal evaluation 189.4±1.00µs 189.3±0.79µs -0.05%
Array update evaluation 427.3±2.55µs 433.1±1.14µs +1.36%
Core + Standard library compilation 17.4±0.37ms 20.0±0.69ms +14.94%
Deutsch-Jozsa evaluation 5.1±0.05ms 5.1±0.09ms 0.00%
Large file parity evaluation 33.8±0.11ms 33.7±0.34ms -0.30%
Large input file compilation 11.5±0.32ms 11.7±0.35ms +1.74%
Large input file compilation (interpreter) 45.1±1.73ms 46.9±2.00ms +3.99%
Large nested iteration 34.1±0.38ms 34.8±0.24ms +2.05%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1501.0±31.93µs 1520.2±105.57µs +1.28%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.9±0.18ms 8.0±0.26ms +1.27%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1400.2±35.96µs 1423.0±69.76µs +1.63%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.2±0.29ms 21.7±0.31ms +2.36%
Teleport evaluation 81.5±3.66µs 81.2±4.80µs -0.37%

@idavis idavis force-pushed the iadavis/compile-ast branch from f0324fc to 1b87a7b Compare April 18, 2024 14:55
@idavis idavis marked this pull request as ready for review April 18, 2024 16:46
@github-actions
Copy link
Copy Markdown

Benchmark for 87a0ba5

Click to view benchmark
Test Base PR %
Array append evaluation 336.5±2.31µs 338.7±19.34µs +0.65%
Array literal evaluation 173.9±1.01µs 171.3±4.80µs -1.50%
Array update evaluation 423.1±2.23µs 422.3±3.81µs -0.19%
Core + Standard library compilation 21.0±1.20ms 18.0±0.79ms -14.29%
Deutsch-Jozsa evaluation 5.0±0.04ms 5.1±0.21ms +2.00%
Large file parity evaluation 33.6±0.37ms 33.4±0.07ms -0.60%
Large input file compilation 11.6±0.24ms 11.5±0.19ms -0.86%
Large input file compilation (interpreter) 48.5±2.14ms 43.8±0.90ms -9.69%
Large nested iteration 33.1±0.62ms 33.3±1.27ms +0.60%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1548.8±132.46µs 1510.6±55.31µs -2.47%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.5±0.20ms 7.7±0.13ms -9.41%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1461.5±97.32µs 1415.5±84.25µs -3.15%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 22.4±0.26ms 21.5±0.36ms -4.02%
Teleport evaluation 80.6±4.43µs 82.1±4.19µs +1.86%

Comment thread compiler/qsc/src/interpret/tests.rs Outdated
@github-actions
Copy link
Copy Markdown

Benchmark for 2f3d4a0

Click to view benchmark
Test Base PR %
Array append evaluation 340.8±2.00µs 335.6±2.05µs -1.53%
Array literal evaluation 207.8±1.70µs 180.7±4.68µs -13.04%
Array update evaluation 426.7±1.68µs 419.7±1.44µs -1.64%
Core + Standard library compilation 16.8±0.28ms 17.1±0.54ms +1.79%
Deutsch-Jozsa evaluation 5.1±0.06ms 5.0±0.05ms -1.96%
Large file parity evaluation 33.6±0.13ms 33.6±0.22ms 0.00%
Large input file compilation 11.4±0.27ms 11.5±0.27ms +0.88%
Large input file compilation (interpreter) 44.3±1.05ms 45.6±1.41ms +2.93%
Large nested iteration 33.3±0.37ms 32.8±0.26ms -1.50%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1503.1±24.86µs 1503.6±39.50µs +0.03%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.09ms 7.8±0.09ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1421.9±63.98µs 1429.5±53.31µs +0.53%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.5±0.28ms 21.6±0.31ms +0.47%
Teleport evaluation 82.3±3.89µs 81.4±3.92µs -1.09%

Comment thread compiler/qsc/src/incremental.rs
@idavis idavis enabled auto-merge April 22, 2024 20:07
@idavis idavis added this pull request to the merge queue Apr 22, 2024
Merged via the queue into main with commit 4d891c1 Apr 22, 2024
@idavis idavis deleted the iadavis/compile-ast branch April 22, 2024 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants