Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use new QIR gen API for Base Profile #1400

Merged
merged 13 commits into from
Apr 24, 2024
Merged

Use new QIR gen API for Base Profile #1400

merged 13 commits into from
Apr 24, 2024

Conversation

idavis
Copy link
Collaborator

@idavis idavis commented Apr 18, 2024

No description provided.

@idavis idavis self-assigned this Apr 18, 2024
Copy link

Benchmark for 59c7f03

Click to view benchmark
Test Base PR %
Array append evaluation 350.0±4.38µs 348.5±1.74µs -0.43%
Array literal evaluation 183.5±1.75µs 195.8±3.12µs +6.70%
Array update evaluation 438.4±2.88µs 432.1±2.58µs -1.44%
Core + Standard library compilation 16.9±0.15ms 17.5±0.79ms +3.55%
Deutsch-Jozsa evaluation 5.0±0.04ms 5.2±0.12ms +4.00%
Large file parity evaluation 33.7±0.47ms 33.7±0.39ms 0.00%
Large input file compilation 11.3±0.72ms 11.3±0.18ms 0.00%
Large input file compilation (interpreter) 43.9±1.13ms 43.8±0.83ms -0.23%
Large nested iteration 33.6±0.22ms 34.4±0.43ms +2.38%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1491.8±30.64µs 1497.5±29.87µs +0.38%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.7±0.07ms 7.7±0.06ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1404.5±29.87µs 1412.1±39.81µs +0.54%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.0±0.13ms 21.1±0.53ms +0.48%
Teleport evaluation 81.6±3.82µs 82.3±4.62µs +0.86%

Copy link

Benchmark for 8f5175d

Click to view benchmark
Test Base PR %
Array append evaluation 337.1±2.46µs 338.5±4.46µs +0.42%
Array literal evaluation 180.6±1.57µs 180.8±5.04µs +0.11%
Array update evaluation 422.7±3.26µs 419.1±3.56µs -0.85%
Core + Standard library compilation 19.2±1.32ms 17.5±1.21ms -8.85%
Deutsch-Jozsa evaluation 5.1±0.07ms 5.1±0.06ms 0.00%
Large file parity evaluation 34.5±0.34ms 34.2±0.68ms -0.87%
Large input file compilation 12.6±0.93ms 13.3±1.09ms +5.56%
Large input file compilation (interpreter) 51.0±5.90ms 50.0±4.80ms -1.96%
Large nested iteration 33.0±0.31ms 33.1±0.40ms +0.30%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1531.6±117.80µs 1531.4±163.79µs -0.01%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.5±0.49ms 8.3±0.42ms -2.35%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1456.2±157.33µs 1419.0±28.84µs -2.55%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 22.2±0.88ms 21.8±0.61ms -1.80%
Teleport evaluation 82.4±4.22µs 80.8±3.81µs -1.94%

@idavis idavis mentioned this pull request Apr 19, 2024
64 tasks
Copy link

Benchmark for a8f0670

Click to view benchmark
Test Base PR %
Array append evaluation 339.2±6.42µs 336.8±2.03µs -0.71%
Array literal evaluation 180.2±1.29µs 184.5±16.48µs +2.39%
Array update evaluation 421.7±2.67µs 416.8±1.17µs -1.16%
Core + Standard library compilation 19.7±0.68ms 18.9±0.79ms -4.06%
Deutsch-Jozsa evaluation 5.1±0.06ms 5.2±0.10ms +1.96%
Large file parity evaluation 33.7±0.10ms 33.7±0.08ms 0.00%
Large input file compilation 12.8±0.55ms 12.7±0.47ms -0.78%
Large input file compilation (interpreter) 49.3±1.40ms 48.7±1.20ms -1.22%
Large nested iteration 33.1±0.31ms 32.9±0.32ms -0.60%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1558.8±156.28µs 1537.5±143.70µs -1.37%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.3±0.18ms 8.0±0.30ms -3.61%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1458.6±111.36µs 1455.8±141.36µs -0.19%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 22.7±0.54ms 22.2±0.35ms -2.20%
Teleport evaluation 83.2±6.75µs 82.5±7.27µs -0.84%

Copy link

Benchmark for 0c1cb47

Click to view benchmark
Test Base PR %
Array append evaluation 340.9±12.24µs 367.1±31.14µs +7.69%
Array literal evaluation 201.9±4.31µs 195.8±2.31µs -3.02%
Array update evaluation 424.4±5.89µs 457.3±36.22µs +7.75%
Core + Standard library compilation 17.5±0.74ms 17.9±0.65ms +2.29%
Deutsch-Jozsa evaluation 5.0±0.04ms 5.0±0.05ms 0.00%
Large file parity evaluation 33.8±0.31ms 33.5±0.47ms -0.89%
Large input file compilation 11.7±0.35ms 11.9±0.63ms +1.71%
Large input file compilation (interpreter) 49.0±4.87ms 46.3±3.95ms -5.51%
Large nested iteration 33.1±0.15ms 33.4±0.36ms +0.91%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1502.2±45.20µs 1497.6±31.85µs -0.31%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.9±0.19ms 7.8±0.12ms -1.27%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1412.6±30.36µs 1413.4±33.61µs +0.06%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.4±0.33ms 21.3±0.20ms -0.47%
Teleport evaluation 81.6±5.14µs 80.1±4.00µs -1.84%

@idavis idavis enabled auto-merge April 23, 2024 21:34
@idavis idavis disabled auto-merge April 23, 2024 21:39
@idavis idavis added this pull request to the merge queue Apr 23, 2024
Merged via the queue into main with commit da3795d Apr 24, 2024
17 checks passed
@idavis idavis deleted the iadavis/base-prof-codegen branch April 24, 2024 00:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants