Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow QIR tab in playground along with qir/ls profile configuration. #1403

Merged
merged 6 commits into from
Apr 24, 2024

Conversation

idavis
Copy link
Collaborator

@idavis idavis commented Apr 18, 2024

No description provided.

@idavis idavis self-assigned this Apr 18, 2024
Copy link

Benchmark for 35e4c61

Click to view benchmark
Test Base PR %
Array append evaluation 352.4±4.36µs 336.2±2.31µs -4.60%
Array literal evaluation 193.0±2.39µs 180.7±4.24µs -6.37%
Array update evaluation 437.8±1.79µs 424.4±1.31µs -3.06%
Core + Standard library compilation 18.2±0.20ms 17.9±0.34ms -1.65%
Deutsch-Jozsa evaluation 5.1±0.04ms 5.0±0.05ms -1.96%
Large file parity evaluation 33.9±0.41ms 33.8±0.82ms -0.29%
Large input file compilation 11.8±0.14ms 11.8±0.17ms 0.00%
Large input file compilation (interpreter) 48.4±0.90ms 48.0±0.93ms -0.83%
Large nested iteration 34.9±0.26ms 33.0±0.24ms -5.44%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1502.9±53.35µs 1503.0±71.94µs +0.01%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.0±0.11ms 8.0±0.07ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1420.5±74.94µs 1413.0±54.73µs -0.53%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.5±0.16ms 21.7±0.53ms +0.93%
Teleport evaluation 82.2±3.41µs 80.2±3.53µs -2.43%

Copy link

Benchmark for d3ce5e5

Click to view benchmark
Test Base PR %
Array append evaluation 336.5±3.63µs 347.0±4.35µs +3.12%
Array literal evaluation 182.0±2.66µs 193.3±4.90µs +6.21%
Array update evaluation 423.4±4.31µs 433.4±7.22µs +2.36%
Core + Standard library compilation 17.4±0.62ms 18.3±0.33ms +5.17%
Deutsch-Jozsa evaluation 5.0±0.05ms 5.0±0.04ms 0.00%
Large file parity evaluation 33.6±0.13ms 33.6±0.26ms 0.00%
Large input file compilation 11.7±0.19ms 11.8±0.17ms +0.85%
Large input file compilation (interpreter) 48.2±0.97ms 48.3±1.43ms +0.21%
Large nested iteration 32.8±0.24ms 34.2±0.54ms +4.27%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1509.3±26.73µs 1503.9±48.13µs -0.36%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.1±0.12ms 8.1±0.12ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1415.4±28.77µs 1425.4±59.34µs +0.71%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.5±0.59ms 21.6±0.24ms +0.47%
Teleport evaluation 80.5±3.50µs 80.6±5.09µs +0.12%

@idavis idavis requested a review from swernli as a code owner April 18, 2024 21:44
Copy link

Benchmark for 2d76c90

Click to view benchmark
Test Base PR %
Array append evaluation 340.0±7.18µs 346.5±1.60µs +1.91%
Array literal evaluation 180.3±1.26µs 193.2±3.27µs +7.15%
Array update evaluation 419.8±2.39µs 432.7±1.70µs +3.07%
Core + Standard library compilation 16.6±0.23ms 17.0±0.33ms +2.41%
Deutsch-Jozsa evaluation 5.2±0.05ms 5.0±0.04ms -3.85%
Large file parity evaluation 33.6±0.15ms 33.6±0.69ms 0.00%
Large input file compilation 11.3±0.13ms 11.4±0.14ms +0.88%
Large input file compilation (interpreter) 43.7±0.91ms 44.4±1.37ms +1.60%
Large nested iteration 32.8±0.24ms 34.1±0.61ms +3.96%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1494.8±33.12µs 1499.9±32.09µs +0.34%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.09ms 7.8±0.07ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1415.3±44.08µs 1409.0±34.50µs -0.45%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.3±0.18ms 21.1±0.18ms -0.94%
Teleport evaluation 83.3±3.65µs 81.5±3.75µs -2.16%

Copy link

Benchmark for e6503d1

Click to view benchmark
Test Base PR %
Array append evaluation 341.0±5.49µs 336.6±2.58µs -1.29%
Array literal evaluation 199.4±3.55µs 180.5±4.59µs -9.48%
Array update evaluation 426.4±6.44µs 422.2±1.65µs -0.98%
Core + Standard library compilation 16.7±0.72ms 16.7±0.05ms 0.00%
Deutsch-Jozsa evaluation 5.1±0.11ms 5.1±0.05ms 0.00%
Large file parity evaluation 33.6±0.56ms 33.6±0.42ms 0.00%
Large input file compilation 11.2±0.07ms 11.2±0.14ms 0.00%
Large input file compilation (interpreter) 42.8±0.82ms 42.6±0.72ms -0.47%
Large nested iteration 33.5±0.39ms 33.0±0.35ms -1.49%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1489.9±27.70µs 1509.6±62.32µs +1.32%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.9±0.19ms 7.7±0.08ms -2.53%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1402.8±30.97µs 1408.2±34.20µs +0.38%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.2±0.16ms 21.2±0.18ms 0.00%
Teleport evaluation 82.9±4.13µs 82.6±3.78µs -0.36%

@idavis idavis marked this pull request as draft April 22, 2024 20:36
@idavis
Copy link
Collaborator Author

idavis commented Apr 22, 2024

Waiting for #1400 before being ready.

Copy link

Benchmark for 6ce45da

Click to view benchmark
Test Base PR %
Array append evaluation 336.3±2.46µs 341.9±1.67µs +1.67%
Array literal evaluation 182.8±6.97µs 199.1±4.01µs +8.92%
Array update evaluation 421.2±2.96µs 423.9±1.34µs +0.64%
Core + Standard library compilation 17.7±0.32ms 18.2±1.07ms +2.82%
Deutsch-Jozsa evaluation 5.1±0.05ms 5.0±0.04ms -1.96%
Large file parity evaluation 33.8±0.18ms 33.7±0.20ms -0.30%
Large input file compilation 11.8±0.19ms 11.9±0.38ms +0.85%
Large input file compilation (interpreter) 48.3±1.30ms 44.5±1.56ms -7.87%
Large nested iteration 33.1±0.51ms 33.9±0.53ms +2.42%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1520.6±74.71µs 1496.5±33.91µs -1.58%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.13ms 7.7±0.08ms -1.28%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1421.5±32.52µs 1411.8±31.66µs -0.68%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.5±0.18ms 21.0±0.15ms -2.33%
Teleport evaluation 82.0±4.29µs 81.0±3.92µs -1.22%

@idavis idavis marked this pull request as ready for review April 24, 2024 00:36
Copy link

Benchmark for bc8b5dd

Click to view benchmark
Test Base PR %
Array append evaluation 335.7±1.99µs 338.9±2.28µs +0.95%
Array literal evaluation 188.7±1.03µs 208.1±2.20µs +10.28%
Array update evaluation 416.4±1.11µs 421.6±5.85µs +1.25%
Core + Standard library compilation 17.7±0.65ms 17.3±0.41ms -2.26%
Deutsch-Jozsa evaluation 5.0±0.23ms 5.0±0.06ms 0.00%
Large file parity evaluation 33.5±0.12ms 33.4±0.14ms -0.30%
Large input file compilation 11.3±0.34ms 11.7±0.33ms +3.54%
Large input file compilation (interpreter) 45.1±1.46ms 47.1±1.45ms +4.43%
Large nested iteration 32.9±0.40ms 34.0±0.64ms +3.34%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1503.1±45.48µs 1517.0±51.72µs +0.92%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.19ms 7.8±0.11ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1428.9±63.76µs 1423.1±45.61µs -0.41%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.6±0.29ms 21.4±0.26ms -0.93%
Teleport evaluation 80.3±3.93µs 80.0±4.16µs -0.37%

playground/src/editor.tsx Outdated Show resolved Hide resolved
idavis and others added 2 commits April 23, 2024 18:39
Co-authored-by: Bill Ticehurst <billti@microsoft.com>
Copy link

Benchmark for b5466ff

Click to view benchmark
Test Base PR %
Array append evaluation 339.0±2.05µs 336.6±7.18µs -0.71%
Array literal evaluation 195.7±0.96µs 177.5±4.15µs -9.30%
Array update evaluation 421.8±1.39µs 416.7±2.06µs -1.21%
Core + Standard library compilation 17.0±1.15ms 16.8±0.11ms -1.18%
Deutsch-Jozsa evaluation 5.0±0.05ms 5.0±0.04ms 0.00%
Large file parity evaluation 33.6±0.19ms 33.7±0.69ms +0.30%
Large input file compilation 11.2±0.07ms 11.3±0.17ms +0.89%
Large input file compilation (interpreter) 44.1±1.15ms 44.0±1.28ms -0.23%
Large nested iteration 33.1±0.16ms 32.8±0.17ms -0.91%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1499.0±30.39µs 1501.0±27.20µs +0.13%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.2±0.14ms 7.7±0.07ms -6.10%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1419.8±59.47µs 1411.3±34.34µs -0.60%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.2±0.19ms 21.2±0.24ms 0.00%
Teleport evaluation 80.0±3.98µs 80.8±4.32µs +1.00%

@idavis idavis enabled auto-merge April 24, 2024 03:06
Copy link

Benchmark for 3634a21

Click to view benchmark
Test Base PR %
Array append evaluation 339.3±1.75µs 338.7±12.35µs -0.18%
Array literal evaluation 196.1±1.62µs 177.2±1.48µs -9.64%
Array update evaluation 421.0±1.38µs 421.0±12.97µs 0.00%
Core + Standard library compilation 17.8±0.63ms 17.4±0.68ms -2.25%
Deutsch-Jozsa evaluation 5.1±0.06ms 5.0±0.07ms -1.96%
Large file parity evaluation 33.5±0.14ms 33.5±0.32ms 0.00%
Large input file compilation 11.6±0.30ms 11.8±0.47ms +1.72%
Large input file compilation (interpreter) 47.2±2.07ms 46.2±1.53ms -2.12%
Large nested iteration 33.3±0.45ms 33.2±0.78ms -0.30%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1504.7±34.00µs 1503.5±51.56µs -0.08%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.9±0.14ms 7.9±0.14ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1438.7±83.94µs 1418.5±49.52µs -1.40%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 21.8±0.31ms 21.4±0.39ms -1.83%
Teleport evaluation 81.3±3.90µs 81.8±4.65µs +0.62%

@idavis idavis added this pull request to the merge queue Apr 24, 2024
Merged via the queue into main with commit e84cac4 Apr 24, 2024
17 checks passed
@idavis idavis deleted the iadavis/qir-playground branch April 24, 2024 03:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants