Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include calculated error in calibrator logs #2038

Merged
merged 1 commit into from
Oct 20, 2023

Conversation

kozhukalov
Copy link
Contributor

@kozhukalov kozhukalov commented Oct 4, 2023

Description

Calibration log table is extended with errors calculated
during calibration and sorted so that best
techniques are on the top of the table.

Fixes #2014


License

  • I license this contribution under the terms of the GNU GPL, version 3 and grant Unitary Fund the right to provide additional permissions as described in section 7 of the GNU GPL, version 3.

Before opening the PR, please ensure you have completed the following where appropriate.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @kozhukalov, thank you for submitting a PR to Mitiq! We will respond as soon as possible, and if you have any questions in the meantime, you can ask us on the Unitary Fund Discord.

@kozhukalov kozhukalov force-pushed the issue_2014 branch 2 times, most recently from 9564696 to 467b489 Compare October 4, 2023 03:05
@codecov
Copy link

codecov bot commented Oct 4, 2023

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (c069a38) 98.30% compared to head (c29e644) 98.30%.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #2038   +/-   ##
=======================================
  Coverage   98.30%   98.30%           
=======================================
  Files          87       87           
  Lines        4118     4125    +7     
=======================================
+ Hits         4048     4055    +7     
  Misses         70       70           
Files Coverage Δ
mitiq/calibration/calibrator.py 98.61% <100.00%> (+0.07%) ⬆️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@natestemen natestemen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Really nice work Vladimir! Thanks for adding this!

I think we should add the errors by default as part of the table instead of adding the additional log_errors option. IMO if someone is asking for logs, lets provide everything!

@kozhukalov
Copy link
Contributor Author

Ok, I'll make it default.

The only concern here is backward compatibility. Some people probably try to parse the performance log with their automation tools and we can break their pipelines. However I am new in Mitiq. Not sure how important it is.

@kozhukalov kozhukalov force-pushed the issue_2014 branch 2 times, most recently from 31f798c to e44cbea Compare October 4, 2023 23:11
@kozhukalov kozhukalov marked this pull request as ready for review October 5, 2023 00:08
@kozhukalov kozhukalov force-pushed the issue_2014 branch 2 times, most recently from 3cafa4a to 617a3aa Compare October 6, 2023 17:40
@kozhukalov
Copy link
Contributor Author

I am not sure what is wrong with the docs/readthedocs.org:mitiq check. It says Read the Docs build failed! but the build looks successful. @natestemen can you please help me understand what I should fix to make it green?

@purva-thakre
Copy link
Collaborator

@kozhukalov This is a bug in RTD. When there are multiple PRs running checks at the same time, RTD fails to build the documentation in all of them.

I do not know a way to re-trigger this build besides making a dummy commit.

@kozhukalov
Copy link
Contributor Author

@purva-thakre The issue is that even if this RTD job is green it the becomes red later when another PR runs RTD job. So I think it should not be voting.

Calibration log table is extended with errors calculated
during calibration and sorted so that best
techniques are on the top of the table.

Fixes unitaryfund#2014
@purva-thakre
Copy link
Collaborator

purva-thakre commented Oct 9, 2023

@kozhukalov Yes, I have noticed that the green check becomes red later. Possibly some bug in RTD.

Don't worry too much about the RTD build failure as long as you are not making changes to the documentation.

Copy link
Member

@natestemen natestemen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work with this! Thanks for the nice simple upgrade. :shipit:

@natestemen natestemen merged commit d0b14a5 into unitaryfund:master Oct 20, 2023
19 of 20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Include calculated error in calibrator logs
3 participants