Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added a matrix tool that allows for version-to-version comparison #38

Merged
merged 1 commit into from
Oct 22, 2017

Conversation

jeking3
Copy link
Contributor

@jeking3 jeking3 commented Oct 22, 2017

added a matrix tool that allows for version-to-version comparison of printf style format statements as well as comparison against snprintf results

The result file generated by the tool has about 60,000 variations of format strings.
One can use it to compare snprintf output from one version of a RTL to another, or to compare boost::format output from one version to another (to look for regressions), or to compare snprintf to boost::format.

The WinMerge program does a nice job comparing two output files from this tool as you will see in some of the comments below.

Once this tool is in place, it can be used to establish a a baseline before making any changes to the codebase, and then running it again and comparing the result to see if those changes resulted in a regression.

This fixes #33

@jeking3 jeking3 force-pushed the format-tests branch 2 times, most recently from b32fa2a to 5d09af9 Compare October 22, 2017 12:02
@jeking3 jeking3 self-assigned this Oct 22, 2017
@jeking3 jeking3 added the test label Oct 22, 2017
@jeking3 jeking3 added this to the v1.66.0 milestone Oct 22, 2017
@jeking3 jeking3 force-pushed the format-tests branch 4 times, most recently from 35d14bf to 12eb7b7 Compare October 22, 2017 16:02
…printf style

format statements as well as comparison against snprintf results
@jeking3
Copy link
Contributor Author

jeking3 commented Oct 22, 2017

It's pretty interesting to see how boost behaves differently on linux and windows using this tool.

image

@jeking3
Copy link
Contributor Author

jeking3 commented Oct 22, 2017

Even snprintf is different between recent standard runtimes. Surprising!
image

@jeking3 jeking3 merged commit e3246c9 into boostorg:develop Oct 22, 2017
@jeking3 jeking3 deleted the format-tests branch October 22, 2017 21:04
jeking3 pushed a commit to jeking3/format that referenced this pull request Jun 17, 2018
workaround for z/OS compiler (define BOOST_DATE_TIME_NO_LOCALE)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a test tool that will allow comparison between releases to identify regressions
1 participant