Skip to content

v1.5.0

Latest
Compare
Choose a tag to compare
@arp242 arp242 released this 31 May 16:51
· 3 commits to master since this release
f0b5cdd

Release v1.5.0

Changes

  • This release requires Go 1.19 to build.

  • Add quite a lot of new test.

  • Only "pass" an invalid test if the decoder exits with exactly exit 1, rather than any exit >0. This catches segfaults, panics, and other crashes which shouldn't be considered "passing".

  • Tests are now run in parallel, defaulting to the number of available cores. Use the -parallel flag to set the number of cores to use.

  • Few small improvements to toml-test runner output.

New features

  • The -copy flag copies all tests to the given directory (taking the -toml flag in to account). This is much easier than manually copying the files.

  • Add -errors flag to test expected error messages for invalid tests. See -help for details.

  • Add -print-skip, to print out a small bash/zsh script with -skip flags for tests that failed. Useful to get a list of "known failures" for CI integrations and such.

  • Add -timeout flag to set the maximum execution time per test, to catch infinite loops and/or pathological cases. This defaults to 1s, but can probably be set (much) lower for most implementations.

  • Add -int-as-float flag, for implementations that treat all numbers as floats.

  • Add -cat flag to create a large (valid) TOML document, for benchmarks and such.