Skip to content

1.10.0

Choose a tag to compare

@samoht samoht released this 09 Nov 10:11
· 26 commits to main since this release
f25c8b8

CHANGES:

  • Experimental: with --junit or ALCOTEST_JUNIT=1, write a JUnit XML report
    of each run to junit/<name>-<time>-<id>.xml of the log directory, with the
    file and line of each test, or of its failure (#449, #476, fixes #130,
    @samoht, report by @pbiggar)
  • Record the source file that calls run, and write it as the file of the
    <testsuite> of the JUnit report (#449, @samoht)
  • Platform.S now requires timestamp and write_file (#449, @samoht)
  • Under dune, keep the output of tests in _build/_tests of the workspace,
    where dune does not delete it, rather than in _build/default. With #472, each
    dune test adds its runs to _build/_tests/run/<name>/<time>-<id>, which gives
    a local history of test results (#471, @samoht)
  • Fix alcotest-mirage, which failed with Assertion failed in every run
    without --verbose since 1.5.0 (#473, @samoht)
  • Keep the logs of each run in run/<name>/<time>-<id>, where <name> is the
    name given to run, so that the runs of each test executable are listed in
    order. latest still points to the last run (#472, @samoht)
  • Fix the link named after each test executable, which did not always point to
    its last run. It is replaced by the run/<name> folder (#472, @samoht)
  • Fix a crash when the name of a suite or group is longer than a file name
    can be (#472, @samoht)
  • Fix log files hidden when the name of a suite or group starts with a dot
    (#472, @samoht)
  • Custom platforms: prepare_log_trap takes the name given to run and returns
    the folder of the run (#472, @samoht)
  • Fix creating a log directory written with / on Windows, as in -o a/b, which
    failed with ENOENT (#470, @samoht)
  • Add test ?tags name f and suite name cases, to write suite "a" [ test "b" f ]
    instead of ("a", [ test_case "b" Quick f ]). tagsdefaults to ``Always ``
    (#468, @samoht, combinators suggested by @yawaramin in #393)
  • Add ?tags to group: its cases only run when these tags hold as well as
    their own (#468, @samoht, API from #294 by @craigfe)
  • Add group name cases, a test_case that nests cases to any depth. They
    run in place, are reported as parent.name and are selected with
    test '^parent\.name' (#453, fixes #275, @samoht, API from #294 by @craigfe,
    dotted names suggested by @mjambon)
  • Show the file and line of every failing test, not only of a failing check.
    A failure in a helper points to the line of the test that calls it.
    ALCOTEST_SOURCE_CODE_POSITION still turns this off (#451, @samoht, based on
    B0_testing by @dbuenzli and the b0 programmers)
  • Print the message of a failing check once: ASSERT now only shows the checks
    that passed (#465, @samoht)
  • Add wasm_of_ocaml support (#461, #436, #437, @hhugo, @samoht and @mefyl)
  • Remove code made redundant by OCaml 4.14 (#460, @samoht)
  • Close a failed test's log file when printing it raises, instead of leaking the
    file descriptor (#460, @samoht)
  • Remove the alcotest-js package, which had no code and only added dependencies.
    To test with js_of_ocaml, depend on js_of_ocaml-compiler directly (#463, @samoht)
  • Require OCaml 4.14 and replace uutf with the stdlib UTF-8 decoder. Test names
    with invalid UTF-8 can get a different log file name (#456, @samoht)
  • Print valid UTF-8 as is in string failures, when the output supports it
    (#456, fixes #408, @samoht, report by @feverdreme, suggestion by @lindig)
  • Add iarray, a testable for Iarray.t, available from OCaml 5.4
    (#455, fixes #434, @samoht, report by @JanBeh)
  • Fix UTF-8 locale detection, which never matched since 1.8.0, so Fmt.if_utf_8
    printers always took the non-UTF-8 branch. LC_ALL now overrides LC_CTYPE and
    LANG, as in POSIX, and UTF8 also counts (#457, @samoht)
  • Recognise Alcotest.skip and failed checks in alcotest-async tests: Async
    wrapped the exceptions, so a skip counted as a failure (#278, @vbmithr)
  • Make alcotest-async unavailable on Windows, so that ocaml-ci tests the other
    packages there (#454, @samoht, suggested by @mtelvers)
  • Remove stdlib-shims and ocaml-syntax-shims (#452, @copy)
  • Update ocamlformat to 0.29.0 (#450, @samoht)
  • Fix and modernise CI (#445, #446, #436, #407, @samoht, @hhugo and @MisterDA,
    report by @edwintorok and @ngorogiannis)
  • Add uchar, a testable for Uchar.t (#435, @emengd, review by @dinosaure)
  • Fix the success count in --json output, which included failures
    (#432, fixes #431, @1zumiSagiri, review by @MisterDA)
  • Add conditions on tests: test_case and test tuples accept `Tag,
    `And, `Or, `Not and `Always, also as Tag combinators, which
    hold in a context set by a new --tags option or ALCOTEST_TAGS, as with Go
    build tags. A new tags subcommand lists them. speed_level is now an alias
    of the new tag type, which breaks code matching on it exhaustively or
    restating it as [ `Quick | `Slow ]
    (#448, fixes #124, #151 and #316, @samoht, report by @hannesm and @arvidj)
  • Preserve absolute log directories: mkdir_p turned /foo into //foo, which
    fails with EROFS on Cygwin (#405, fixes #404, @bbonf, review by @MisterDA
    and @samoht)
  • Allow callers to override and_exit and record_backtrace in the test
    subcommand (#439, fixes #438, @edwintorok)
  • Keep Unix.stdout and Unix.stderr valid during tests on Windows
    (#444, fixes #443, @ngorogiannis)
  • Test alcotest-async exception handling (#279, @craigfe)
  • Add an alcotest-async example (#458, #421, @dannywillems)