[new release] dune (1.10.0)

[rgrinberg]

Fast, portable and opinionated build system

• Project page: https://github.com/ocaml/dune
• Documentation: https://dune.readthedocs.io/

CHANGES:

• Restricted the set of variables available for expansion in the destination
  filename of install stanza to simplify implementation and avoid dependency
  cycles. (Discover binaries created by install stanzas without listing buildable targets dune#2073, @aalekseyev, @diml)

• [menhir] call menhir from context root build_dir ([menhir] Call menhir from root build directory to improve error reporting dune#2067, @ejgallego,
  review by @diml, @rgrinberg)

• [coq] Add coq.pp stanza to help with pre-processing of grammar
  files ([coq] Add coqpp preprocessing stanza. dune#2054, @ejgallego, review by @rgrinberg)

• Add a new more generic form for the promote mode: (promote (until-clean) (into <dir>)) (Fix #2061 and allow to promote a subset of the targets dune#2068, @diml)

• Allow to promote only a subset of the targets via (promote (only <pred>)). For instance: (promote (only *.mli)) (Fix #2061 and allow to promote a subset of the targets dune#2068, @diml)

• Improve the behavior when a strict subset of the targets of a rule is already
  in the source tree for projects using the dune language < 1.10 (Fix #2061 and allow to promote a subset of the targets dune#2068, fixes
  Parallel build issue in 1.9.1 dune#2061, @diml)

• With lang dune >= 1.10, rules in standard mode are no longer allowed to
  produce targets that are present in the source tree. This has been a warning
  for long enough (Fix #2061 and allow to promote a subset of the targets dune#2068, @diml)

• Allow %{...} variables in pps flags (Allow variables in pps flags dune#2076, @mlasson review by @diml and
  @aalekseyev).

• Add a 'cookies' option to ppx_rewriter/deriver flags in library stanzas. This
  allow to specify cookie requests from variables expanded at each invocation of
  the preprocessor. (Allow to pass more information to ppx rewriters dune#2106, @mlasson @diml)

• Add more opam metadata and use it to generate .opam files. In particular, a
  package field has been added to specify package specific information.
  (track opam file metadata in dune-project and rewrite opam files dune#2017, More progress on the opam generation dune#2091, @avsm, @jonludlam, @rgrinberg)

• Clean up the special support for findlib.dynload. Before, Dune would simply
  match on the library name. Now, we only match on the findlib package name when
  the library doesn't come from Dune. Someone writing a library called
  findlib.dynload with Dune would have to add (special_builtin_support findlib_dynload) to trigger the special behavior. (Formalise special builtin support for findlib.dynload dune#2115, @diml)

• Install the future_syntax preprocessor as ocaml-syntax-shims.exe (Rename future-syntax to ocaml-syntax-shims dune#2125,
  @rgrinberg)

• Hide full command on errors and warnings in development and show them in CI.
  (detected using the CI environment variable). Commands for which the
  invocation might be omitted must output an error prefixed with File . Add an
  --always-show-command-line option to disable this behavior and always show
  the full command. (Trim error messages in watch mode dune#2120, fixes display: add an option to not print the command even on errors dune#1733, @rgrinberg)

• In dune-workspace files, add the ability to choose the host context and to
  create duplicates of the default context with different settings. (Add the ability to choose the host context and create duplicates of the default context with different settings dune#2098,
  @TheLortex, review by @diml, @rgrinberg and @aalekseyev)

• Add support for hg in dune subst (Use the VCS module in watermarks.ml dune#2135, @diml)

• Don't build documentation for implementations of virtual libraries (Don't build docs for implementations of virtual libraries dune#2141,
  fixes Docs build fail with multiple virtual library implementations dune#2138, @jonludlam)

• Fix generation of the -pp flag in .merlin (Fix generation of -pp in .merlin dune#2142, @rgrinberg)

• Make dune subst add a (version ...) field to the dune-project
  file (Make "dune subst" add a version field to dune-project dune#2148, @diml)

• Add the %{os_type} variable, which is a short-hand for
  %{ocaml-config:os_type} (Allow the enabled_if field in library stanzas dune#1764, @diml)

• Allow enabled_if fields in library stanzas, restricted to the
  %{os_type}, %{model}, %{architecture}, %{system} variables (Allow the enabled_if field in library stanzas dune#1764,
  Add model, architecture, system as enabled_if vars (#2164)kf dune#2164 @diml, @rgrinberg)

• Fix chdir on external and source paths. Dune will also fail gracefully if
  the external or source path does not exist (Fix chdir handling dune#2165, fixes Mkdir_p.exec: attempted to create unmanaged dir in Dune 1.9 dune#2158, @rgrinberg)

• Support the .cc extension fro C++ sources (Add support for the .cc extension for C++ sources dune#2195, fixes can cxx_files support a .cc extension? dune#83, @rgrinberg)

• Run ocamlformat relative to the context root. This improves the locations of
  errors. (Run ocamlformat from build context root dune#2196, fixes ocamlformat is passed a path relative to the build dir dune#1370, @rgrinberg)

• Fix detection of README, LICENSE, CHANGE, and HISTORY files. These
  would be undetected whenever the project was nested in another workspace.
  (Fix detecting odig files for installation dune#2194, @rgrinberg)

• Fix generation of .merlin whenever there's more than one stanza with the
  same ppx preprocessing specification (watch mode awakened by changes in ignored_subdirs dune#2209 ,fixes FLG -ppx missing dune#2206, @rgrinberg)

• Fix generation of .merlin in the presence of the copy_files stanza and
  preprocessing specifications of other stanazs. (Fix copy_files handling when generating .merlin files dune#2211, fixes FLG -ppx missing dune#2206,
  @rgrinberg)

• Run refmt from the context's root directory. This improves error messages in
  case of syntax errors. (Run refmt from the context's root dir dune#2223, @rgrinberg)

• In .merlin files, don't pass -dump-ast to the future_syntax preprocessor.
  Merlin doesn't seem to like it when binary AST is generated by a -pp
  preprocessor. (future-syntax: do not confuse merlin by an AST produced by a -pp dune#2236, @aalekseyev)

• dune install will verify that all files mentioned in all .install files
  exist before trying to install anything. This prevents partial installation of
  packages (Add check that all files are present before installing dune#2230, @rgrinberg)

[XVilka]

CI timeout problems, probably you will want to rerun some of the jobs:

$ opam depext -uivyj 2 charrua-unix.0.11.2
# Detecting depexts using vars: arch=x86_64, os=linux, os-distribution=debian, os-family=debian
[ERROR] Sorry, resolution of the request timed out.
        Try to specify a simpler request, use a different solver, or increase the allowed time by setting OPAMSOLVERTIMEOUT to a bigger value (currently, it is set to 60.0 seconds).
Command failed: opam list --readonly --with-test --external  --resolve=charrua-unix.0.11.2 returned 60

[camelus]

☀️ All lint checks passed cfa54d7

• These packages passed lint tests: dune.1.10.0

---

☀️ Installability check (11274 → 11275)

• new installable packages (1): dune.1.10.0

[avsm]

Is this a regression in 1.10? exists_if is a new feature

#=== ERROR while compiling jupyter-archimedes.2.3.2 ===========================#
# context              2.0.4 | linux/x86_64 | ocaml-base-compiler.4.07.1 | git+file:///home/opam/opam-repository
# path                 ~/.opam/4.07/.opam-switch/build/jupyter-archimedes.2.3.2
# command              ~/.opam/4.07/bin/dune build -p jupyter-archimedes -j 71
# exit-code            1
# env-file             ~/.opam/log/jupyter-archimedes-18-d35c8c.env
# output-file          ~/.opam/log/jupyter-archimedes-18-d35c8c.out
### output ###
# File "jupyter-archimedes/src/dune", line 10, characters 14-30:
# 10 |               archimedes.cairo))
#                    ^^^^^^^^^^^^^^^^
# Error: Library "archimedes.cairo" in /home/opam/.opam/4.07/lib/archimedes is hidden (unsatisfied 'exist_if').
# Hint: try: dune external-lib-deps --missing -j 71 -p jupyter-archimedes @@default

https://ci.ocaml.org/log/saved/docker-run-303980b97235ef60766bdba7c698472b/ef130eae24bb84c601b0b83b59611bc16fb2d275

[rgrinberg]

The exists_if is from the META file for archimedes.cairo. This has been supported since the beginning.

[rgrinberg]

Ping @avsm

[avsm]

thanks @rgrinberg !