Big Sur Intel mass bottling tracking issue

[jonchang]

If you are a Homebrew user on macOS Big Sur:

We do not provide support for this released but not yet supported version.
You will encounter build failures with some formulae.
Please create pull requests instead of asking for help on Homebrew's GitHub,
Discourse, Twitter or any other official channels. You are responsible for
resolving any issues you experience while you are running this
released but not yet supported version.

Maintainers, our self-hosted runners for macOS 11.0 Big Sur on Intel are now up and running. To build a bottle on Big Sur, run:

brew dispatch-build-bottle --macos 11.0 --upload --issue=64785 FORMULA

This will:

1. Run brew test-bot on that formula for a single macOS version (11.0)
2. Upload and commit the bottle hash (e.g. a1e2f9a)
3. Post in this issue if there are any build failures.

Ensure that all dependencies of the formula you are requesting a bottle for already have bottles of their own. This will help avoid frankenbottles (where bottles are built using dependencies bottled for earlier versions of macOS). Consider using FX's script: #64785 (comment)

Note that the Big Sur runners do not have cask osxfuse, adoptopenjdk8, or xquartz installed. If any formulae had undeclared dependencies on these Requirements, they'll need to be updated or deprecated/disabled/removed, as appropriate.

I've also been running a script that automatically dispatches new bottling jobs if it sees we have idle runners. Think of it as a background job that will ensure that we are always at 100% utilization of the Big Sur runners. Any pull request or dispatch job will make it stop filling the queue, so that way you won't have wait to test something that you want to work on.

I've restricted this issue to repository collaborators as it is likely to attract many requests for support. Once we get the most popular formulae migrated this should be unlocked.

[fxcoudert]

A shell script (run without argument) that tells you what formulas are ready to be bottled, in order of the analytics list:

#!/bin/bash

cd /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula

top=`brew info --analytics | cut -c 9-60 | grep -v '[(\/\-]'`

# List of formulas that are bottled (or bottle unneeded)
bottled=`egrep -l '(sha256.* => :big_sur|bottle :unneeded)' *.rb | sed 's/\.rb$//' | xargs`
bottled=" $bottled "

# One argument: the formula to check
function check_deps() {
  test -e $1.rb || return
  if [[ "$bottled" == *" $1 "* ]]; then
    return
  fi

  deps=`grep '^ *depends_on "' $1.rb | sed -e 's/^ *depends_on "//' -e 's/".*//'`
  for dep in $deps ; do
    if [[ "$bottled" == *" $dep "* ]]; then
      true
    else
      return
    fi
  done
  echo "$1"
}

for i in $top ; do
  check_deps $i
done

It's ugly shell, but it works

[jonchang]

Qt bottle: https://github.com/Homebrew/homebrew-core/runs/1399724540?check_suite_focus=true

ERROR at //build/config/mac/mac_sdk.gni:80:5: Script returned non-zero exit code.
exec_script("//build/mac/find_sdk.py", find_sdk_args, "list lines")
^----------
Current dir: /private/tmp/qt-20201114-71251-zayscx/qt-everywhere-src-5.15.1/qtwebengine/src/core/release/
Command: /usr/bin/python2 /private/tmp/qt-20201114-71251-zayscx/qt-everywhere-src-5.15.1/qtwebengine/src/3rdparty/chromium/build/mac/find_sdk.py --p
--print_bin_path 11.0
Returned 1.
stderr:

Traceback (most recent call last):
File "/private/tmp/qt-20201114-71251-zayscx/qt-everywhere-src-5.15.1/qtwebengine/src/3rdparty/chromium/build/mac/find_sdk.py", line 127, in <modul

print(main())
File "/private/tmp/qt-20201114-71251-zayscx/qt-everywhere-src-5.15.1/qtwebengine/src/3rdparty/chromium/build/mac/find_sdk.py", line 96, in main
raise Exception('No %s+ SDK found' % min_sdk_version)
Exception: No 11.0+ SDK found

See //build/config/sysroot.gni:65:3: whence it was imported.
import("//build/config/mac/mac_sdk.gni")
^--------------------------------------
See //BUILD.gn:76:5: which caused the file to be included.
"//net:net_unittests",
^--------------------
Project ERROR: GN run error!
make[3]: *** [sub-gn_run-pro-make_first] Error 3
make[2]: *** [sub-core-make_first] Error 2
make[1]: *** [sub-src-make_first] Error 2
make: *** [module-qtwebengine-make_first] Error 2

Qtwebengine will need this chromium patch: chromium/chromium@cdd9621#diff-195dca8233761e55ae153d3c49dca30f6ffa6abc0422af9d65c86c8c8e445569

Pull request: #64799

[fxcoudert]

Erlang failure:

  You are natively building Erlang/OTP for a later version of MacOSX
  than current version (11.0.1). You either need to
  cross-build Erlang/OTP, or set the environment variable
  MACOSX_DEPLOYMENT_TARGET to 11.0.1 (or a lower version).

Upstream report https://bugs.erlang.org/browse/ERL-1407

[BrewTestBot]

❌ @fxcoudert bottle request for mono failed.

[BrewTestBot]

❌ @fxcoudert bottle request for lftp failed.

[BrewTestBot]

❌ @fxcoudert bottle request for leiningen failed.

[BrewTestBot]

❌ @fxcoudert bottle request for protobuf@3.7 failed.

[BrewTestBot]

❌ @fxcoudert bottle request for serialosc failed.

[BrewTestBot]

❌ @fxcoudert bottle request for coturn failed.

[BrewTestBot]

❌ @fxcoudert bottle request for docker-machine-driver-xhyve failed.

[BrewTestBot]

❌ @fxcoudert bottle request for austin failed.

[BrewTestBot]

❌ @fxcoudert bottle request for gambit failed.

[BrewTestBot]

❌ @fxcoudert bottle request for cassandra-reaper failed.

[BrewTestBot]

❌ @fxcoudert bottle request for soundpipe failed.

[BrewTestBot]

❌ @fxcoudert bottle request for ape failed.

[BrewTestBot]

❌ @fxcoudert bottle request for echoprint-codegen failed.

[BrewTestBot]

❌ @fxcoudert bottle request for pcapplusplus failed.

[BrewTestBot]

❌ @fxcoudert bottle request for global failed.

[BrewTestBot]

❌ @fxcoudert bottle request for cuba failed.

[BrewTestBot]

❌ @fxcoudert bottle request for libjson-rpc-cpp failed.

[BrewTestBot]

❌ @fxcoudert bottle request for mboxgrep failed.

[BrewTestBot]

❌ @fxcoudert bottle request for rancher-compose failed.

[BrewTestBot]

❌ @fxcoudert bottle request for dep failed.

[BrewTestBot]

❌ @fxcoudert bottle request for valgrind failed.

[BrewTestBot]

❌ @fxcoudert bottle request for pod2man failed.

[BrewTestBot]

❌ @fxcoudert bottle request for whohas failed.

[BrewTestBot]

❌ @alebcay bottle request for po4a failed.

[BrewTestBot]

❌ @alebcay bottle request for expect failed.

[BrewTestBot]

❌ @fxcoudert bottle request for iam-policy-json-to-terraform failed.

[BrewTestBot]

❌ @fxcoudert bottle request for deployer failed.

[BrewTestBot]

❌ @fxcoudert bottle request for chronograf failed.

[BrewTestBot]

❌ @fxcoudert bottle request for pjproject failed.

[BrewTestBot]

❌ @Moisan bottle request for lemon failed.

[BrewTestBot]

❌ @Moisan bottle request for gron failed.