permission errors when running brew test mytap/mytap/formula

[ipatch]

Output of brew config

HOMEBREW_VERSION: 6.0.1-80-gcf4bbe3
ORIGIN: https://github.com/Homebrew/brew.git
HEAD: cf4bbe33370fab55dca28c7f6c0f84380f54c762
Last commit: 12 days ago
Branch: main
Core tap origin:
Core tap HEAD: 60fd33c8b6bcb76248cb4e8f3cdde93d6ba8ce75
Core tap last commit: 8 weeks ago
Core tap JSON: 04 Jun 16:55 UTC
HOMEBREW_PREFIX: /home/capin/homebrew
HOMEBREW_REPOSITORY: /home/capin/homebrew
HOMEBREW_CELLAR: /home/capin/homebrew/Cellar
HOMEBREW_CACHE: /home/capin/homebrew/cache
HOMEBREW_CASK_OPTS: []
HOMEBREW_DEVELOPER: set
HOMEBREW_DISPLAY: localhost:10.0
HOMEBREW_DISPLAY_INSTALL_TIMES: set
HOMEBREW_DOWNLOAD_CONCURRENCY: 8
HOMEBREW_EDITOR: nvim
HOMEBREW_MAKE_JOBS: 8
HOMEBREW_NO_ANALYTICS: set
HOMEBREW_NO_ASK: set
HOMEBREW_NO_AUTOREMOVE: set
HOMEBREW_NO_AUTO_UPDATE: set
HOMEBREW_NO_GITHUB_API: set
HOMEBREW_NO_INSTALL_CLEANUP: set
HOMEBREW_NO_INSTALL_FROM_API: set
HOMEBREW_NO_SANDBOX_LINUX: set
HOMEBREW_REQUIRE_TAP_TRUST: set
HOMEBREW_TEMP: /opt/tmp/homebrew
HOMEBREW_VERBOSE: set
Homebrew Ruby: 4.0.5 => /home/capin/homebrew/Library/Homebrew/vendor/portable-ruby/4.0.5_1/bin/ruby
CPU: octa-core 64-bit arm
Clang: 22.1.4
Git: 2.53.0 => /bin/git
Curl: 8.11.1 => /bin/curl
Kernel: Linux 6.14.4-400.asahi.fc40.aarch64+16k aarch64 GNU/Linux
OS: Fedora Linux 42 (Adams)
Host glibc: 2.41
Host libstdc++: 6.0.34
/usr/bin/gcc: 15.2.1
/usr/bin/ruby: 3.4.8
glibc: N/A
gcc@13: 13.4.0
gcc: 15.2.0_1
xorg: N/A

Output of brew doctor

Please note that these warnings are just used to help the Homebrew maintainers
with debugging if you file an issue. If everything you use Homebrew for is
working fine: please don't worry or file an issue; just ignore this. Thanks!

Warning: Homebrew/homebrew-core was not tapped properly! Run:
  rm -rf "/home/capin/homebrew/Library/Taps/homebrew/homebrew-core"
  brew tap homebrew/core

Warning: Some installed formulae are deprecated or disabled.
You should find replacements for the following formulae:
  pyside2@5.15.15_py312
  freeimage
  icu4c@75
  icu4c@76
  icu4c@77
  libgit2@1.7
  libsass
  qt@5
  sassc

Warning: You have unlinked kegs in your Cellar.
Leaving kegs unlinked can lead to build-trouble and cause formulae that depend on
those kegs to fail to run properly once built. Run `brew link` on these:
  dbus
  glib
  ruby
  qtwebengine
  vtk
  coin3d
  pyside

Warning: Your Homebrew's prefix is not /home/linuxbrew/.linuxbrew.

Most of Homebrew's bottles (binary packages) can only be used with the default prefix.
Consider uninstalling Homebrew and reinstalling into the default prefix.

This is a Tier 3 configuration:
  https://docs.brew.sh/Support-Tiers#tier-3
You can report issues with Tier 3 configurations to Homebrew/* repositories!
Read the above document before opening any issues or PRs.


Warning: Some taps are not on the default git origin branch and may not receive
updates. If this is a surprise to you, check out the default branch with:
  git -C $(brew --repo freecad/freecad) checkout master
  git -C $(brew --repo homebrew/core) checkout

Description of issue

the output from the above commands is from my local asahi linux box not the github runner where i'm having the issues.

basically for longest time i have just had the below snippet for the brew test for the freecad formula in the homebrew-freecad tap. and freecad does provide a series unit tests when building and installing freecad from source. so i think it would be a good idea to at least run through the non gui tests after building the formula from source and generating a bottle.

so before the below PR i had the following for the freecad formula

test do
  system true
end

ideally i'd have something along the lines of

test do
  freecadcmd = OS.mac? ? prefix/"MacOS/FreeCADCmd" : bin/"FreeCADCmd"
  system freecadcmd, "-t", "0"
end

but unfortunately i've run into a series errors most notably related to permission issues when attempting to run the test on the macos 14 github provided ci runner.

i've copied a series output from various runs attempting to resolve the issues in the following PR

FreeCAD/homebrew-freecad#825

but basically i'm running into the following errors as of right now.

==> Testing freecad/freecad/freecad@1.1.1_py313_qt6
==> /opt/homebrew/Cellar/freecad@1.1.1_py313_qt6/1.1.1/MacOS/FreeCADCmd -u /private/tmp/freecadA1.1.1_py313_qt6-test-20260622-40314-vv4ai1/user.cfg -s /private/tmp/freecadA1.1.1_py313_qt6-test-20260622-40314-vv4ai1/system.cfg -t 0
Fatal Python error: take_gil: PyMUTEX_LOCK(gil->mutex) failed
Python runtime state: unknown

While initializing FreeCAD the following exception occurred: 'Could not create directories. Failed with: Operation not permitted'

 File "/opt/homebrew/Cellar/freecad@1.1.1_py313_qt6/1.1.1/Mod/CAM/Path/Post/UtilsExport.py", line 39, in <module>
    imp<class 'PermissionError'>: [Errno 1] Operation not permitted: '/Users/runner/Library/Application Support/FreeCAD/v1-1/CamAssets'
FreeCAD 1.1.1, Libs: 1.1.1R0108fd4b48
(C) 2001-2026 FreeCAD contributors

i'm at the point where i'm going to try and launch the program first to see if it will create the required directories / files first then run the test suite, but if that doesn't work, i am not sure where i should go from here. i'd really like to have this test suite run to know things are working as they should.

[cookesan]

For a formula test, I would keep all FreeCAD user/config writes inside testpath.

Homebrew's Formula#run_test creates a temporary test directory, sets HOME to that directory, applies the sandbox env, and then runs the formula's test do block. So a test that still tries to create /Users/runner/Library/Application Support/FreeCAD/... is escaping the intended test home/config location.

Since FreeCADCmd already supports -u and -s, the next thing I would try is also redirecting any platform config/cache variables FreeCAD respects to testpath, for example an app-home/user-data variable if FreeCAD has one, or XDG_CONFIG_HOME/XDG_CACHE_HOME on platforms where it uses those. I would avoid a "launch it once" workaround if that writes to the runner's real Library; the better test is a non-GUI command with every writable path under testpath.