build: self-hosted compiler progress

[slimsag]

This is the tracking issue for getting all Mach examples/libraries working with the new self-hosted Zig compiler, which will be enabled by default in Zig v0.11 and is already enabled by default in all nightly Zig builds.

Status

• aarch64-macos: tested 2022-09-09
• x86_64-linux: tested 2022-09-08
• x86_64-windows: tested 2022-09-09

aarch64-macos	linux	windows	test
✅	✅	✅	cd libs/ecs && zig build test -fno-stage1
✅	✅	✅	cd libs/ecs && zig build test -fstage1
✅	✅	✅	cd libs/gpu && zig build test
✅	✅	✅	cd libs/gpu && zig build run-example
✅	✅	✅	cd libs/glfw && zig build test
✅	✅	✅	cd libs/sysaudio && zig build test
✅	✅	✅	cd libs/sysaudio && zig build run-example-soundio-sine-wave
✅	✅	✅	cd libs/freetype && zig build test
✅	✅	✅	cd libs/freetype && zig build run-example-single-glyph -- 'a'
✅	✅	✅	cd libs/freetype && zig build run-example-glyph-to-svg
✅	✅	✅	cd libs/gpu-dawn && zig build
✅	✅	✅	zig build-exe --main-pkg-path . ./tools/html-generator.zig
🍎	🍎	🍎	zig build run-example-triangle -fstage1 -Dtarget=wasm32-freestanding-musl
✅	✅	✅	zig build run-shaderexp
✅	✅	✅	zig build run-example-advanced-gen-texture-light
✅	✅	✅	zig build run-example-boids
⚠️	⚠️	⚠️	zig build run-example-ecs-app
✅	✅	✅	zig build run-example-fractal-cube
✅	✅	✅	zig build run-example-gkurve
✅	✅	✅	zig build run-example-image-blur
✅	✅	✅	zig build run-example-instanced-cube
✅	✅	✅	zig build run-example-map-async
✅	✅	✅	zig build run-example-rotating-cube
✅	✅	✅	zig build run-example-textured-cube
✅	✅	✅	zig build run-example-triangle
✅	✅	✅	zig build run-example-triangle-msaa
✅	✅	✅	zig build run-example-two-cubes
✅	✅	✅	zig build run-example-cubemap
✅	✅	✅	zig build example-triangle -Dtarget=wasm32-freestanding-musl
🍎	🍎	🍎	zig build run-example-triangle -fstage1 -Dtarget=wasm32-freestanding-musl
⚠️	⚠️	⚠️	zig build example-sysaudio -Dtarget=wasm32-freestanding-musl
🍎	🍎	🍎	zig build run-example-sysaudio -fstage1 -Dtarget=wasm32-freestanding-musl
⚠️	?	⚠️	zig build
✅	✅	✅	zig build test

Known issues

• The HTTP server we use for running WebAssembly examples, apple_pie, use async, so our WASM examples cannot auto-start a web server and open the browser anymore. Not the end of the world.

Zig issues we are blocked on

• stage2 regression: 'struct layout not resolved' for structs built at comptime ziglang/zig#12786
• stage2 regression in beginComptimePtrMutation ziglang/zig#12794

Zig issues we have hacky workarounds for

Search for TODO(self-hosted)

• stage2: usingnamespace can create ambiguous reference ziglang/zig#12429
• stage3: ICE with inlined functions / wrong number of parameters ziglang/zig#12433
• Segmentation fault when using @cImport on aarch64-macos ziglang/zig#12483
  • Compilation error on stage2 with @cImport and SDL2 ziglang/zig#12737
  • stage2 regression: cImport fails on macOS Multiprocessing.h copyright symbol (not UTF-8 encoded) ziglang/zig#12784

Zig issues that are problems for us, but haven't been filed yet

NOT YET FILED:

1. Our map-async example (which does not use zig async) required adding a useless field to the App file struct (*App is treated as *const App for some reason otherwise, not sure why. Need to make a minimal repro and file a bug. error: expected type '*main.main', found '*const main.main') a4ddfb6

[PiergiorgioZagaria]

Solved the last error for compiling mach with glfw, basically _ = glfw.getProcAddress("foobar") was being called at compile time because GLproc, the return type of getProcAddress used the old function declaration.

Will test with the latest version of mach now and send a PR

[slimsag]

@PiergiorgioZagaria nice work, thanks so much for continuing to dig into this. I updated the issue description just now with what (I think?) the status quo is w.r.t. stage2 support, let me know if I should update anything there

[slimsag]

apple_pie has since been replaced with a web server dedicated to WASM serving: https://github.com/hexops/mach/tree/main/tools/wasmserve

We're now fully on the self-hosted compiler, so closing.