ci: Skip aarch64 builds except for new releases

These builds are extremely slow due to needing to rely on emulation, and
we can't adequately test them due to the emulation not providing all
syscalls that we require. There's little point to wasting time building
something that we can't test for every push to a PR branch, so we'll
defer building these until the time a release is cut.

Signed-off-by: Matt Wozniski <mwozniski@bloomberg.net>

.github/workflows/build_wheels.yml

@@ -39,7 +39,7 @@ jobs:
       matrix:
         os: [ubuntu-latest]
         cibw_python: ["cp37-*", "cp38-*", "cp39-*", "cp310-*", "cp311-*"]
-        cibw_arch: ["x86_64", "aarch64"]
+        cibw_arch: ${{ fromJSON(github.event_name == "release" && github.event.action == "published" && '["x86_64", "aarch64"]' || '["x86_64"]') }}
 
     steps:
       - name: Disable ptrace security restrictions