Building release 1.6.6 on illumos-based OS fails

[szaydel]

I just tried to build on recent OmniOS from https://nim-lang.org/download/nim-1.6.6.tar.xz and I hit a build failure.

Current Output

omni@omni01:~/nim-1.6.6$ sh build.sh
# OS: solaris
# CPU: i386
gcc -w '-fmax-errors=3' -O3 -fno-strict-aliasing -fno-ident -Ic_code -c c_code/1_1/stdlib_digitsutils.nim.c -o c_code/1_1/stdlib_digitsutils.nim.o
In file included from c_code/1_1/stdlib_digitsutils.nim.c:4:
c_code/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
c_code/nimbase.h:550:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  550 | NIM_STATIC_ASSERT(sizeof(NI) == sizeof(void*) && NIM_INTBITS == sizeof(NI)*8, "");
      | ^~~~~~~~~~~~~~~~~

Possible Solution

I modified build.sh to instead of using uname -m to a hardcoded amd64, which allows me to build without a problem. I think the solution here might be to check that this amounts to amd64:

omni@omni01:~$ [ $(gcc -E -dM - < /dev/null | awk '/__amd64__/ {print $2}') == "__amd64__" ]; echo $?
0

...and if so, then use amd64 instead of what otherwise ends-up being i86pc:

omni@omni01:~$ uname -m
i86pc

[Araq]

PRs are welcome but we don't support "OmniOS" officially.

[szaydel]

Understood, thanks. Do you have any interest in supporting it?

[Araq]

No, it's yet another Unix variant, totally uninteresting.

[szaydel]

Got it, thank you for clarifying.

[barracuda156]

I just tried to build on recent OmniOS from https://nim-lang.org/download/nim-1.6.6.tar.xz and I hit a build failure.

Current Output

omni@omni01:~/nim-1.6.6$ sh build.sh
# OS: solaris
# CPU: i386
gcc -w '-fmax-errors=3' -O3 -fno-strict-aliasing -fno-ident -Ic_code -c c_code/1_1/stdlib_digitsutils.nim.c -o c_code/1_1/stdlib_digitsutils.nim.o
In file included from c_code/1_1/stdlib_digitsutils.nim.c:4:
c_code/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
c_code/nimbase.h:550:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  550 | NIM_STATIC_ASSERT(sizeof(NI) == sizeof(void*) && NIM_INTBITS == sizeof(NI)*8, "");
      | ^~~~~~~~~~~~~~~~~

@szaydel I got this error on 10.6.8 Rosetta now.

[szaydel]

@barracuda156, let me look into this. I won't have cycles today, I don't think but I will look into it tomorrow. Can you tell me a little bit about what you have Omni running on, and the version of Omni?

[barracuda156]

@barracuda156, let me look into this. I won't have cycles today, I don't think but I will look into it tomorrow. Can you tell me a little bit about what you have Omni running on, and the version of Omni?

@szaydel Thanks for responding!

I am getting this error with Nim on MacOS 10.6.8 in Rosetta (so when building for ppc32). I just mentioned it here, since the error is almost identical, so solution could be similar as well.
(Obviously, I had to modify build script in order for it to work on Rosetta at all – otherwise it [mis]detects the arch from physical cpu instead of emulated one.)

P. S. Precisely, I get this:

--->  Building nim
# OS: macosx
# CPU: powerpc
/opt/local/bin/gcc-mp-12 -w -fmax-errors=3 -O3 -fno-strict-aliasing -fno-ident -arch ppc -Ic_code -c c_code/1_1/stdlib_assertions.nim.c -o c_code/1_1/stdlib_assertions.nim.o
In file included from c_code/1_1/stdlib_assertions.nim.c:4:
c_code/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
c_code/nimbase.h:328:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  328 | NIM_STATIC_ASSERT(sizeof(NIM_BOOL) == 1, ""); // check whether really needed
      | ^~~~~~~~~~~~~~~~~

[szaydel]

Yes, I think it is probably a nearly identical problem, likely a matter of workaround similar to what I had to do. I wish I could more easily repro this, but I don't have a mac with a PPC chip.

[barracuda156]

Yes, I think it is probably a nearly identical problem, likely a matter of workaround similar to what I had to do. I wish I could more easily repro this, but I don't have a mac with a PPC chip.

@szaydel It may not occur on a PPC Mac natively (I am away from my PPC machines so cannot check atm).
I run 10.6.8 Server in Parallels on Big Sur, and Rosetta of 10.6 allows to build and run ppc32 binaries natively (architecture is emulated). But it is quite a specific setup, I do not really expect others spending time to reproduce that. I have it just as a temporary solution while PPC hardware is not at my disposal.

[szaydel]

I did not right away realize that the example from 3 hours ago was not Omni. :) Yes, this seems to be a pretty particular setup.

[barracuda156]

I did not right away realize that the example from 3 hours ago was not Omni. :) Yes, this seems to be a pretty particular setup.

@szaydel I think now there is some problem with a packaged source of Nim from its website, it uses old/incomplete/wrong C sources. I rewritten portfile to use Github versions (including csources_v1), and assertion error problem is just gone.

[szaydel]

Interesting. Are you seeing this same problem building directly from tip of master?

[barracuda156]

Interesting. Are you seeing this same problem building directly from tip of master?

@szaydel Let me see. At the moment I use 1.6.6, but if that fails, I switch to latest-commit version. Limited free time these days, I just now made patches for Nim code so that correct compiler is invoked with correct arch flags. Running the build now. Expectations not high yet, I doubt ppc64 Nim has ever been tested on MacOS (despite being nominally supported), since the sources have Clang hardcoded – and Clang is broken for PPC on MacOS forever. If so, we are into an unexplored territory.

[barracuda156]

@szaydel So yeah, I ended up with the same assert error in the second stage (after bootstrapping from C sources completed):

/opt/local/bin/gcc-mp-12 -o bin/nim c_code/1_1/stdlib_assertions.nim.o c_code/1_1/stdlib_dollars.nim.o c_code/1_1/stdlib_formatfloat.nim.o c_code/3_1/stdlib_io.nim.o c_code/3_1/stdlib_system.nim.o c_code/2_1/stdlib_parseutils.nim.o c_code/2_1/stdlib_math.nim.o c_code/1_1/stdlib_algorithm.nim.o c_code/2_1/stdlib_unicode.nim.o c_code/3_1/stdlib_strutils.nim.o c_code/2_1/stdlib_pathnorm.nim.o c_code/3_1/stdlib_posix.nim.o c_code/3_1/stdlib_times.nim.o c_code/3_1/stdlib_os.nim.o c_code/1_1/stdlib_hashes.nim.o c_code/2_1/stdlib_strtabs.nim.o c_code/1_1/stdlib_sets.nim.o c_code/2_1/@mpathutils.nim.o c_code/2_1/@mropes.nim.o c_code/3_1/stdlib_tables.nim.o c_code/2_1/@mlineinfos.nim.o c_code/3_7/@mplatform.nim.o c_code/1_1/@mprefixmatches.nim.o c_code/2_1/stdlib_strformat.nim.o c_code/2_1/stdlib_terminal.nim.o c_code/3_1/@moptions.nim.o c_code/3_1/@mmsgs.nim.o c_code/1_1/@mcondsyms.nim.o c_code/3_1/stdlib_streams.nim.o c_code/3_1/stdlib_cpuinfo.nim.o c_code/3_1/stdlib_osproc.nim.o c_code/2_3/stdlib_sha1.nim.o c_code/2_1/stdlib_lexbase.nim.o c_code/3_1/stdlib_parsejson.nim.o c_code/3_1/stdlib_json.nim.o c_code/3_1/@mextccomp.nim.o c_code/1_1/@mwordrecg.nim.o c_code/3_1/@mnimblecmd.nim.o c_code/2_3/stdlib_parseopt.nim.o c_code/1_1/@mincremental.nim.o c_code/3_1/@mcommands.nim.o c_code/2_1/@mllstream.nim.o c_code/1_1/@midents.nim.o c_code/1_1/@midgen.nim.o c_code/1_1/@mint128.nim.o c_code/1_1/@mast.nim.o c_code/1_1/@mnimlexbase.nim.o c_code/3_1/@mlexer.nim.o c_code/3_1/@mparser.nim.o c_code/1_1/@mrenderer.nim.o c_code/1_1/@mfilters.nim.o c_code/1_1/@mfilter_tmpl.nim.o c_code/1_1/@msyntaxes.nim.o c_code/1_1/stdlib_intsets.nim.o c_code/3_1/@mrodutils.nim.o c_code/3_1/@mastalgo.nim.o c_code/1_1/@mtrees.nim.o c_code/3_1/@mtypes.nim.o c_code/1_1/@mbtrees.nim.o c_code/1_1/stdlib_md5.nim.o c_code/1_1/@mmodulegraphs.nim.o c_code/1_1/@mmagicsys.nim.o c_code/1_1/@mbitsets.nim.o c_code/1_1/@mnimsets.nim.o c_code/3_1/@msemfold.nim.o c_code/3_1/@mmodulepaths.nim.o c_code/1_1/@mvmdef.nim.o c_code/3_1/@msemdata.nim.o c_code/1_1/@mlinter.nim.o c_code/1_1/@mnimfix@sprettybase.nim.o c_code/1_1/@mlookups.nim.o c_code/3_1/@msemtypinst.nim.o c_code/1_1/@mparampatterns.nim.o c_code/1_1/@mlowerings.nim.o c_code/1_1/@m..@slib@spackages@sdocutils@srstast.nim.o c_code/3_1/@m..@slib@spackages@sdocutils@srst.nim.o c_code/1_1/@m..@slib@spackages@sdocutils@shighlite.nim.o c_code/3_1/@m..@slib@spackages@sdocutils@srstgen.nim.o c_code/1_1/stdlib_xmltree.nim.o c_code/1_1/stdlib_uri.nim.o c_code/1_1/stdlib_cgi.nim.o c_code/1_1/@mtypesrenderer.nim.o c_code/3_1/@mdocgen.nim.o c_code/3_1/@msigmatch.nim.o c_code/1_1/@mimporter.nim.o c_code/1_1/@mprocfind.nim.o c_code/3_1/@mpragmas.nim.o c_code/3_1/@mreorder.nim.o c_code/1_1/@mpasses.nim.o c_code/1_1/@msaturate.nim.o c_code/1_1/@mguards.nim.o c_code/3_1/@msighashes.nim.o c_code/3_1/@mliftdestructors.nim.o c_code/1_1/@msempass2.nim.o c_code/1_1/@mcgmeth.nim.o c_code/1_1/@maliases.nim.o c_code/1_1/@mpatterns.nim.o c_code/3_1/@mdfa.nim.o c_code/3_1/@minjectdestructors.nim.o c_code/1_1/@mliftlocals.nim.o c_code/1_1/@mlambdalifting.nim.o c_code/1_1/@mclosureiters.nim.o c_code/1_1/@mtransf.nim.o c_code/1_1/@mvmgen.nim.o c_code/3_1/@mvmdeps.nim.o c_code/1_1/@mvmmarshal.nim.o c_code/3_1/@mgorgeimpl.nim.o c_code/1_1/@mmacrocacheimpl.nim.o c_code/3_1/@mevaltempl.nim.o c_code/3_1/@mvm.nim.o c_code/1_1/@msemmacrosanity.nim.o c_code/1_1/@mpluginsupport.nim.o c_code/1_1/@mplugins@slocals.nim.o c_code/1_1/@mplugins@sitersgen.nim.o c_code/1_1/@mplugins@sactive.nim.o c_code/1_1/@mspawn.nim.o c_code/1_1/@msemparallel.nim.o c_code/3_1/@msem.nim.o c_code/1_1/@mccgutils.nim.o c_code/1_1/@mtreetab.nim.o c_code/1_1/@mndi.nim.o c_code/1_1/@mcgendata.nim.o c_code/3_1/@mccgmerge.nim.o c_code/1_1/@menumtostr.nim.o c_code/2_1/stdlib_dynlib.nim.o c_code/3_1/@mcgen.nim.o c_code/3_1/@mnimconf.nim.o c_code/1_1/@mpassaux.nim.o c_code/1_1/@mdepends.nim.o c_code/1_1/@mmodules.nim.o c_code/1_1/@mjsgen.nim.o c_code/3_1/@mdocgen2.nim.o c_code/1_1/@mmain.nim.o c_code/3_1/@mscriptconfig.nim.o c_code/3_1/@mcmdlinehelper.nim.o c_code/3_1/@mnim.nim.o -ldl -lm -arch ppc
: SUCCESS
Hint: used config file '/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924/config/nim.cfg' [Conf]
Hint: used config file 'koch.nim.cfg' [Conf]
Hint: used config file '/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924/config/config.nims' [Conf]
Hint: system [Processing]
Hint: since [Processing]
Hint: ansi_c [Processing]
Hint: memory [Processing]
Hint: assertions [Processing]
Hint: miscdollars [Processing]
Hint: digitsutils [Processing]
Hint: iterators [Processing]
Hint: coro_detection [Processing]
Hint: dollars [Processing]
Hint: formatfloat [Processing]
Hint: dragonbox [Processing]
Hint: schubfach [Processing]
Hint: stacktraces [Processing]
Hint: countbits_impl [Processing]
Hint: bitops_utils [Processing]
/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924/lib/system.nim(2463, 68) Warning: unknown magic 'Finished' might crash the compiler [UnknownMagic]
Hint: widestrs [Processing]
Hint: io [Processing]
Hint: koch [Processing]
Hint: os [Processing]
Hint: strutils [Processing]
Hint: parseutils [Processing]
Hint: math [Processing]
Hint: bitops [Processing]
Hint: macros [Processing]
Hint: fenv [Processing]
Hint: algorithm [Processing]
Hint: enumutils [Processing]
Hint: typetraits [Processing]
Hint: unicode [Processing]
Hint: strimpl [Processing]
Hint: pathnorm [Processing]
Hint: osseps [Processing]
Hint: posix [Processing]
Hint: times [Processing]
Hint: options [Processing]
Hint: parseopt [Processing]
Hint: osproc [Processing]
Hint: strtabs [Processing]
Hint: hashes [Processing]
Hint: streams [Processing]
Hint: cpuinfo [Processing]
Hint: streamwrapper [Processing]
Hint: deques [Processing]
Hint: kqueue [Processing]
Hint: kochdocs [Processing]
Hint: sets [Processing]
Hint: sequtils [Processing]
Hint: globs [Processing]
Hint: nimpaths [Processing]
Hint: deps [Processing]
Hint: uri [Processing]
Hint: base64 [Processing]
Hint: decode_helpers [Processing]
Hint: strformat [Processing]
Hint: gitutils [Processing]
Hint: tempfiles [Processing]
Hint: random [Processing]
Hint: sysrand [Processing]
Hint: monotimes [Processing]
CC: stdlib_digitsutils.nim
CC: stdlib_assertions.nim
CC: stdlib_dollars.nim
CC: stdlib_io.nim
CC: stdlib_system.nim
CC: stdlib_parseutils.nim
Error: execution of an external compiler program '/opt/local/bin/gcc-mp-12 -c  -w -fmax-errors=3  -I/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924/lib -I/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924 -o /opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c.o /opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c' failed with exit code: 1

In file included from /opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c:9:
/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924/lib/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-2f85924/lib/nimbase.h:328:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  328 | NIM_STATIC_ASSERT(sizeof(NIM_BOOL) == 1, ""); // check whether really needed
      | ^~~~~~~~~~~~~~~~~
Command failed: ./bin/nim c koch
Exit code: 1

[szaydel]

I have not tested yet on my M1 with Omni under UTM. I am going to try to find some time today. Sorry, time has been rather short... This latest output you shared, is this from the master branch?

[barracuda156]

@szaydel Output above was from v. 1.6.6 (release), but, unfortunately, master branch fails the same way. I just switched to building from latest-commit Nim, and the same failure on the same spot:

Error: execution of an external compiler program '/opt/local/bin/gcc-mp-12 -c  -w -fmax-errors=3 -pthread  -I/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib -I/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf -o /opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_sharedlist.nim.c.o /opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_sharedlist.nim.c' failed with exit code: 1

In file included from /opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_sharedlist.nim.c:9:
/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
/opt/local/var/macports/build/_opt_PPCRosettaPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib/nimbase.h:328:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  328 | NIM_STATIC_ASSERT(sizeof(NIM_BOOL) == 1, ""); // check whether really needed
      | ^~~~~~~~~~~~~~~~~
Command failed: ./bin/nim c koch
Exit code: 1

[szaydel]

Well, at least things are consistent, something to be said for that. :)

[barracuda156]

@szaydel Just back to my PPC machines. Now we know for sure that assertion failure has nothing to do with Rosetta, same error on 10.6 PPC:

CC: stdlib_digitsutils.nim
CC: stdlib_assertions.nim
Error: execution of an external compiler program '/opt/local/bin/gcc-mp-11 -c  -w -fmax-errors=3 -pthread  -I/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib -I/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf -o /opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c.o /opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c' failed with exit code: 1

In file included from /opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c:9:
/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib/nimbase.h:328:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  328 | NIM_STATIC_ASSERT(sizeof(NIM_BOOL) == 1, ""); // check whether really needed
      | ^~~~~~~~~~~~~~~~~
Command failed: ./bin/nim c koch
Exit code: 1
Error: Failed to build nim: command execution failed

[szaydel]

I need to test this on ARM, have not had a chance. On my intel x86-64 I did not have an issue.

[barracuda156]

@szaydel Just back to my PPC machines. Now we know for sure that assertion failure has nothing to do with Rosetta, same error on 10.6 PPC:

CC: stdlib_digitsutils.nim
CC: stdlib_assertions.nim
Error: execution of an external compiler program '/opt/local/bin/gcc-mp-11 -c  -w -fmax-errors=3 -pthread  -I/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib -I/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf -o /opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c.o /opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c' failed with exit code: 1

In file included from /opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/.home/.cache/nim/koch_d/stdlib_assertions.nim.c:9:
/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib/nimbase.h:276:35: error: static assertion failed: ""
  276 | #define NIM_STATIC_ASSERT(x, msg) _Static_assert((x), msg)
      |                                   ^~~~~~~~~~~~~~
/opt/local/var/macports/build/_opt_PPCSnowLeopardPorts_lang_nim/nim/work/nim-lang-Nim-7a756bf/lib/nimbase.h:328:1: note: in expansion of macro 'NIM_STATIC_ASSERT'
  328 | NIM_STATIC_ASSERT(sizeof(NIM_BOOL) == 1, ""); // check whether really needed
      | ^~~~~~~~~~~~~~~~~
Command failed: ./bin/nim c koch
Exit code: 1
Error: Failed to build nim: command execution failed

@Araq Maybe you could help here and give a hint, what may be going wrong? Notice that initially I had this error with older version of csources, but not with new ones: #19914 (comment)
However I get it now after csources are successfully built.

[esafak]

As the author of #13798. I think @timotheecour may be able to help.