Failed to do native link in Scala 2.13.8 with Scala Native 0.4.2

[sequencer]

Here is my repository:
https://github.com/sequencer/gitakc
When I build with mill and clang from Arch Linux repo.
I got this error message:

1 targets failed
gitakc.native[2.13.8].nativeLink java.lang.ClassCastException: class scala.scalanative.linker.Unavailable cannot be cast to class scala.scalanative.linker.ScopeInfo (scala.scalanative.linker.Unavailable and scala.scalanative.linker.ScopeInfo are in unnamed module of loader mill.api.ClassLoader$$anon$1 @96e44d8)
    scala.scalanative.linker.Reach.fallback$1(Reach.scala:120)
    scala.scalanative.linker.Reach.$anonfun$lookup$8(Reach.scala:132)
    scala.Option.orElse(Option.scala:447)
    scala.scalanative.linker.Reach.lookup(Reach.scala:132)
    scala.scalanative.linker.Reach.reachDefn(Reach.scala:176)
    scala.scalanative.linker.Reach.process(Reach.scala:140)
    scala.scalanative.linker.Reach$.apply(Reach.scala:876)
    scala.scalanative.linker.Link$.apply(Link.scala:13)
    scala.scalanative.build.ScalaNative$.$anonfun$link$1(ScalaNative.scala:35)
    scala.scalanative.build.Logger.time(Logger.scala:35)
    scala.scalanative.build.Logger.time$(Logger.scala:32)
    scala.scalanative.build.Logger$$anon$3.time(Logger.scala:88)
    scala.scalanative.build.ScalaNative$.link(ScalaNative.scala:35)
    scala.scalanative.build.Build$.$anonfun$build$1(Build.scala:65)
    scala.scalanative.build.Logger.time(Logger.scala:35)
    scala.scalanative.build.Logger.time$(Logger.scala:32)
    scala.scalanative.build.Logger$$anon$3.time(Logger.scala:88)
    scala.scalanative.build.Build$.build(Build.scala:55)
    mill.scalanativelib.worker.ScalaNativeWorkerImpl.nativeLink(ScalaNativeWorkerImpl.scala:69)
    mill.scalanativelib.ScalaNativeModule.$anonfun$nativeLink$2(ScalaNativeModule.scala:164)
    mill.define.ApplyerGenerated.$anonfun$zipMap$1(ApplicativeGenerated.scala:5)
    mill.define.Task$MappedDest.evaluate(Task.scala:396)

I think this might be a bug in Scala Native, but not familiar with Scala Native, so seeking for some help from upstream.

[ekrich]

Hi @sequencer , Thanks for the report and working with Scala Native.

Scala Native has to be released to support 2.13.8 and only the latest release 0.4.3-RC2 supports this Scala Version. v0.4.3-RC1...v0.4.3-RC2

The good thing about 0.4.3-RC2 is that it also supports Scala 3.

[WojciechMazur]

Actually, 2.13.8 was pack-published for 0.4.1 and 0.4.2, however, it contained some bugs leading to incorrect reporting of missing methods/classes. I probably should be already fixed in the latest 0.4.3 release, or at least we should be able to see which JDK methods are missing now

[WojciechMazur]

I've tried to reproduce your issue with 0.4.3. After dropping parallel-collections dependency (which cannot be supported until multithreading support would be introduced) it compiles just fine.
In the ReleaseFull mode it was taking too much time, but in ReleaseFast works, it compiles and works just fine. Also in most cases, it's better to use LTO.thin instead of the legacy LTO.full.

A quick note - mill seems to need version 0.10.0 or higher to work with 0.4.3, due to the changes in how main method is resolved. Apparently it does not check which version of Scala Native is being used

[sequencer]

@WojciechMazur Thanks for your investigation(and sorry for the delay response): I tried it today but with no luck, I'm using mill 0.10.0(also tried the latest release from mill GitHub release).
In my native branch, when running:

mill gitakc.native[2.13.8].nativeLink

Here is the error I came across:

[67/67] gitakc.native[2.13.8].nativeLink
[error] Found 43 missing definitions while linking
[error] Not found Top(geny.Writable$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:37
[error] Not found Top(geny.Writable$StringWritable)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:37
[error] Not found Top(os.Path)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.Path$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:13
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:17
[error] Not found Top(os.PathChunk)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.PathChunk$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:14
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:19
[error] Not found Top(os.PathChunk$StringPathChunk)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.PathConvertible)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.PathConvertible$StringConvertible$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:13
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:17
[error] Not found Top(os.PermSet)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.ReadablePath)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.Source)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.Source$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:37
[error] Not found Top(os.Source$WritableSource)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(os.isFile$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:27
[error] Not found Top(os.makeDir$all$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:21
[error] Not found Top(os.mtime$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:29
[error] Not found Top(os.package$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:14
[error] Not found Top(os.read$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:10
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:41
[error] Not found Top(os.write$over$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:33
[error] Not found Top(sttp.client3.RequestT)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.client3.Response)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.client3.SttpApi)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.client3.SttpBackend)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.client3.quick$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.model.Uri)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.model.UriInterpolator)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(sttp.model.UriInterpolator$UriContext)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:36
[error] Not found Top(ujson.Readable)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(ujson.Readable$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:10
[error] Not found Top(ujson.Readable$fromTransformer)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(upickle.Api)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(upickle.core.Types)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:3
[error] Not found Top(upickle.core.Types$CaseR)
[error] Not found Member(Top(upickle.core.Types$CaseR),RL18upickle.core.TypesE)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:4
[error] Not found Top(upickle.core.Types$CaseW)
[error] Not found Member(Top(upickle.core.Types$CaseW),D6$init$uEO)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:4
[error] Not found Top(upickle.core.Types$ReadWriter)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(upickle.core.Types$ReadWriter$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:3
[error] Not found Top(upickle.core.Types$Reader)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:8
[error] Not found Top(upickle.core.Types$Writer)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:3
[error] Not found Member(Top(upickle.core.Types$Writer),D6$init$uEO)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:4
[error] Not found Top(upickle.default$)
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:4
[error]         at /home/sequencer/gitakc/gitakc/src/gitakc.scala:9
1 targets failed
gitakc.native[2.13.8].nativeLink scala.scalanative.linker.LinkingException: Undefined definitions found in reachability phase
    scala.scalanative.linker.Reach.fail(Reach.scala:976)
    scala.scalanative.linker.Reach.reportMissing(Reach.scala:971)
    scala.scalanative.linker.Reach.result(Reach.scala:47)
    scala.scalanative.linker.Reach$.apply(Reach.scala:989)
    scala.scalanative.linker.Link$.apply(Link.scala:13)
    scala.scalanative.build.ScalaNative$.$anonfun$link$1(ScalaNative.scala:32)
    scala.scalanative.build.Logger.time(Logger.scala:35)
    scala.scalanative.build.Logger.time$(Logger.scala:32)
    scala.scalanative.build.Logger$$anon$3.time(Logger.scala:88)
    scala.scalanative.build.ScalaNative$.link(ScalaNative.scala:32)
    scala.scalanative.build.Build$.$anonfun$build$1(Build.scala:65)
    scala.scalanative.build.Logger.time(Logger.scala:35)
    scala.scalanative.build.Logger.time$(Logger.scala:32)
    scala.scalanative.build.Logger$$anon$3.time(Logger.scala:88)
    scala.scalanative.build.Build$.build(Build.scala:55)
    mill.scalanativelib.worker.ScalaNativeWorkerImpl.nativeLink(ScalaNativeWorkerImpl.scala:84)
    mill.scalanativelib.ScalaNativeModule.$anonfun$nativeLink$2(ScalaNativeModule.scala:196)
    mill.define.Task$TraverseCtx.evaluate(Task.scala:376)

I'm not familiar with Scala Native, so have no idea how to figure out the bug here.(I thought I might need blame to linker?)

[WojciechMazur]

For Scala Native similarly as in Scala.js you need to use special version of library published with additional files - they hava a native of sjs suffix accordingly. Sbt automatically adds this suffix when using %%% to define dependencies. If I remember correctly in mill you use should use :::: for cross platform deps instead of :::

[sequencer]

Thanks! @WojciechMazur, it works now!