Missing symbols in official Windows TensorFlow native builds

[karllessard]

Hi, we (SIG-JVM) are trying to leverage the Windows C Library builds available under https://storage.googleapis.com/tensorflow/libtensorflow/ which, I think, are built by Google.

Starting from TF 2.14.x, these builds are broken because they do not export the TSL symbols required by the TensorFlow C API.

Here is the list of missing symbols that we (TF Java) do depend on:

jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_DeleteStatus
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_SetStatus
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_SetStatusFromIOError
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_Status
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_Message
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_ForEachPayload
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_NewStatus
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_GetCode
jnitensorflow.obj : error LNK2001: unresolved external symbol TSL_SetPayload

Can someone look at this please? (modifié)

[angerson]

It seems like Intel has fixed something related that will land in 2.16: #61830

Does that help?

[karllessard]

Thanks @angerson , the ticket seems to talk about the missing include folders (which we've also noticed but found a workaround for), though it does not mention anything about the non-exported symbols in the binaries. Is there a nightly build of 2.16 of the C API for Windows I can quickly test on?

[karllessard]

Is there any Windows build available in the libtensorflow-nightly bucket?

[nitins17]

Is there any Windows build available in the libtensorflow-nightly bucket?

The latest nightly libtensorflow archive for Windows can be found here.

[karllessard]

Thanks @nitins17 , we just checked and while the nightly builds do have some of the TSL headers, the TSL_ symbols are still missing from the binaries. cc\ @angerson

[karllessard]

Any updates about this/any PR coming soon? Thanks!

[mraunak]

Hi @karllessard, PR is in progress, will have it merged to master within a couple of days.

[karllessard]

Adding a reference to this comment here as well, problem is still not fixed after merging #62874: #62874 (comment)

[nitins17]

Can you provide a short reproducible code snippet for this?

[karllessard]

I can work on a something yes, though I don't have myself a Windows machine and it may take me some time. Meanwhile, you can look at our CI/CD where our own build (TF Java) is failing: https://github.com/tensorflow/java/actions/runs/7777626622/job/21206146416#step:6:1655 (compiler command is here).

All other platforms (linux, macos) succeed to link successfully to the C lib, including to TSL symbols.

[karllessard]

Just to highlight here that it would be great to have this fix ready for the 2.16 cut, so that TF Java can continue to support Windows properly in its forthcoming next release.