Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote build fails when submitted from Windows #2381

Closed
ghost opened this issue Mar 16, 2020 · 4 comments
Closed

Remote build fails when submitted from Windows #2381

ghost opened this issue Mar 16, 2020 · 4 comments
Labels

Comments

@ghost
Copy link

ghost commented Mar 16, 2020

Submitting an application with ContextTypes.STREAMING_ANALYTICS_SERVICE or ContextTypes.BUNDLE with remote build fails:

Exception in thread "main" java.lang.IllegalStateException: Error submitting archive for compilation:
"CDISP0095E ERROR: The following path was input, but is not the path to a directory: tk6258766762312045303"
"."
"make: *** [all] Error 1"
"CDISA5488E The 56347f51-ccf9-43fc-b265-9dbbfe5c9d9e build failed for the following domain: production-shared-2."

at com.ibm.streamsx.rest.AbstractStreamingAnalyticsService.buildAndSubmitJob(AbstractStreamingAnalyticsService.java:261)
at com.ibm.streamsx.topology.internal.context.remote.RemoteBuildAndSubmitRemoteContext.submitBuildArchive(RemoteBuildAndSubmitRemoteContext.java:76)
at com.ibm.streamsx.topology.internal.context.remote.RemoteBuildAndSubmitRemoteContext.submitBuildArchive(RemoteBuildAndSubmitRemoteContext.java:30)
at com.ibm.streamsx.topology.internal.context.remote.BuildRemoteContext._submit(BuildRemoteContext.java:63)
at com.ibm.streamsx.topology.internal.context.remote.RemoteContextImpl.submit(RemoteContextImpl.java:30)
at com.ibm.streamsx.topology.context.remote.RemoteContextSubmit.main(RemoteContextSubmit.java:38)

This behavior is observed only when the topology is submitted from Python under MS Windows.

@ghost ghost added the bug label Mar 16, 2020
@ghost ghost self-assigned this Mar 16, 2020
@ghost
Copy link
Author

ghost commented Mar 16, 2020

Windows: generated manifest_tk.txt has CRLF at end of lines. This causes the above error in the following shell command in the makefile:

        @set -e; for toolkit in `/bin/cat manifest_tk.txt`; do \
                if [ -d $${toolkit}/opt/python/streams ]; then \
                        PYTHONUSERBASE=${OUT_PY} python3 com.ibm.streamsx.topology/bin/spl-python-extract.py -i $${toolkit};\
                fi; \
                ${STREAMS_INSTALL}/bin/spl-make-toolkit -i $${toolkit}; \
        done;

The file must be generated with LF as line separator.

@ghost
Copy link
Author

ghost commented Mar 16, 2020

To create the artifacts, PrintWriter.println(...); is used, which terminates the line with the line separator string, which is defined by the system property line.separator, and which is not necessarily a single newline character ('\n'). It must be a Linux line separator as the files are processed by a Linux system.

@natashadsilva
Copy link
Member

I am having the same problem too.

@ghost
Copy link
Author

ghost commented Mar 17, 2020

resolved with 1.14.11 release

@ghost ghost closed this as completed Mar 17, 2020
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant