Running make in parallel always results in build failure

[Brainiarc7]

Hello there,

The build always fails when running make in parallel.
Please investigate.

An example, building from a workspace:

cd ~/intel-compute-runtime/workspace/build_igc
cmake ../igc/IGC
time make -j$(nproc) VERBOSE=1

This will fail. However, substituting the make process with -j explicitly set to 1 will result in a successful build.

[iwwu]

I did the build on latest IGC yesterday, then realized my nproc is 1. I will find another system to try again.

[Brainiarc7]

Sure, please do.

…

On Thu, 9 May 2019 at 20:58, iwwu ***@***.***> wrote: I did the build on latest IGC yesterday, then realized my nproc is 1. I will find another system to try again. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#89 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAR7NB5IOGMYXI6MQ4NQAZTPURQ53ANCNFSM4HJSRNOA> .

[iwwu]

@Brainiarc7 Can you provide the failing message? Does "make -j$(nproc)" work for you?

[Brainiarc7]

On my system, no.
nproc returns 12 (as I have an i7 8750H).
I'll provide the log when the system is up and running.

[iwwu]

@Brainiarc7 Are you running on ubuntu 18 LTS? Please provide your system information. Thanks.

[Brainiarc7]

Yes, I’m on Ubuntu 18.04 LTS

…

On Mon, 13 May 2019 at 23:57, iwwu ***@***.***> wrote: @Brainiarc7 <https://github.com/Brainiarc7> Are you running on ubuntu 18 LTS? Please provide your system information. Thanks. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#89?email_source=notifications&email_token=AAR7NB6UQJ4KDGUOUTK2E73PVHI33A5CNFSM4HJSRNOKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVJRHVI#issuecomment-491983829>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAR7NB6KXHSV76BE3ZRO5BLPVHI33ANCNFSM4HJSRNOA> .

[Brainiarc7]

See this:

Kernel:

uname -r 
5.1.0

OS:

lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 18.04.2 LTS
Release:	18.04
Codename:	bionic

Processor count:

nproc
12

GCC:

gcc --version
gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Clang:

clang-4.0 --version
clang version 4.0.1-10 (tags/RELEASE_401/final)
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin

[paigeale]

Hello Brainiarc7,

Could you try the tip of igc? With running the following commands

cd build
cmake -DVME_TYPES_DEFINED=FALSE ../igc/IGC
make -j12

I ran the following commands with 16 processors and was able to build IGC. If you still get an error please add a snippet of your error message.

Thanks,
Alex

[Brainiarc7]

Will do shortly, thanks.

[Brainiarc7]

Hey there @paigeale ,

Doing so results in a build failure, using the current git tip:

/usr/bin/ranlib ../Release/libCompiler.a
make[2]: Leaving directory '/home/brainiarc7/intel-compute-runtime/workspace/build_igc'
[ 96%] Built target Compiler
make[1]: Leaving directory '/home/brainiarc7/intel-compute-runtime/workspace/build_igc'
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

real	16m54.833s
user	190m28.350s
sys	8m31.129s

The failing point is:

[ 80%] BiF: "IBiF_PreRelease_int.bc": Compiling OpenCL source: "IBIF_PreRelease_Impl.cl"
cd /home/brainiarc7/intel-compute-runtime/workspace/build_igc/BiFModule && /usr/bin/cmake -E make_directory /home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/.
cd /home/brainiarc7/intel-compute-runtime/workspace/build_igc/BiFModule && ../Release/clang/linux-ubuntu64/clang -cc1 -x cl -fblocks -fpreserve-vec3-type -opencl-builtins -triple=spir64 -w -emit-llvm-bc -o /home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./IBiF_PreRelease_int.bc_IBIF_PreRelease_Impl__cl__0.bc.tmp -include /home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/clang/linux-ubuntu64/opencl-c.h -include /home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h -I /home/brainiarc7/intel-compute-runtime/workspace/igc/IGC/BiFModule/Languages/OpenCL -I /home/brainiarc7/intel-compute-runtime/workspace/igc/IGC/BiFModule/Languages/OpenCL/PointerSize -I /home/brainiarc7/intel-compute-runtime/workspace/igc/IGC/BiFModule/Headers -I /home/brainiarc7/intel-compute-runtime/workspace/igc/IGC/BiFModule/../AdaptorOCL/ocl_igc_shared/device_enqueue -D__EXECUTION_MODEL_DEBUG=1 -D__OPENCL_C_VERSION__=200 -D__IGC_BUILD__ -Dcl_khr_f16 -Dcl_khrfp64 -Dcl_khr_gl_msaa_sharing -Dcl_khr_mipmap_image -Dcl_khr_depth_images -Dcl_intel_subgroups_short -Dcl_intel_subgroups_char -Dcl_intel_subgroups_long -Dcl_intel_64bit_global_atomics_placeholder -Dcl_intel_device_side_avc_vme_enable -cl-std=CL2.0 /home/brainiarc7/intel-compute-runtime/workspace/igc/IGC/BiFModule/Languages/OpenCL/PreRelease/IBIF_PreRelease_Impl.cl
In file included from <built-in>:2:
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6866:61: error: typedef redefinition with different types ('struct intel_sub_group_avc_mce_payload_t *' vs 'intel_sub_group_avc_mce_payload_t')
typedef __private struct intel_sub_group_avc_mce_payload_t* intel_sub_group_avc_mce_payload_t;
                                                            ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6869:61: error: typedef redefinition with different types ('struct intel_sub_group_avc_ime_payload_t *' vs 'intel_sub_group_avc_ime_payload_t')
typedef __private struct intel_sub_group_avc_ime_payload_t* intel_sub_group_avc_ime_payload_t;
                                                            ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6872:61: error: typedef redefinition with different types ('struct intel_sub_group_avc_ref_payload_t *' vs 'intel_sub_group_avc_ref_payload_t')
typedef __private struct intel_sub_group_avc_ref_payload_t* intel_sub_group_avc_ref_payload_t;
                                                            ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6875:61: error: typedef redefinition with different types ('struct intel_sub_group_avc_sic_payload_t *' vs 'intel_sub_group_avc_sic_payload_t')
typedef __private struct intel_sub_group_avc_sic_payload_t* intel_sub_group_avc_sic_payload_t;
                                                            ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6881:60: error: typedef redefinition with different types ('struct intel_sub_group_avc_mce_result_t *' vs 'intel_sub_group_avc_mce_result_t')
typedef __private struct intel_sub_group_avc_mce_result_t* intel_sub_group_avc_mce_result_t;
                                                           ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6884:60: error: typedef redefinition with different types ('struct intel_sub_group_avc_ime_result_t *' vs 'intel_sub_group_avc_ime_result_t')
typedef __private struct intel_sub_group_avc_ime_result_t* intel_sub_group_avc_ime_result_t;
                                                           ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6887:87: error: typedef redefinition with different types ('struct intel_sub_group_avc_ime_result_single_reference_streamout_t *' vs 'intel_sub_group_avc_ime_result_single_reference_streamout_t')
typedef __private struct intel_sub_group_avc_ime_result_single_reference_streamout_t* intel_sub_group_avc_ime_result_single_reference_streamout_t;
                                                                                      ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6890:85: error: typedef redefinition with different types ('struct intel_sub_group_avc_ime_result_dual_reference_streamout_t *' vs 'intel_sub_group_avc_ime_result_dual_reference_streamout_t')
typedef __private struct intel_sub_group_avc_ime_result_dual_reference_streamout_t* intel_sub_group_avc_ime_result_dual_reference_streamout_t;
                                                                                    ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6893:79: error: typedef redefinition with different types ('struct intel_sub_group_avc_ime_single_reference_streamin_t *' vs 'intel_sub_group_avc_ime_single_reference_streamin_t')
typedef __private struct intel_sub_group_avc_ime_single_reference_streamin_t* intel_sub_group_avc_ime_single_reference_streamin_t;
                                                                              ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6896:77: error: typedef redefinition with different types ('struct intel_sub_group_avc_ime_dual_reference_streamin_t *' vs 'intel_sub_group_avc_ime_dual_reference_streamin_t')
typedef __private struct intel_sub_group_avc_ime_dual_reference_streamin_t* intel_sub_group_avc_ime_dual_reference_streamin_t;
                                                                            ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6899:60: error: typedef redefinition with different types ('struct intel_sub_group_avc_ref_result_t *' vs 'intel_sub_group_avc_ref_result_t')
typedef __private struct intel_sub_group_avc_ref_result_t* intel_sub_group_avc_ref_result_t;
                                                           ^
/home/brainiarc7/intel-compute-runtime/workspace/build_igc/Release/bif/./opencl_cth.h:6902:60: error: typedef redefinition with different types ('struct intel_sub_group_avc_sic_result_t *' vs 'intel_sub_group_avc_sic_result_t')
typedef __private struct intel_sub_group_avc_sic_result_t* intel_sub_group_avc_sic_result_t;
                                                           ^
12 errors generated.
BiFModule/CMakeFiles/BiFModuleOcl.dir/build.make:2265: recipe for target 'Release/bif/IBiF_PreRelease_int.bc_IBIF_PreRelease_Impl__cl__0.bc.tmp' failed
make[2]: *** [Release/bif/IBiF_PreRelease_int.bc_IBIF_PreRelease_Impl__cl__0.bc.tmp] Error 1
make[2]: Leaving directory '/home/brainiarc7/intel-compute-runtime/workspace/build_igc'
CMakeFiles/Makefile2:24801: recipe for target 'BiFModule/CMakeFiles/BiFModuleOcl.dir/all' failed
make[1]: *** [BiFModule/CMakeFiles/BiFModuleOcl.dir/all] Error 2
make[1]: Leaving directory '/home/brainiarc7/intel-compute-runtime/workspace/build_igc'
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

[paigeale]

Hey @Brainiarc7 ,

So the -DVME_TYPES_DEFINED=FALSE didn't work for you (you can remove that). I thought you may be missing some vme libraries but you are not. Could you attach the failing log prior to making the CMake change?

[Brainiarc7]

Yes, indeed it broke the build. Omitting that option on the current git tip resulted in a working build. The log posted prior is identical to the one I received before. A commit must have fixed my issue shortly afterwards. I'll now mark this as closed.

…

On Tue, 21 May 2019 at 19:48, Alex Paige ***@***.***> wrote: Hey @Brainiarc7 <https://github.com/Brainiarc7> , So the -DVME_TYPES_DEFINED=FALSE didn't work for you (you can remove that). I thought you may be missing some vme libraries but you are not. Could you attach the failing log prior to making the CMake change? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#89?email_source=notifications&email_token=AAR7NBYC472UEDJOMYHRXZ3PWQRUVA5CNFSM4HJSRNOKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODV4QI4I#issuecomment-494470257>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAR7NB2FF2UZ6MUQEJKBNATPWQRUVANCNFSM4HJSRNOA> .

[paigeale]

Great to hear it is now working as expected. Please email me (email in profile) and let me know if you have any feedback on what would make this process easier in the future.

[Brainiarc7]

@paigeale thanks, I've followed up on the same via email.