parallel build issue #536
Comments
|
@p3x-robot |
|
so -j1 means 2 cores? just kinda weird, i tought 2 cores means -j2, but i suppose then -j1 means 0 and 1 - eg 2? |
|
the problem is, that when i build multiple cores in openwrt (when i build all packages), except for nodejs it works, because it knows about the dependencies, is it possible to add all packages to have a dependencies so that npm should be have a dependecies on node and the rest should be have dependencies on nodejs and npm, because then it would works with multiple cores, right now my problem is that my build would take 4 hours, but because this nodejs repo is not using these dependencies , it tries to build for example node-cpx before npm or nodejs is available so it gives an error. |
|
To build node-cpx, you need npm of host build. It may not be possible to build npm packages until npm can build it. |
|
but can i somehow add a dependencies (nodejs, npm) on all these nodejs packages as a dependencies, because when i try to build with multiple cores/jobs it will throw an error because it starts to build any eg node-cpx, because nodejs and npm is not built. if i would add these packages as a dependency on nodejs and npm, then the multiple jobs would work, do you know what i mean? right now because it only works with 1 job, i would like to build the node feeds with multiple jobs. can we transform it the packages to be a dependencies of nodejs and npm? do you know what i mean? |
|
The dependencies are explicitly described in the Makefile of npm modules. |
|
i see, but for some reason it is not working, maybe the node/host is built, but the npm is not built still, can we add the dependency for npm as well? |
|
i see the error on the multiple jobs it is missing NPM... that is my issue |
|
do you want to show me what the error is? |
|
Yes Please. |
|
ok, i am sending it to you , now building |
|
here are the errors, it is missing the npm: |
|
Oh! understood. |
|
would you tell me when it is working? then i would try to build with multiple jobs? no rush, just asking. |
|
@p3x-robot |
|
building |
|
now, it is a different problem: |
|
what is good, that now it builds node and npm (the log is growing still), but it is weird why it is still not working perfectly like all dependencies (all other packages). before, it was building node-browserify and node-cpx without even having a node folder. |
|
in the node folder what is happening is there are to log files: the host-compile.txt is done: but for the compile.txt is still growing, it is still at some point: do you have an idea why it is happening? |
|
the log error.txt file right now looks like this: |
|
now finally, the node compile.txt is ready, now i am expecting the new packages should work: |
|
the rest as it works as i was doing it in serial, but instead of 17 hours it took 4 hours... |
|
https://cdn.corifeus.com/openwrt/18.06.4/targets/mvebu/error-packages.txt - you can see were serial and no npm host job error
|
|
but how come it is still not building? some host compile error: And it builds before node is totally built. I can se the log the node compile.txt is still growing and that why is has a host failed to build. that is the question. when i build serially it works 100%. |
|
i think you did not look at my comments careful. i run 4 jobs and it is still compiling node , when it start building |
|
I changed the part that seems to be related. |
|
ok, building, thanks |
|
weird, same error:
NODEJS: the host-compile is done at 08:06 AM, but the compile is actually is done at 09:08 AM: |
nxhack
changed the title
|
Please show me detailed log on the construction of "node-cpx". |
|
ok, i deleted, but i am sending you in about 2-3 hours. |
|
ok, same result. what is see is happening is, that there are 2 logs for node: how can we trigger to build the node/compile.txt before it starts the node-cpx and the other, here is the log, but it is the same, but in the package error.txt is shows it is a host error: error.txt node-browserfy node-cpx: |
|
hmm
I will check it |
|
i installed this package on my workstation and i get tons of warning of Is in it something with the rename that is not working with the building? |
|
I did not found root cause, but I changed a little. Please test if you can. |
|
building |
|
ok, the so does the only thing i did, i used 6 cores, instead of 4... now, only https://cdn.corifeus.com/openwrt/18.06.4/targets/mvebu/error-packages.txt |
|
it does not make sense as the node-cpx and node-browserify Makefile is almost identical. |
|
Thank you for the test. |
|
with 8 cores, an no host error: |
|
this package is perfect, i used 9 jobs and no host error at all. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
eg.
make V=svsmake V=s -j8The text was updated successfully, but these errors were encountered: