-
Notifications
You must be signed in to change notification settings - Fork 224
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Jetpack 2.3 #1
Comments
That file should have been created during the cmake configuration step. Can you check if it exists in |
That file, and the TH/THC subfolders aren't there. But, everything else is. I didn't see any error messages when I did the cmake configuration step. It did take a good while, but nothing unexpected. |
Yeah actually the root error is earlier in the cmake phase - typing in by hand since Firefox on 2.3 crashes
The later error is likely a result of this failure. |
Thanks Dusty,
The earlier errors are variations of "cc: internal compiler error: Killed (program cc1plus)" (this is after a reboot) - lots of killed programs while it's trying to build. Usually these occur from some OS issue like limited RAM. So hum. I'm also getting a killed Firefox, is there some resource limitation in 2.3 causing all these kills? Otherwise, to try and rebuild is all I need to do is remove the build directory correct? Thanks - |
It appears in a torch.cudnn package update unrelated to 2.3, where a directive was added to compile in parallel with make -J3. Will try patching back to -J1 to reduce the memory usage. |
Hi Dustin, any luck? |
OK, I was able to get it building again by patching cutorch rockspec in commit |
The only way I was able to get cmake to work correctly was to do what Dustin recommended. Doing this was a bit tricky though. What it requires is modifying the cutorch-scm-1.rockspec file under build/cutorch/rocks, and then you have to make it read only. If you don't make it read only it ends up being over-written. The lines I modified were Line 27 where I changed jopts=1 It's likely not the best way to do it, but it got the job done. Summary of steps As to firefox it's my understanding it doesn't work with Jetpack 2.3 Edit - The latest commit accomplishes the same thing. But, for some reason I didn't have to create a mounting swap. |
I did verify in the build log, that cutorch was Since all of the files are self-contained within the build/ directory, torch/ect. doesn't need compiled from source for each Jetson and could be copied around for JetPack 2.3. Also note that the torch repo is rolled back to a prior commit right now in the CMake script due to the issues mentioned from this post above. |
Thanks guys. Tried it last night and still get kills. I had logged out of the desktop to save memory but apparently I still need swap space. Dusty any issues with setting up swap? I'm not seeing a lot in a search other than I'd need to recompile the kernel, or has that changed now? |
You don't need to recompile L4T kernel, I followed these normal instructions: http://askubuntu.com/a/33703 To tell if it's successful, you should see swap memory appear in /proc/meminfo |
OK, I got a 32GB SDCard swap and SSD for building. The box thrashes so badly it's frozen up, but I was able to get a top page which shows some tens or hundreds of OK it got through the cmake! Now on doing a make it fails here ...
you guys didn't get this error? |
It's because cutorch was updated since my last comment - see cutorch commit 44c5193. In master, I commented out that line now 32cb67c. |
It works! Thanks Dusty, neat little program |
I could never get this working for JetPack 2.3. The 'cmake' works, but doing 'make' ends up producing the fatal error: "THC/THC.h: No such file or directory. I even tried downloading the pre-built archive 'L4T-R24.2-RC1'. Executing ./deepRL-console hello.lua throws "libluajit.so: cannot open shared object file: No such file or directory. Should I just go back to JetPack 2.2? |
OK, I've updated master to build again with latest Torch changes. If you try cloning the repo again, it should work. If you still get the THC/THC.h error, please confirm that Regarding the pre-built archive, does it work if you extract the contents as |
The pre-built archive worked once it was executed within the directory you specified above. I was doing it out of /home/ubuntu/jetson-inference. Running the demo I noticed after 400 epochs the wins dramatically decreased from .90 to .50. By 1200 it was back to .90. But then dropped sharply again. Once the algorithm learns, why can't it maintain a high percentage of wins? |
@AerialRobotics yeah I noticed this too, have been meaning to dig into the reason. First guess is overfitting and I was going to try saving the model when it reaches 90%+, then switch to inference. |
@AerialRobotics I think the reason cause your problem is the memory size. As the talk above, you can add swap. For me, 12GB swap is OK. |
Compiling under Jetpack 2.3 resulted in the following error.
deepQLearner.cpp:13:18: fatal error: luat.h: No such file or directory.
I did try the pre-built package for Jetpack 2.2, and that seemed to run fine.
The text was updated successfully, but these errors were encountered: