Long build time from source

[bilelomrani1]

I am trying to install the server locally without Docker on an NVIDIA A100. The build command BUILD_EXTENSIONS=True make install seems to take a very long time (> 6hours). Is it expected? What is the typical build time?

[OlivierDehaene]

No that's not normal, especially if you are not installing flash attention. You can install ninja-build to speed up build times.

[bilelomrani1]

Sorry, now I recall more precisely the issue that I encountered: BUILD_EXTENSIONS=True make install worked correctly but the server complained that the flash attention wasn't installed. So I ran cd server && make install and this was the part that took a long time to run.

[OlivierDehaene]

Yes you should really install ninja-build either with pip install ninja or apt-get install ninja-build