[CR] CMake: update rules; add Linux install targets; add support for dev-builds; #11970

brezerk · 2015-04-10T08:16:31Z

Hi there.

I'd like to use QtCreator as dev env. But It seems like cmake scripts are outdated and require some updates.

However, currently cmake build is not upstream build system for the project...

So. Do you guys have any plans for build system migration? Does this activity will be helpful for you?

Psimage · 2015-04-10T09:52:23Z

Hi. Thanks for updating cmake build!
It would be definitely helpful for those who used to different development environment (e.g. I'm used to IntelliJ IDEA IDE since i'm from Java world so i want to try CLion as an IDE for C++ but it only supports CMake).

Psimage · 2015-04-10T09:54:39Z

src/lua/CMakeLists.txt

+ADD_CUSTOM_TARGET(
+	lua_bindings
+	COMMAND ${LUA_BINARY} generate_bindings.lua
+	BYPRODUCTS ${CMAKE_SOURCE_DIR}/src/lua/catabindings.cpp


BYPRODUCTS argument in ADD_CUSTOM_TARGET command requires CMake 3.2 but required version of CMake is set to 2.8

Removed, thanks.

Quoting the documentation:

The target has no output file and is ALWAYS CONSIDERED OUT OF DATE even if the commands try to create a file with the name of the target. Use ADD_CUSTOM_COMMAND to generate a file with dependencies.

And indeed, every time I run make, it recreates catabindings.cpp and recompiles and relinks it, which is at least a waste of time.

The standard Makefile has "$(LUA_DIR)/class_definitions.lua" and "$(LUASRC_DIR)/generate_bindings.lua" as explicit dependencies for regenerating the bindings.

yeah. ADD_CUSTOM_COMMAND seems to work just fine. thanks!

BevapDin · 2015-04-10T11:01:29Z

src/CMakeLists.txt


 # Required library linkage
-if(TILES)
+IF(TILES)
 	target_include_directories(cataclysm PUBLIC ${SDL2_INCLUDE_DIR})


Not your fault, but maybe it's time to increase the required cmake version? target_include_directories was added in cmake 2.8.11, required version is "only" 2.8.

Heah. We need to do something with this :) Thanks.

Since the build was broken before and nobody noticed in 15 days its probably safe to upgrade.

BevapDin · 2015-04-10T12:30:50Z

src/chkjson/CMakeLists.txt

+INCLUDE_DIRECTORIES( ${CMAKE_SOURCE_DIR}/src ${CMAKE_SOURCE_DIR}/src/chkjson )
+
+# Add the actual executable
+ADD_EXECUTABLE(chkjson ${CHKJSON_SOURCES} ${CHKJSON_HEADERS})


This adds the chkjson file to the "all" target and it's therefor made every time somebody runs make all. It's not a big thing (only 2 source files + linking), but the original Makefile has this as a separate target that has to be invoked explicitly.

Yeah. It seems like it is used only for debug/test purposes.
I'll move it to 'test' chain when will start it's implementation :)

BevapDin · 2015-04-10T12:32:42Z

make install does not install the gfx folder. According to the Makefile, it should be installed (only if TILES is defined) into $DATA_PREFIX, same place where font, json etc. goes.

brezerk · 2015-04-10T12:37:54Z

Fixed in: https://github.com/brezerk/Cataclysm-DDA/commit/b21dd954dd414bdac793e6d0dc50dd4443513695 :P

Btw: it seems like current source code does not able to run binary from arbitrary PREFIX_PATH directory? Or am I missing something?

brezerk · 2015-04-10T12:39:43Z

ah. I see:

398     DEFINES += -DPREFIX="$(PREFIX)"

BevapDin · 2015-04-10T12:43:42Z

There is another thing, cmake installs the content of the data folder to "./share/cataclysm-dda/data/", but it belongs into "./share/cataclysm-dda/" (there should be no data folder at all).

BevapDin · 2015-04-10T12:51:31Z

Btw: it seems like current source code does not able to run binary from arbitrary PREFIX_PATH directory? Or am I missing something?

I have CMAKE_INSTALL_PREFIX set to "/tmp/cataclysm" and can run the binary from there with ./bin/cataclysm --basepath . (after moving the contents of share/cataclysm-dda/data/ to share/cataclysm-dda/).

Edit: and now it works with the parameter, just ./bin/cataclysm is enough.

brezerk · 2015-04-10T12:59:31Z

Good catch, thanks! Updating build rules...

… dst;

brezerk · 2015-04-10T13:54:22Z

OK. It seems I will need to modify the source to be able to run binary from the cmake build directory:

[ himera ] brezerk@pts/4:1028 :( 1 ~/develop/Cataclysm-DDA-Fork/build $
cmake .. -DRELESE=OFF
--  build options --
-- Build  in development mode (RELEASE=ON) --
-- CMAKE_INSTALL_PREFIX          : /home/brezerk/develop/Cataclysm-DDA-Fork
-- Configuring done
-- Generating done
-- Build files have been written to: /home/brezerk/develop/Cataclysm-DDA-Fork/build

However trying to run it:

[ himera ] brezerk@pts/4:1029  ~/develop/Cataclysm-DDA-Fork/build $
./src/cataclysm
[ himera ] brezerk@pts/4:1030 :( 1 ~/develop/Cataclysm-DDA-Fork/build $

strace output:

close(4)                                = 0
open("/home/brezerk/.cataclysm-dda/config/fonts.json", O_RDONLY) = -1 ENOENT (No such file or directory)
open("\"/home/brezerk/develop/Cataclysm-DDA-Fork\"/share/cataclysm-dda/fontdata.json", O_RDONLY) = -1 ENOENT (No such file or directory)
write(3, "16:48:50.732 WARNING : opendir ["..., 142) = 142
stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2097, ...}) = 0

So it tries to look into 'share/cataclysm-dda'.
Will try to use -DRELEASE to control this.

… binary from cmake build directory;

brezerk · 2015-05-05T19:53:39Z

Ok. I was able to test both MSYS2: MinGW32 and MinGW64 bit using:

For MinGW32:

        $ cmake -G "MSYS Makefiles" \
                -DCMAKE_MAKE_PROGRAM=mingw32-make\
                -DCMAKE_C_COMPILER=i686-w64-mingw32-gcc\
                -DCMAKE_CXX_COMPILER=i686-w64-mingw32-g++\
                -DCMAKE_SYSTEM_PREFIX_PATH=/c/msys32/mingw32\
                ..
        $ mingw32-make

For MinGW64:

        $ cmake -G "MSYS Makefiles" \
                -DCMAKE_MAKE_PROGRAM=mingw32-make\
                -DCMAKE_C_COMPILER=x86_64-w64-mingw32-gcc\
                -DCMAKE_CXX_COMPILER=x86_64-w64-mingw32-g++\
                -DCMAKE_SYSTEM_PREFIX_PATH=/c/msys64/mingw64\
                ..
        $ mingw32-make

Compiles ok. ncurses version works as expected. The tiles one fails as expected :D

Small investigation showes that it do segfault on:

WinCreate () at Y:/Cataclysm-DDA-Fork/src/sdltiles.cpp:309

 308         renderer = SDL_CreateRenderer( window, -1, SDL_RENDERER_ACCELERATED |
 309                                        SDL_RENDERER_PRESENTVSYNC | SDL_RENDERER_TARGETTEXTURE );

SDL_RENDERER_ACCELERATED the renderer uses hardware acceleration

Not sure if my KVM has any hw accel... :D

LunaTheArcticFox · 2015-05-05T20:01:08Z

Not sure if my KVM has any hw accel... :D

I can test this out again when I get home for you.

brezerk · 2015-05-05T20:02:01Z

@KrazyTheFox It will be helpfull. thanks.

brezerk · 2015-05-05T20:28:03Z

Yeah. It seems like my assumption was correct.

I have modified config/options:SOFTWARE_RENDERING true

And now it works using sf renderer instead of hw one :)

kevingranade · 2015-05-05T20:54:25Z

Oh that, yes it's supposed to fall back to sw rendering if hw fails, but on some systems it crashes if you even try, hence the sw rendering option.

brezerk · 2015-05-06T10:04:28Z

In case, if some one wish to test Cataclysm-DDA cmake build scripts, here is doc COMPILING-CMAKE.md

LunaTheArcticFox · 2015-05-07T13:30:36Z

Using a fresh install of msys and a clean copy of Cataclysm, I was unable to compile a working version on Windows. I still needed to specify the libraries as in my previous compilation post when using cmake. It would successfully generate the makefile and when running make, it would build without errors. Upon trying to run either cataclysm.exe or cataclysm-tiles.exe, nothing would happen and I was unable to get either of the exes to generate any error messages.

macrosblackd · 2015-05-07T13:46:13Z

Did you install the deps with msys or manually?
On May 7, 2015 8:30 AM, "Mitchell Matthews" notifications@github.com
wrote:

Using a fresh install of msys and a clean copy of Cataclysm, I was unable
to compile a working version on Windows. I still needed to specify the
libraries as in my previous compilation post when using cmake. It would
successfully generate the makefile and when running make, it would build
without errors. Upon trying to run either cataclysm.exe or
cataclysm-tiles.exe, nothing would happen and I was unable to get either of
the exes to generate any error messages.

—
Reply to this email directly or view it on GitHub
#11970 (comment)
.

LunaTheArcticFox · 2015-05-07T15:16:28Z

Did you install the deps with msys or manually?

With msys.

macrosblackd · 2015-05-07T15:17:59Z

That's strange, I was able to build with cmake and it detected the
installed dependencies.

On 5/7/15, Mitchell Matthews notifications@github.com wrote:

Did you install the deps with msys or manually?

With msys.

Reply to this email directly or view it on GitHub:
#11970 (comment)

brezerk · 2015-05-08T13:20:14Z

@KrazyTheFox You are specifying archive libraries for !static build. I guess, this is the reason, why you are getting broken executables.

It is strange, b/c I had no need to specify the libraries manually...

Are you using mingw shell or msys2 shell to build the project?

LunaTheArcticFox · 2015-05-08T13:29:26Z

Msys 2 shell. I'll spin up a clean Windows vm today and try it in there to make sure I don't have something external messing it up.

brezerk · 2015-05-08T13:36:41Z

@KrazyTheFox If I understand it correctly, default "MSYS2 Shell" is used for pacman stuff.
I just checked, and it seems like it does not setup PATH for libraries/cmake/whatever for me too.

Can you try to build using "MinGW Win64 Shell" or "MinGW Win32 Shell" please?

LunaTheArcticFox · 2015-05-08T14:32:23Z

Using the MinGW32 shell did make it easier to build, but the problem wasn't that. I was building (or attempting to build) release versions with "-DRELEASE=1". When I switched that to "-DRELEASE=0" to build a debug build, it succeeded in building a working tiles build.

Edit: I'm able to build a release build that launches, however, when opened I get only a blank, black screen.

brezerk · 2015-05-08T15:08:33Z

@KrazyTheFox Yes, -DRELEASE=1 require you to place binary into game folder manually make install currently will now work for Windows (will fix this in the future).

Does ncurses version works? afik: the first CataclysmDDA start can take some time, while it read game data and create an cache?

Not sure, but can you try to build with -DUSE_HOME_DIR=OFF option set.

LunaTheArcticFox · 2015-05-08T15:41:58Z

@brezerk
I've moved the exe manually and placed all the required DLLs in the folder as needed. I'll give the curses version a try later as well as the home dir option, but for now I must go spend a large sum of money on an air conditioner since my HOA sucks. :( Should be able to test this out this evening.

LunaTheArcticFox · 2015-05-08T19:55:06Z

I've figured out the problems with the release builds. The .exe itself can be in any folder, but it expects the data/ folder to actually be located at C:\Program Files (x86)\CataclysmDDA\share\cataclysm-dda\. This is problematic, since the game can't access any of those files without running it as an Administrator and it also mean you'll need to copy those files manually with every update. The configuration directory it generates is in the correct place, ./config/. The debug build uses all relative paths as expected.

The exact cmake command run:

cmake -G "MSYS Makefiles" -DUSE_HOME_DIR=0 -DTILES=1 -DLOCALIZE=0 -DRELEASE=1 -DCMAKE_MAKE_PROGRAM=mingw32-make -DCMAKE_C_COMPILER=i686-w64-mingw32-gcc -DCMAKE_CXX_COMPILER=i686-w64-mingw32-g++ -DCMAKE_SYSTEM_PREFIX_PATH=/c/msys32/mingw32 ..

I will say thanks for helping me out with all this and getting a simpler build system up on Windows. It'll be very nice to not have to run Cataclysm in a VM!

brezerk · 2015-05-08T21:41:03Z

@KrazyTheFox thank you for your feedback.

-DPREFIX has no scene in case of WIN32 build, since it will hardcore data patch to CMAKE_INSTALL_PREFIX which is defaults to C:\Program Files (x86)\CataclysmDDA\share\cataclysm-dda\.

Fixed in: https://github.com/brezerk/Cataclysm-DDA/commit/6d0678c184c1793389e5a16fca5bc7af7eb48116

LunaTheArcticFox · 2015-05-09T01:08:34Z

@brezerk
Perfect! Just went through the whole set of instructions again to double check that things work. Built a release version that runs on Windows with almost no effort. Very nice!

brezerk added 3 commits April 10, 2015 10:45

some cmake updates

cd2cb83

Finalize and clenup POC; Fixup install dst; Add ZLAYER and USE_HOME_DIR;

56ab832

Add CMake rules for LUA target

2711340

Psimage reviewed Apr 10, 2015
View reviewed changes

brezerk added 4 commits April 10, 2015 13:09

Add chkjson target

f001929

Fixup hardcoded git binary :)

ab41bdc

Cleanup; Remove BYPRODUCTS since it require cmake 3.x

69ba133

fixup version.cmake

b56c7af

BevapDin reviewed Apr 10, 2015
View reviewed changes

brezerk added 3 commits April 10, 2015 14:43

Add data install

a2eed21

Add SILENT build-only option; Fixup idents;

b812106

Add data files install target; Add gfx install target;

b21dd95

BevapDin reviewed Apr 10, 2015
View reviewed changes

brezerk added 4 commits April 10, 2015 16:08

Add lang target; Fixup: Define PREFIX; Remove 'data' from DATA_PREFIX…

39a7c01

… dst;

Remove 'data' from gfx target as well

cd9905a

Rename DEBUG option to RELEASE; Add RELEASE defines;

cec5b42

Fixup cmake warning

0b18bf7

brezerk added 2 commits April 10, 2015 17:26

Fixup install target for RELEASE=ON; Add workaround to be able to run…

de3b470

… binary from cmake build directory;

Fixup WORKING_DIRECTORY for version.cmake in case of non tree build

a326ee7

Update INSTALL.txt

77455fc

brezerk added 4 commits May 6, 2015 12:32

Move INSTALL.txt -> COMPILING-CMAKE.md; Change to markdown syntax;

77b13c5

COMPILING-CMAKE.md: update Makrdown format

699546b

COMPILING-CMAKE.md: update Makrdown format (part2)

1912b01

COMPILING-CMAKE.md: add missing cmake build options descriptions

d62b9aa

brezerk changed the title ~~[CR][WIP] CMake: update rules; add Linux install targets; add support for dev-builds;~~ [CR] CMake: update rules; add Linux install targets; add support for dev-builds; May 6, 2015

brezerk added 2 commits May 9, 2015 00:34

Do not set -DPREFIX in case of WIN32 build

6d0678c

COMPILING-CMAKE.md: Update info for MSYS2 build

2cd2c05

kevingranade merged commit 2cd2c05 into CleverRaven:master May 9, 2015

brezerk deleted the improved_build_system branch May 9, 2015 08:18

Termineitor244 mentioned this pull request Apr 2, 2021

Remove references to an inexistent "INSTALL" file #48318

Closed

[CR] CMake: update rules; add Linux install targets; add support for dev-builds; #11970

[CR] CMake: update rules; add Linux install targets; add support for dev-builds; #11970

Conversation

brezerk commented Apr 10, 2015

Psimage commented Apr 10, 2015

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

BevapDin commented Apr 10, 2015

brezerk commented Apr 10, 2015

brezerk commented Apr 10, 2015

BevapDin commented Apr 10, 2015

BevapDin commented Apr 10, 2015

brezerk commented Apr 10, 2015

brezerk commented Apr 10, 2015

brezerk commented May 5, 2015

LunaTheArcticFox commented May 5, 2015

brezerk commented May 5, 2015

brezerk commented May 5, 2015

kevingranade commented May 5, 2015 via email

brezerk commented May 6, 2015

LunaTheArcticFox commented May 7, 2015

macrosblackd commented May 7, 2015

LunaTheArcticFox commented May 7, 2015

macrosblackd commented May 7, 2015

brezerk commented May 8, 2015

LunaTheArcticFox commented May 8, 2015

brezerk commented May 8, 2015

LunaTheArcticFox commented May 8, 2015

brezerk commented May 8, 2015

LunaTheArcticFox commented May 8, 2015

LunaTheArcticFox commented May 8, 2015

brezerk commented May 8, 2015

LunaTheArcticFox commented May 9, 2015