Incremental compilation support for modules

[waruqi]

Xmake Version

2.7.2

Operating System Version and Architecture

ubuntu

Describe Bug

Modifying headers doesn't trigger recompiling; #2961

we can test it in user_headerunits test.

• xxx.mpp cannot generate deps with header
  • gcc
  • clang
  • msvc
• we need improve to parse header file from xxx.gcm.d and xxx.cpp.o.d if it contains modules
  • gcc
  • clang
  • msvc
• ccache will also affect incremental compilation (disabled)
  • object
  • fix dependfile

Expected Behavior

..

Project Configuration

No response

Additional Information and Error Logs

No response

[waruqi]

we need improve to parse include deps with modules.

gcc

hello.gcm.d

build/.objs/src/hello.mpp.o  /modules/cache/hello.gcm:  src/hello.mpp\
build/.objs/src/hello.mpp.o  /modules/cache/hello.gcm:  ./src/header.hpp.c++m\
hello.c++m:  /modules/cache/hello.gcm\
.PHONY: hello.c++m\
/modules/cache/hello.gcm:|  build/.objs/src/hello.mpp.o\
CXX_IMPORTS += ./src/header.hpp.c++m

I really don't understand this include dependency format of gcc. what's :|?
😐

main.cpp.d

build/.objs/user_headerunit/linux/x86_64/release/src/main.cpp.o:  src/main.cpp\
build/.objs/user_headerunit/linux/x86_64/release/src/main.cpp.o:  ./src/header.hpp.c++m hello.c++m\
CXX_IMPORTS += ./src/header.hpp.c++m hello.c++m\

without modules

main.o: src/main.cpp src/interface.h\

clang

main.cpp.o.d

build/.objs/hello/linux/x86_64/release/src/main.cpp.o:   build/.gens/hello/linux/x86_64/release/rules/modules/cache/hello.pcm   /usr/lib/llvm-15/lib/clang/15.0.2/include/module.modulemap   src/main.cpp\

hello.pcm.d

build/.gens/hello/linux/x86_64/release/rules/modules/cache/hello.pcm:   /usr/lib/llvm-15/lib/clang/15.0.2/include/module.modulemap   src/hello.mpp\

msvc

main.cpp.o.d

{
    "Version": "1.2",
    "Data": {
        "Source": "c:\users\ruki\desktop\user_headerunit\src\main.cpp",
        "ProvidedModule": "",
        "Includes": [],
        "ImportedModules": [
            {
                "Name": "hello",
                "BMI": "c:\users\ruki\desktop\user_headerunit\src\hello.ifc"
            }
        ],
        "ImportedHeaderUnits": [
            {
                "Header": "c:\users\ruki\desktop\user_headerunit\src\header.hpp",
                "BMI": "c:\users\ruki\desktop\user_headerunit\src\header.hpp.ifc"
            }
        ]
    }
}

[waruqi]

we need parse CXX_IMPORTS += ./src/header.hpp.c++m for gcc/deps.

[barcharcraz]

we need improve to parse include deps with modules.

gcc

hello.gcm.d

build/.objs/src/hello.mpp.o  /modules/cache/hello.gcm:  src/hello.mpp\
build/.objs/src/hello.mpp.o  /modules/cache/hello.gcm:  ./src/header.hpp.c++m\
hello.c++m:  /modules/cache/hello.gcm\
.PHONY: hello.c++m\
/modules/cache/hello.gcm:|  build/.objs/src/hello.mpp.o\
CXX_IMPORTS += ./src/header.hpp.c++m

I really don't understand this include dependency format of gcc. what's :|? neutral_face

That's an order only dependency, it just means hello.gcm must be built after hello.mpp.o, but need not be rebuilt if it's older than hello.mpp.o.

[waruqi]

we need improve to parse include deps with modules.

gcc

hello.gcm.d

build/.objs/src/hello.mpp.o  /modules/cache/hello.gcm:  src/hello.mpp\
build/.objs/src/hello.mpp.o  /modules/cache/hello.gcm:  ./src/header.hpp.c++m\
hello.c++m:  /modules/cache/hello.gcm\
.PHONY: hello.c++m\
/modules/cache/hello.gcm:|  build/.objs/src/hello.mpp.o\
CXX_IMPORTS += ./src/header.hpp.c++m

I really don't understand this include dependency format of gcc. what's :|? neutral_face

That's an order only dependency, it just means hello.gcm must be built after hello.mpp.o, but need not be rebuilt if it's older than hello.mpp.o.

Got it, thanks!