pathsAffectingAllModules will only be observed if the files are also unknown.
In our case, we have files which are associated with projects, but should also trigger all the builds.
See https://github.com/dropbox/AffectedModuleDetector/blob/main/affectedmoduledetector/src/main/kotlin/com/dropbox/affectedmoduledetector/AffectedModuleDetector.kt#L465