Iterating all projects has serious performance impact

[trissanen]

Describe the bug

Since upgrading from 2.2.0 to 2.4.0 we see a significant increase in the processing time. Checking the debug logs, it seems that gitlabform is iterating ALL projects in our gitlab installation (about 5000 and growing). Processing time went from about a minute to over 6 minutes.

This problem seems to have caused by this commit 1a3ec52 . Using -a command line parameter can be use as a workaround unless archived projects are causing other problems.

Is there a way to achieve the same functionality without listing every single project?

In my organization we only use gitlabform to manage few groups and not the whole of the gitlab installation

GitLabForm version

2.4.0

GitLab version

13.12.11-ee

[gdubicki]

Please check out v2.7.1 where this issue should be fixed, @trissanen , and reopen if you don't see improvement.