jscpd looks for code duplicate in images

[fungiboletus]

Describe the bug

jscpd looks for code duplicate in images, which takes some time with very little chances to find duplicates.

Expected behavior

Perhaps filenames with extensions from common binary files should be ignored by jscpd by default.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity.
It will be closed in 14 days if no further activity occurs.
Thank you for your contributions.

If you think this issue should stay open, please remove the O: stale 🤖 label or comment on the issue.

If you're a maintainer, you can stop the bot to mark this issue as stale in the future by adding the O: backlog 🤖 label`.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity.
It will be closed in 14 days if no further activity occurs.
Thank you for your contributions.

If you think this issue should stay open, please remove the O: stale 🤖 label or comment on the issue.

If you're a maintainer, you can stop the bot to mark this issue as stale in the future by adding the O: backlog 🤖 label`.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity.
It will be closed in 14 days if no further activity occurs.
Thank you for your contributions.

If you think this issue should stay open, please remove the O: stale 🤖 label or comment on the issue.

If you're a maintainer, you can stop the bot to mark this issue as stale in the future by adding the O: backlog 🤖 label`.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity.
It will be closed in 14 days if no further activity occurs.
Thank you for your contributions.

If you think this issue should stay open, please remove the O: stale 🤖 label or comment on the issue.

If you're a maintainer, you can stop the bot to mark this issue as stale in the future by adding the O: backlog 🤖 label`.

[ferrarimarco]

@fungiboletus Hi! Thanks for this report.

Can you please share more about how you're running and configuring super-linter, so we can reproduce this?

[fungiboletus]

I believe I used the default configuration from the getting started section in the readme at the time of the issue. My repository had some images in it.

[ferrarimarco]

Thanks for following up. For now, I'm going to close this because we don't have a reproduction case.

[fungiboletus]

Here you go: https://github.com/fungiboletus/superlint-jscpd-images

It's an example repository with an image and the default configuration from the getting started section in the readme.

The .webp image is processed by jscpd (and also gitleaks and textlint).

[ferrarimarco]

@fungiboletus thanks for this example.

I think this is a fair request. We should exclude at least the same files we exclude when using find:

super-linter/lib/functions/buildFileList.sh

Lines 111 to 131 in b9d7d8d

	mapfile -t RAW_FILE_ARRAY < <(find "${WORKSPACE_PATH}" \
	-not \( -path '*/\.git' -prune \) \
	-not \( -path '*/\.pytest_cache' -prune \) \
	-not \( -path '*/\.rbenv' -prune \) \
	-not \( -path '*/\.terragrunt-cache' -prune \) \
	-not \( -path '*/\.venv' -prune \) \
	-not \( -path '*/\__pycache__' -prune \) \
	-not \( -path '*/\node_modules' -prune \) \
	-not -name ".DS_Store" \
	-not -name "*.gif" \
	-not -name "*.ico" \
	-not -name "*.jpg" \
	-not -name "*.jpeg" \
	-not -name "*.pdf" \
	-not -name "*.png" \
	-not -name "*.webp" \
	-not -name "*.woff" \
	-not -name "*.woff2" \
	-not -name "*.zip" \
	-type f \
	2>&1 | sort)

[ferrarimarco]

Given the changes in #5041, this should be solved.