Extending deny list to support filenames and folders

[Mzack9999]

Proposed changes

This PR extends the deny list functionality in file requests in order to support file and directory exclusions

Checklist

• Pull request is created against the dev branch
• All checks passed (lint, unit/integration/regression tests etc.) with my changes
• I have added tests that prove my fix is effective or that my feature works
• I have added necessary documentation (if appropriate)

[Ice3man543]

lgtm!

[ehsandeep]

@Mzack9999 it took some time but here are all the details we required related to file/folder exclusion for the file templates, currently, the 2nd and 5th rules are supported, and others need to be supported.

    denylist:
      - /Users/xx/nuclei-templates/cves/ # excludes all the directory / subdirectory under "/Users/xx/nuclei-templates/cves/*"
      - /Users/xx/nuclei-templates/vulnerabilities/jira/jira-unauthenticated-projects.yaml  # excludes specfic file /Users/xx/nuclei-templates/vulnerabilities/jira/jira-unauthenticated-projects.yaml
      - dns/ # excludes $INPUT_PATH/dns/*
      - exposed-panels/cortex-xsoar-login.yaml # excludes $INPUT_PATH/exposed-panels/cortex-xsoar-login.yaml
      - .txt  # excludes all the files with TXT extesioin

      # $INPUT_PATH is what we receive as an input directory/path to perform file scan using "-u" or "list" flag.
      # nuclei -t file/ -u http_data/, here "http_data" is $INPUT_PATH

[ehsandeep]

Test fails are expected due to the use of old version of nuclei.

[forgedhallpass]

We might want to move the hard-coded

nuclei/v2/pkg/protocols/file/file.go

Line 70 in c4d1b03

var defaultDenylist = []string{".3g2", ".3gp", ".7z", ".apk", ".arj", ".avi", ".axd", ".bmp", ".css", ".csv", ".deb", ".dll", ".doc", ".drv", ".eot", ".exe", ".flv", ".gif", ".gifv", ".gz", ".h264", ".ico", ".iso", ".jar", ".jpeg", ".jpg", ".lock", ".m4a", ".m4v", ".map", ".mkv", ".mov", ".mp3", ".mp4", ".mpeg", ".mpg", ".msi", ".ogg", ".ogm", ".ogv", ".otf", ".pdf", ".pkg", ".png", ".ppt", ".psd", ".rar", ".rm", ".rpm", ".svg", ".swf", ".sys", ".tar.gz", ".tar", ".tif", ".tiff", ".ttf", ".vob", ".wav", ".webm", ".wmv", ".woff", ".woff2", ".xcf", ".xls", ".xlsx", ".zip"}

to the default configuration as well.