feat: Ignore large data files

[kgilpin]

Logical Changes

• Extended Binary File Extensions List

  Added more file extensions to the list of BINARY_FILE_EXTENSIONS.

• Introduced Data File Extensions List

  Introduced a new list DATA_FILE_EXTENSIONS.

• Refactored File Filtering Logic

  Created helper functions isBinaryFile and isDataFile to streamline file filtering.

• Updated File Filtering Method

  Enhanced filterFiles function to exclude large data files.

• Extended Unit Tests

  Modified and added unit tests to cover new filtering logic for binary and data files.

• Added Test Case for Regex Patterns

  Added a new test case in the pattern matching tests.

Possible Bugs to Investigate

Checked-off items have been reviewed by the developer and determined to be non-issues.

• Missing Extensions: There is a risk of missing certain binary or data file extensions that are not included in the current lists.
• Hardcoded File Size Threshold: The file size threshold (50,000 bytes) is hardcoded and may not be suitable for all scenarios.
• Performance Impact: Iterating through large arrays of file names and extensions could impact performance.
• Error Handling: The catch block in filterFiles logs an error but continues processing. Ensure this behavior is intended.
• Test Coverage: Ensure all edge cases are covered in unit tests, particularly for newly introduced file types and size-based exclusions.

Fixes #2039

[appland-release]

🎉 This PR is included in version @appland/appmap-v3.168.0 🎉

The release is available on:

• @appland/appmap-v3.168.0
• GitHub release
• @appland/appmap-v3.168.0

Your semantic-release bot 📦🚀