-
Notifications
You must be signed in to change notification settings - Fork 25
Feature: Heuristic exclude suggestions
Josh Soref edited this page Mar 23, 2021
·
12 revisions
I've also been thinking about having the system do heuristics, if there are proportionally many items for a given file, it's probably worth suggesting to exclude
the file.
Roughly implementation compares the number of unique dictionary words in a file with the number of unique non dictionary words in the file. If there are more non dictionary words, the file will be skipped.
To get a file to be checked, one will need to:
- add words to the dictionary (
allow.txt
) - mask patterns (
patterns.txt
) - reduce the number of non dictionary words (by fixing typos)