Ensure email addresses are 100% valid

[9b]

frisbee/frisbee/utils.py

Line 51 in 3cfe138

def extract_emails(results: str, domain: str, fuzzy: bool) -> List[str]:

There are times when matches are found in which extra data has been tacked onto the end of the match. In these cases, a valid email is made invalid due to the trailing data. It would be ideal to trim anything past the core domain match.

Potential ways to solve this

• Get the substring index of the domain + length of domain in order to then ask for that, plus the pre-pending email match
• Leverage a TLD list in order to match the TLD, dropping anything else.

[9b]

This will only impact fuzzy matching. A proper solution has been identified, though it needs to be checked for performance as it may slow down the program.

    A proper implementation here will pull in a TLD library in order to
    isolate the "core" of the domain from the TLD. The core itself should
    be what is used as the "seed" for the fuzzy search. If matched, then
    we know a fuzzy hit (kword) is there. We apply the substring method
    after to ensure that we preserve a valid email. This approach counters
    the trailing junk behind a valid email.