Python tool to help you knockout duplicate entries from multiple files and generate the final output
Required: Python 3.5 or above
$ python dupknock.py directory_containing_files [exts]
To search within text (txt) files only:
$ python dupknock.py subdomains
When searching within txt and csv
$ python dupknock.py subdomains txt,csv