A list of over 320,000,000 SHA-1 hashes from hacked password lists. This list is provided by Troy Hunt, curator of the website Have I been pwned?.
There are no changes from Troy's list, other than merging his multiple files together into a single list. I am providing this via Git because it may be more useful to fetch them over Git, including the automatic resolution of deltas in case Troy posts a new update file.
THIS IS A VERY BIG LIST. It is around 12 GB, uncompressed.
NOTE: This is a list of known-bad password SHA-1 hashes. For a list of known-bad clear text passwords, see https://github.com/skyzyx/bad-passwords.
These files are large enough that they will crash pretty much any text editor out there. So we will rely on shell tools instead which can handle streams.
LC_ALL=C sort --parallel="$(nproc --all)" -u input > output
- http://sgolconda.blogspot.com/2015/11/sort-very-large-dataset.html
- https://unix.stackexchange.com/questions/3770/how-to-merge-all-text-files-in-a-directory-into-one
Needs modern enough GNU sort (post-2010). macOS’ BSD sort will not likely work.