Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Thanks so much for crafting and sharing duplicut.
It appears to delete many unique lines containing spaces or non-ASCII characters, e.g.,
Any line with 5 or more Japanese characters is cut:
Hi ! I guess you ran duplicut without changing the options.
Also, the empty lines deletion is hardcoded, because the goal is to speedup tools like hascat & john, so they don't have to read empty lines (or guess empty passwords)
Anyway, a limitation of --line-max-size is 254, because line_sz is stored in 8bits in the hashmap (for memory optimization)
Please close the issue if my comment resolved it, and thank you for the feedback !