duplicate entries

[nickhilliard]

% cat sorted_unique_cf.txt | tr '[A-Z]' '[a-z]' | sort | uniq -d | wc -l
    1213
%

this should return zero.

[nevinera]

Yeah, he documented that he used | uniq | sort, which I thought was a typo. A similar (simpler) comparison:

$ cat sites-using-cloudflare-master/sorted_unique_cf.txt  | sort | uniq | wc -l
 4287625
$ cat sites-using-cloudflare-master/sorted_unique_cf.txt  | wc -l
 4288852

[coderobe]

I have opened a PR with a fixed version, see #99

[pirate]

Thanks @coderobe, will merge that shortly and fix the README methodology.