Deduplicate CSV rows, optionally by selected keys.

gem install dorian-csv-uniq

Also included in the aggregate gem:

gem install dorian

csv-uniq [options] [key ...] [file ...]

Run csv-uniq -h for generated option details and csv-uniq -v for the installed version.

• Without keys it deduplicates whole rows. With --headers, keys can be header names.

printf 'a,1\nb,2\na,1\n' | csv-uniq

csv-uniq --headers -p key input.csv