Duplicate column names

[pezholio]

http://csvlint.io/validation/530b5aa263737633f8000000 gives duplicate column name errors, as there's a title line on the first row, then a blank row, followed by headers.

It seems to be a common issue that people put information about the CSV in the first line (or few lines). Should we generate a separate error for this if the first few lines have one column? Something which in the front end would say:

"Your CSV seems to contain unstructured text at the beginning of the file, it is important that your CSV only contains structured data - any background information or metadata should be included on a referring web page or accompanying document"

[ldodds]

That could be useful. If there were just fewer columns at the beginning, but the rest of the file was consistent then it suggests there's some preamble there that needs to be removed.

Probably more informative to try and spot that rather than have the generic error.

[JeniT]

@statshero has a suggested algorithm at https://github.com/theodi/R-projects/blob/master/csv-stats/the_status_of_csvs_on_data.gov.uk.md