Add detection for various *sv file formats in Data Import Doctype

[vmatt]

Hello,

I've encountered an issue in Frappe where attempting to upload different *sv file formats (such as CSV, TSV, or files separated by semicolons) through the Data Import Doctype does not properly detect and process the file formats other than standard CSV. This issue affects the seamless import of data saved in less common *sv formats, potentially hindering the data integration process from various external sources.

Steps to Reproduce:

1. Navigate to the Data Import page in Frappe.
2. Try to upload a file with TSV format or a semicolon-separated values format.
3. Observe that the system either fails to detect the file format correctly or processes it incorrectly.

Expected Behavior:
The Data Import tool should automatically detect and correctly parse different *sv formats such as CSV, TSV, and semicolon-separated values files.

Actual Behavior:
The Data Import tool fails to detect or correctly parse file formats other than standard CSV. In this case, you see warnings, usually for all rows:
Row has less values than columns or Row has more values than columns

Suggested Enhancement:
It would be highly beneficial to enhance the Data Import Doctype to include a feature where:

• The system is capable of detecting various delimiters like tabs (\t), semicolons (;), etc.
• Offer users an option to specify the delimiter manually in case of automatic detection failure.

This enhancement would significantly improve data handling capabilities, making the tool more flexible and user-friendly for various business and data contexts.

Additional Information:

• Frappe version: v15.24.1

I believe this feature would be appreciated by many users who deal with diverse data formats and look forward to any updates regarding its potential implementation.