You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
protected final InputAnalysisProcess getInputAnalysisProcess() {
if (settings.isDelimiterDetectionEnabled() || settings.isQuoteDetectionEnabled()) {
return new CsvFormatDetector(20, settings, whitespaceRangeStart) {
@Override
void apply(char delimiter, char quote, char quoteEscape) {
if (settings.isDelimiterDetectionEnabled()) {
CsvParser.this.delimiter = delimiter;
CsvParser.this.delimiters[0] = delimiter;
Could we make maxRowSample a public configurable parameter? we would like to increase the value of maxRowLines to increase the delimiter detection accuracy.
The text was updated successfully, but these errors were encountered:
@jbax This issue is unfortunately a deal breaker for us because we have found errors in the delimiter detection in production using only 20 lines, whereas increasing this to i.e. 100 works. Because of where this is hard coded our only option is to fork the code and build our own jar which we'd really rather avoid if possible. Can you give any indication about timeline or priority for this change? Thanks so much.
Look like the maxRowSample parameter is hardcoded to 20 in the com.univocity.parsers.csv.CsvParser.java:
return new CsvFormatDetector(20, settings, whitespaceRangeStart) {
)
(
univocity-parsers/src/main/java/com/univocity/parsers/csv/CsvParser.java
Line 466 in 3c2c2fa
Could we make maxRowSample a public configurable parameter? we would like to increase the value of maxRowLines to increase the delimiter detection accuracy.
The text was updated successfully, but these errors were encountered: