CSV appender for writting big files

[josevi86]

I want to create a big csv file using the CSV Appender. I'm using this code:

`for (int i = 0; i < writeBuffer.size(); i++) {
	String array[] = writeBuffer.get(i).toArray(new String[writeBuffer.get(i).size()]);
	csvAppender.appendLine(array);
   }`

being writeBuffer a List<List>. This buffer can have more than 500 lines.
When I finish with the processing, the resulting file only has 148 lines and the last one is incomplete.

I also have try to flush at 100 lines, but then is not writting the next lines.

Maybe i am using the library in a incorrect way?

Thanks in advance.

[osiegmar]

Please provide a complete and executable example (main method).

[josevi86]

Okey, there is no need. I have detected my problem.

I was using appendLine for appending more than one line. In my example, array[] has this contents:

array= ["headerA,headerB,headerC,",
             "valueA1,valueB1,valueC1",
             "valueA100,valueB100,valueC100",
             "valueA500,valueB500,valueC500"
]

In the end, the array could have 500 "lines of lines", when, if i'm not wrong, appendLine is for appending only something like:

array=["headerA", "headerB", "headerC"]

Exists the way to append N lines without closing the file? We need to process line by line of a one big file, and my thought was to write this buffer (an array of 500 lines) for avoid to have all the file in memory.

Thanks

[osiegmar]

You can use appendLine() or a combination of one (or multiple) appendField() and endLine() to append data to the output. The output (e.g. the file) will be closed when closing the CsvAppender (either by explicitly calling close() or implicitly by using try-with-resources).

[Pascal66]

Happen to me too.
With or without endline()

The strange thing happen when I append a field with a Double and not with an Integer.

csvAppenderTrain.appendField("7"); //WORK
csvAppenderTrain.appendField("7.0"); //NOT WORKING