Feature Request: Processing callback

[taemon1337]

One thing I'm starting to see a need for (at least for my stuff) is a callback function for each csv row.

For example, say you are reading chunks of a large CSV and need to insert an additional key/value(s), like this:

SmarterCSV.process file, options, do |rows|
rows = rows.map { |row| row[:_special_id] = spec_id }
send_rows_in_bulk_somewhere( rows )
end


this processes rows twice, as opposed to something like this

SmarterCSV.process file, options.merge( callback: "my_callback" ), do |rows| send_rows_in_bulk_somewhere(rows) end def my_callback row row[:_special_id] = get_spec_id(row) end

Maybe this is just as fast if you processed each row then cached then up before sending them out, I haven't done any comparisons.

[tilo]

can't you do something like this?

SmarterCSV.process( file , options ) do |hash|
   do_something_with_row(hash)
   do_something_after_row_is_processed
end

[taemon1337]

Yes, however you are processing the rows twice, which most of the time is fine, but if you are streaming a really large CSV, it would be more efficient to to edit each row inline, as opposed to processing each chunk twice.

[tilo]

I'm considering this as a feature for 2.0

[tilo]

well, you could do this:

SmarterCSV.process( file , options ) do |hash|
   do_something_with_row(hash)
end

def do_something_with_row(hash)
  do_the_main_thing
 do_something_after_row_is_processed
end