float precision problem

[SKoschnicke]

I created a test case where "-1912.167" is read as "-1912.1670000000001" from an excel file. I think it results from some floating point conversions but can't find the code which creates floats from an excel file. Maybe someone else knows the place.

Here is the test case:
SKoschnicke/spreadsheet-1@f309aeb

[zdavatz]

I guess it is Ruby that does that.

[EtienneDepaulis]

Hey guys,
we have the exact same problem. Any idea on how to fix it ?
Cheers

[SKoschnicke]

Here is a hack you may use:

  def self.fix_spreadsheet_float(number_string)
    if /\.\d*000000[123456789]$/.match number_string
      Rails.logger.info "removing last digit of #{number_string} because it seems to be a float precision problem"
      return number_string.chop
    else
      return number_string
    end
  end

[zdavatz]

Thanks for sharing this!