Excon::Errors::Timeout being raised occasionally for S3DataStore

[tolsen]

This has started happening with recent versions of fog and excon. Here's a backtrace:

Excon::Errors::Timeout: write timeout reached

[GEM_ROOT]/gems/excon-0.14.2/lib/excon/socket.rb:124:in rescue in write' [GEM_ROOT]/gems/excon-0.14.2/lib/excon/socket.rb:115:inwrite'
[GEM_ROOT]/gems/excon-0.14.2/lib/excon/connection.rb:249:in request_kernel' [GEM_ROOT]/gems/excon-0.14.2/lib/excon/connection.rb:101:inrequest'
[GEM_ROOT]/gems/fog-1.4.0/lib/fog/core/connection.rb:20:in request' [GEM_ROOT]/gems/fog-1.4.0/lib/fog/aws/storage.rb:392:inrequest'
[GEM_ROOT]/gems/fog-1.4.0/lib/fog/aws/requests/storage/put_object.rb:43:in put_object' [GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/data_storage/s3data_store.rb:50:inblock (2 levels) in store'
[GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/temp_object.rb:110:in file' [GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/data_storage/s3data_store.rb:49:inblock in store'
[GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/data_storage/s3data_store.rb:159:in rescuing_socket_errors' [GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/data_storage/s3data_store.rb:47:instore'
[GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/app.rb:94:in store' [GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/job.rb:377:instore'
[GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/active_model_extensions/attachment.rb:179:in store_job!' [GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/active_model_extensions/attachment.rb:74:insave!'
[GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/active_model_extensions/instance_methods.rb:16:in block in save_dragonfly_attachments' [GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/active_model_extensions/instance_methods.rb:15:ineach'
[GEM_ROOT]/gems/dragonfly-0.9.12/lib/dragonfly/active_model_extensions/instance_methods.rb:15:in `save_dragonfly_attachments'

At first glance, it appears there are two possible solutions. One option is to have rescuing_socket_errors() in s3data_store.rb rescue Excon::Errors::Timeout just like Excon::Errors::SocketError (calling storage.reload after the rescue). Second option is to offer configuration option to set :persistent to be false when instantiating Fog::Storage.

[diegoviola]

I have this same problem with Fog 1.5.0, any ideas how to fix it?

persistent is already set to false in Fog 1.5.0 apparently.

[markevans]

did anyone manage to figure this out? did more recent versions of fog fix it?

[markevans]

I'll close here - if it's a dragonfly problem please re-open in https://github.com/markevans/dragonfly-s3_data_store