Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[production][errs#show] Mongo::OperationFailure: too much data for sort() with no index. add an index or specify a small... #131

Closed
danigb opened this issue Nov 21, 2011 · 4 comments
Closed

[production][errs#show] Mongo::OperationFailure: too much data for sort() with no index. add an index or specify a small... #131

danigb opened this issue Nov 21, 2011 · 4 comments

Comments

@danigb
Copy link

danigb commented Nov 21, 2011

See this exception on Errbit

Mongo::OperationFailure: too much data for sort() with no index. add an index or specify a smaller limit

Summary

URL

http://errcamping.herokuapp.com/apps/69e00b7aeed4d9b10b9c7f105fe75eea/errs/4ec84f58bfb05f000500000b"

Where

errs#show

Occured

Nov 21 11:20am

Similar

2

Params

{
  "action" => "show",
  "app_id" => "69e00b7aeed4d9b10b9c7f105fe75eea",
  "controller" => "errs",
  "id" => "4ec84f58bfb05f000500000b"
}

Session

{
  "_csrf_token" => "21W7uS/C5C6An9TfOnr6JCm9PLRfzdJhpOX8s1DbMVA=",
  "key" => "flash",
  "session_id" => "b1c8d754f8b714381a534d19543beec4",
  "warden_user_user_key" => "[\"User\", [\"4ec847281085550006000001\"], \"$2a$10$5cReoBvsMssiEvGL27nPGO\"]"
}

Backtrace

101:  /vendor/bundle/ruby/1.9.1/gems/mongo-1.3.1/lib/mongo/cursor.rb -> **next_document**
251:  /vendor/bundle/ruby/1.9.1/gems/mongo-1.3.1/lib/mongo/collection.rb -> **find_one**
25:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid/collections/master.rb -> **block in find_one**
29:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid/collections/retry.rb -> **retry_on_connection_failure**
24:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid/collections/master.rb -> **find_one**
48:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid/collection.rb -> **find_one**
153:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid/contexts/mongo.rb -> **first**
45:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid/criteria.rb -> **first**
35:  [PROJECT_ROOT]/controllers/errs_controller.rb -> **show**
4:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal/implicit_render.rb -> **send_action**
150:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/abstract_controller/base.rb -> **process_action**
11:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal/rendering.rb -> **process_action**
18:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/abstract_controller/callbacks.rb -> **block in process_action**
456:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/callbacks.rb -> **_run__3426348360647432410__process_action__4503593921537192942__callbacks**
410:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/callbacks.rb -> **_run_process_action_callbacks**
94:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/callbacks.rb -> **run_callbacks**
17:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/abstract_controller/callbacks.rb -> **process_action**
17:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal/rescue.rb -> **process_action**
30:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal/instrumentation.rb -> **block in process_action**
52:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/notifications.rb -> **block in instrument**
21:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/notifications/instrumenter.rb -> **instrument**
52:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/notifications.rb -> **instrument**
29:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal/instrumentation.rb -> **process_action**
119:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/abstract_controller/base.rb -> **process**
41:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/abstract_controller/rendering.rb -> **process**
138:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal.rb -> **dispatch**
14:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal/rack_delegation.rb -> **dispatch**
178:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_controller/metal.rb -> **block in action**
62:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/routing/route_set.rb -> **call**
62:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/routing/route_set.rb -> **dispatch**
27:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/routing/route_set.rb -> **call**
148:  /vendor/bundle/ruby/1.9.1/gems/rack-mount-0.6.14/lib/rack/mount/route_set.rb -> **block in call**
93:  /vendor/bundle/ruby/1.9.1/gems/rack-mount-0.6.14/lib/rack/mount/code_generation.rb -> **block in recognize**
117:  /vendor/bundle/ruby/1.9.1/gems/rack-mount-0.6.14/lib/rack/mount/code_generation.rb -> **optimized_each**
92:  /vendor/bundle/ruby/1.9.1/gems/rack-mount-0.6.14/lib/rack/mount/code_generation.rb -> **recognize**
139:  /vendor/bundle/ruby/1.9.1/gems/rack-mount-0.6.14/lib/rack/mount/route_set.rb -> **call**
493:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/routing/route_set.rb -> **call**
33:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/rack/mongoid/middleware/identity_map.rb -> **block in call**
130:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/mongoid.rb -> **unit_of_work**
33:  /vendor/bundle/ruby/1.9.1/gems/mongoid-2.1.2/lib/rack/mongoid/middleware/identity_map.rb -> **call**
35:  /vendor/bundle/ruby/1.9.1/gems/warden-1.0.5/lib/warden/manager.rb -> **block in call**
34:  /vendor/bundle/ruby/1.9.1/gems/warden-1.0.5/lib/warden/manager.rb -> **catch**
34:  /vendor/bundle/ruby/1.9.1/gems/warden-1.0.5/lib/warden/manager.rb -> **call**
17:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/best_standards_support.rb -> **call**
14:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/head.rb -> **call**
24:  /vendor/bundle/ruby/1.9.1/gems/rack-1.2.4/lib/rack/methodoverride.rb -> **call**
21:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/params_parser.rb -> **call**
182:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/flash.rb -> **call**
149:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/session/abstract_store.rb -> **call**
302:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/cookies.rb -> **call**
46:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/callbacks.rb -> **block in call**
416:  /vendor/bundle/ruby/1.9.1/gems/activesupport-3.0.10/lib/active_support/callbacks.rb -> **_run_call_callbacks**
44:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/callbacks.rb -> **call**
106:  /vendor/bundle/ruby/1.9.1/gems/rack-1.2.4/lib/rack/sendfile.rb -> **call**
48:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/remote_ip.rb -> **call**
47:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/show_exceptions.rb -> **call**
13:  /vendor/bundle/ruby/1.9.1/gems/railties-3.0.10/lib/rails/rack/logger.rb -> **call**
17:  /vendor/bundle/ruby/1.9.1/gems/rack-1.2.4/lib/rack/runtime.rb -> **call**
11:  /vendor/bundle/ruby/1.9.1/gems/rack-1.2.4/lib/rack/lock.rb -> **block in call**
:  [unknown source] -> ****
11:  /vendor/bundle/ruby/1.9.1/gems/rack-1.2.4/lib/rack/lock.rb -> **call**
30:  /vendor/bundle/ruby/1.9.1/gems/actionpack-3.0.10/lib/action_dispatch/middleware/static.rb -> **call**
168:  /vendor/bundle/ruby/1.9.1/gems/railties-3.0.10/lib/rails[PROJECT_ROOT]lication.rb -> **call**
77:  /vendor/bundle/ruby/1.9.1/gems/railties-3.0.10/lib/rails[PROJECT_ROOT]lication.rb -> **method_missing**
528:  /vendor/bundle/ruby/1.9.1/gems/unicorn-4.1.1/lib/unicorn/http_server.rb -> **process_client**
600:  /vendor/bundle/ruby/1.9.1/gems/unicorn-4.1.1/lib/unicorn/http_server.rb -> **worker_loop**
485:  /vendor/bundle/ruby/1.9.1/gems/unicorn-4.1.1/lib/unicorn/http_server.rb -> **spawn_missing_workers**
135:  /vendor/bundle/ruby/1.9.1/gems/unicorn-4.1.1/lib/unicorn/http_server.rb -> **start**
121:  /vendor/bundle/ruby/1.9.1/gems/unicorn-4.1.1/bin/unicorn -> **<top (required)>**
19:  /vendor/bundle/ruby/1.9.1/bin/unicorn -> **load**
19:  /vendor/bundle/ruby/1.9.1/bin/unicorn -> **<main>**

Environment

REMOTE_ADDR: 10.217.55.238
REQUEST_METHOD: GET
REQUEST_PATH: /apps/69e00b7aeed4d9b10b9c7f105fe75eea/errs/4ec84f58bfb05f000500000b
PATH_INFO: /apps/69e00b7aeed4d9b10b9c7f105fe75eea/errs/4ec84f58bfb05f000500000b
REQUEST_URI: /apps/69e00b7aeed4d9b10b9c7f105fe75eea/errs/4ec84f58bfb05f000500000b
SERVER_PROTOCOL: HTTP/1.1
HTTP_VERSION: HTTP/1.1
HTTP_X_FORWARDED_PROTO: http
HTTP_X_FORWARDED_PORT: 80
HTTP_X_FORWARDED_FOR: 90.168.143.241
HTTP_USER_AGENT: Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.8 (KHTML, like Gecko) Ubuntu/11.10 Chromium/17.0.935.0 Chrome/17.0.935.0 Safari/535.8
HTTP_REFERER: http://errcamping.herokuapp.com/apps/69e00b7aeed4d9b10b9c7f105fe75eea
HTTP_HOST: errcamping.herokuapp.com
HTTP_COOKIE: remember_user_token=BAhbB1sGbzoTQlNPTjo6T2JqZWN0SWQGOgpAZGF0YVsRaVNpAchpTGktaRVpAYVpWmkAaQtpAGkAaQZJIhl1N2FDRThteXV6cU5YVUdNeUE4cQY6BkVU--8f94822cb5b4902f652940bf78e6ac3cff38b3c7; _errbit_session=BAh7CUkiGXdhcmRlbi51c2VyLnVzZXIua2V5BjoGRVRbCEkiCVVzZXIGOwBGWwZvOhNCU09OOjpPYmplY3RJZAY6CkBkYXRhWxFpU2kByGlMaS1pFWkBhWlaaQBpC2kAaQBpBkkiIiQyYSQxMCQ1Y1Jlb0J2c01zc2lFdkdMMjduUEdPBjsAVEkiEF9jc3JmX3Rva2VuBjsARkkiMTIxVzd1Uy9DNUM2QW45VGZPbnI2SkNtOVBMUmZ6ZEpocE9YOHMxRGJNVkE9BjsARkkiD3Nlc3Npb25faWQGOwBGIiViMWM4ZDc1NGY4YjcxNDM4MWE1MzRkMTk1NDNiZWVjNEkiCmZsYXNoBjsARklDOiVBY3Rpb25EaXNwYXRjaDo6Rmxhc2g6OkZsYXNoSGFzaHsGOgxzdWNjZXNzSSI0R3JlYXQgbmV3cyBldmVyeW9uZSEgVGhlIGVyciBoYXMgYmVlbiByZXNvbHZlZC4GOwBGBjoKQHVzZWRvOghTZXQGOgpAaGFzaHsGOwlU--f69c57bf048386051c92fd736b9a62d59dd11c82
HTTP_CONNECTION: keep-alive
HTTP_ACCEPT_LANGUAGE: en-US,en;q=0.8
HTTP_ACCEPT_ENCODING: gzip,deflate,sdch
HTTP_ACCEPT_CHARSET: ISO-8859-1,utf-8;q=0.7,*;q=0.3
HTTP_ACCEPT: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
HTTP_X_HEROKU_QUEUE_WAIT_TIME: 1
HTTP_X_HEROKU_QUEUE_DEPTH: 0
HTTP_X_HEROKU_DYNOS_IN_USE: 1
HTTP_X_REQUEST_START: 1321870822612
rack_url_scheme: http
SERVER_NAME: errcamping.herokuapp.com
SERVER_PORT: 80
key: action_dispatch.request.query_parameters
rack_input: #
rack_errors: #
rack_multiprocess: true
rack_multithread: false
rack_run_once: false
rack_version: ["1", "1"]
SERVER_SOFTWARE: Unicorn 4.1.1
rack_logger: #
action_dispatch_parameter_filter: ["password"]
action_dispatch_secret_token: 6b74778101638fa9c156b3928c9492fb2481ab842538bea838d21f9c9993f649f5806449584266d413d0b2f1104162b3066a86512ed71ededd627cd41f939614
action_dispatch_show_exceptions: true
action_dispatch_remote_ip: 90.168.143.241
rack_session: {"warden_user_user_key"=>"[\"User\", [\"4ec847281085550006000001\"], \"$2a$10$5cReoBvsMssiEvGL27nPGO\"]", "_csrf_token"=>"21W7uS/C5C6An9TfOnr6JCm9PLRfzdJhpOX8s1DbMVA=", "session_id"=>"b1c8d754f8b714381a534d19543beec4", "key"=>"flash"}
rack_session_options: {"path"=>"/", "key"=>"expire_after", "secure"=>"false", "httponly"=>"true", "id"=>"b1c8d754f8b714381a534d19543beec4"}
rack_request_cookie_string: remember_user_token=BAhbB1sGbzoTQlNPTjo6T2JqZWN0SWQGOgpAZGF0YVsRaVNpAchpTGktaRVpAYVpWmkAaQtpAGkAaQZJIhl1N2FDRThteXV6cU5YVUdNeUE4cQY6BkVU--8f94822cb5b4902f652940bf78e6ac3cff38b3c7; _errbit_session=BAh7CUkiGXdhcmRlbi51c2VyLnVzZXIua2V5BjoGRVRbCEkiCVVzZXIGOwBGWwZvOhNCU09OOjpPYmplY3RJZAY6CkBkYXRhWxFpU2kByGlMaS1pFWkBhWlaaQBpC2kAaQBpBkkiIiQyYSQxMCQ1Y1Jlb0J2c01zc2lFdkdMMjduUEdPBjsAVEkiEF9jc3JmX3Rva2VuBjsARkkiMTIxVzd1Uy9DNUM2QW45VGZPbnI2SkNtOVBMUmZ6ZEpocE9YOHMxRGJNVkE9BjsARkkiD3Nlc3Npb25faWQGOwBGIiViMWM4ZDc1NGY4YjcxNDM4MWE1MzRkMTk1NDNiZWVjNEkiCmZsYXNoBjsARklDOiVBY3Rpb25EaXNwYXRjaDo6Rmxhc2g6OkZsYXNoSGFzaHsGOgxzdWNjZXNzSSI0R3JlYXQgbmV3cyBldmVyeW9uZSEgVGhlIGVyciBoYXMgYmVlbiByZXNvbHZlZC4GOwBGBjoKQHVzZWRvOghTZXQGOgpAaGFzaHsGOwlU--f69c57bf048386051c92fd736b9a62d59dd11c82
rack_request_cookie_hash: {"remember_user_token"=>"BAhbB1sGbzoTQlNPTjo6T2JqZWN0SWQGOgpAZGF0YVsRaVNpAchpTGktaRVpAYVpWmkAaQtpAGkAaQZJIhl1N2FDRThteXV6cU5YVUdNeUE4cQY6BkVU--8f94822cb5b4902f652940bf78e6ac3cff38b3c7", "_errbit_session"=>"BAh7CUkiGXdhcmRlbi51c2VyLnVzZXIua2V5BjoGRVRbCEkiCVVzZXIGOwBGWwZvOhNCU09OOjpPYmplY3RJZAY6CkBkYXRhWxFpU2kByGlMaS1pFWkBhWlaaQBpC2kAaQBpBkkiIiQyYSQxMCQ1Y1Jlb0J2c01zc2lFdkdMMjduUEdPBjsAVEkiEF9jc3JmX3Rva2VuBjsARkkiMTIxVzd1Uy9DNUM2QW45VGZPbnI2SkNtOVBMUmZ6ZEpocE9YOHMxRGJNVkE9BjsARkkiD3Nlc3Npb25faWQGOwBGIiViMWM4ZDc1NGY4YjcxNDM4MWE1MzRkMTk1NDNiZWVjNEkiCmZsYXNoBjsARklDOiVBY3Rpb25EaXNwYXRjaDo6Rmxhc2g6OkZsYXNoSGFzaHsGOgxzdWNjZXNzSSI0R3JlYXQgbmV3cyBldmVyeW9uZSEgVGhlIGVyciBoYXMgYmVlbiByZXNvbHZlZC4GOwBGBjoKQHVzZWRvOghTZXQGOgpAaGFzaHsGOwlU--f69c57bf048386051c92fd736b9a62d59dd11c82"}
action_dispatch_cookies: {"remember_user_token"=>"BAhbB1sGbzoTQlNPTjo6T2JqZWN0SWQGOgpAZGF0YVsRaVNpAchpTGktaRVpAYVpWmkAaQtpAGkAaQZJIhl1N2FDRThteXV6cU5YVUdNeUE4cQY6BkVU--8f94822cb5b4902f652940bf78e6ac3cff38b3c7", "_errbit_session"=>"BAh7CUkiGXdhcmRlbi51c2VyLnVzZXIua2V5BjoGRVRbCEkiCVVzZXIGOwBGWwZvOhNCU09OOjpPYmplY3RJZAY6CkBkYXRhWxFpU2kByGlMaS1pFWkBhWlaaQBpC2kAaQBpBkkiIiQyYSQxMCQ1Y1Jlb0J2c01zc2lFdkdMMjduUEdPBjsAVEkiEF9jc3JmX3Rva2VuBjsARkkiMTIxVzd1Uy9DNUM2QW45VGZPbnI2SkNtOVBMUmZ6ZEpocE9YOHMxRGJNVkE9BjsARkkiD3Nlc3Npb25faWQGOwBGIiViMWM4ZDc1NGY4YjcxNDM4MWE1MzRkMTk1NDNiZWVjNEkiCmZsYXNoBjsARklDOiVBY3Rpb25EaXNwYXRjaDo6Rmxhc2g6OkZsYXNoSGFzaHsGOgxzdWNjZXNzSSI0R3JlYXQgbmV3cyBldmVyeW9uZSEgVGhlIGVyciBoYXMgYmVlbiByZXNvbHZlZC4GOwBGBjoKQHVzZWRvOghTZXQGOgpAaGFzaHsGOwlU--f69c57bf048386051c92fd736b9a62d59dd11c82"}
action_dispatch_request_unsigned_session_cookie: {"warden_user_user_key"=>"[\"User\", [\"4ec847281085550006000001\"], \"$2a$10$5cReoBvsMssiEvGL27nPGO\"]", "_csrf_token"=>"21W7uS/C5C6An9TfOnr6JCm9PLRfzdJhpOX8s1DbMVA=", "session_id"=>"b1c8d754f8b714381a534d19543beec4", "key"=>"flash"}
warden: Warden::Proxy:56205960 @config={:default_scope=>:user, :scope_defaults=>{}, :default_strategies=>{:user=>[:rememberable, :token_authenticatable, :database_authenticatable]}, :intercept_401=>false, :failure_app=>Devise::FailureApp}
action_dispatch_request_path_parameters: {"action"=>"show", "controller"=>"errs", "app_id"=>"69e00b7aeed4d9b10b9c7f105fe75eea", "id"=>"4ec84f58bfb05f000500000b"}
action_controller_instance: #
action_dispatch_request_parameters: {"action"=>"show", "controller"=>"errs", "app_id"=>"69e00b7aeed4d9b10b9c7f105fe75eea", "id"=>"4ec84f58bfb05f000500000b"}
action_dispatch_request_formats: ["text/html"]
@danigb
Copy link
Author

danigb commented Nov 21, 2011

Uupps... to much info here... Just to know: I have a error notified 2000 times (uupps) and I could not open the show view...

@ndbroadbent
Copy link
Member

Whoops, that's a lot of notifications! Sometimes in situations like that, I open a console and just type Problem.find(<id>).destroy. This is also why I wrote #118 .. Maybe we should only keep the first couple of hundred notices, and just increase a counter for the rest.

Anyway, your too much data for sort() with no index should actually be fixed by running the mongoid indexing task: rake db:mongoid:create_indexes. This should let you open the show view. Please let me know if that solves your problem :)

@danigb danigb closed this as completed Nov 28, 2011
@troex
Copy link

troex commented Mar 5, 2012

rake db:mongoid:create_indexes solved same problem for me I've got around 6000 notifies

@jjb
Copy link

jjb commented Feb 7, 2013

rake db:mongoid:create_indexes solved my problem when running rake db:migrate gave me the same message about missing indexes. -- might be worth mentioning this trick somewhere in the readme

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@jjb @danigb @ndbroadbent @troex