Too much data without an index error

[organicveggie]

Saw the following Mongo exception during startup.

2013-01-09 17:31:30.993 - ERROR - [StateMachine.scala:179] [Collection aws.tags] caught exception
com.mongodb.MongoException: too much data for sort() with no index.  add an index or specify a smaller limit
    at com.mongodb.MongoException.parse(MongoException.java:82)
    at com.mongodb.DBApiLayer$MyCollection.__find(DBApiLayer.java:310)
    at com.mongodb.DBCursor._check(DBCursor.java:360)
    at com.mongodb.DBCursor._hasNext(DBCursor.java:490)
    at com.mongodb.DBCursor.hasNext(DBCursor.java:515)
    at scala.collection.JavaConversions$JIteratorWrapper.hasNext(JavaConversions.scala:574)
    at scala.collection.Iterator$class.foreach(Iterator.scala:660)
    at scala.collection.JavaConversions$JIteratorWrapper.foreach(JavaConversions.scala:573)
    at scala.collection.IterableLike$class.foreach(IterableLike.scala:73)
    at scala.collection.JavaConversions$JIterableWrapper.foreach(JavaConversions.scala:587)
    at scala.collection.TraversableLike$class.map(TraversableLike.scala:194)
    at scala.collection.JavaConversions$JIterableWrapper.map(JavaConversions.scala:587)
    at com.netflix.edda.mongo.MongoDatastore.load(MongoDatastore.scala:201)
    at com.netflix.edda.Collection.load(Collection.scala:158)
    at com.netflix.edda.Collection.initState(Collection.scala:227)
    at com.netflix.edda.StateMachine.act(StateMachine.scala:149)
    at scala.actors.Reactor$$anonfun$dostart$1.apply(Reactor.scala:222)
    at scala.actors.Reactor$$anonfun$dostart$1.apply(Reactor.scala:222)
    at scala.actors.ReactorTask.run(ReactorTask.scala:33)
    at scala.concurrent.forkjoin.ForkJoinPool$AdaptedRunnable.exec(ForkJoinPool.java:611)
    at scala.concurrent.forkjoin.ForkJoinTask.quietlyExec(ForkJoinTask.java:422)
    at scala.concurrent.forkjoin.ForkJoinWorkerThread.mainLoop(ForkJoinWorkerThread.java:340)
    at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:325)

[coryb]

Sorry for the delay, I have been out on vacation for a bit.

I am not sure why aws.tags would not have the required indexes to perform the query in Edda.

Could you run "db.getCollection("aws.tags").getIndexes()" via the mongo CLI?

If you are still seeing the issue perhaps try creating this index:
db.getCollection("aws.tags").createIndexe({stime:-1,id:1})

[coryb]

I think the commit will fix this issue, so I am going to close it. Please rebuild and try again. If you see the error again please let me know. Thanks.