Too many files in bucket causes endless looping

[fredx]

If I don't clean up old ASSET_VERSION directories in my bucket, eventually I get to a point where cdn_fu appears to get into an endless loop and never uploads anything. I tracked this to the method:

CloudfrontUploader#populate_existing_asset_checksums

If the objects.size == MAX_KEYS it enters the loop. When this happens, the method bucket.objects always returns the same set. I've verified this by printing the result on each iteration.

On another (but related) note, is there a reason the uploader has to scan all the existing files even if they are under a different root path (ASSET_VERSION)? As the number of old versions increases, deploys take longer and longer.

using rails 2.3.5 with aws-s3 --version=0.6.2