Rackspace CloudFiles 10000 Container/Folder Limit in Cyberduck

[cyberduck]

a998853 created the issue

There are repeated messages, saying that this has been fixed, but it appears that this is not the case.

• c68eecf
• Marker limit #5664
• 0a0c3dc
• Increase Mosso/Rackspace Cloud File limit beyond 10,000 #3950

We continue to see only 10,000 containers when we have over 12,000 containers in our CloudFiles Account.

We are running Cyberduck 4.02 8601

And we might be able to live with this if searches extended beyond the 10,000 containers, but it appears that the searches only take place within the first 10,000 containers found...

[cyberduck]

a998853 commented

The system will return a [maximum] of 10,000 container names per request. To retrieve
subsequent container names, another request must be made with a 'marker' parameter.
The marker indicates where the last list left off; the system will return container names
greater than this marker, up to 10,000 again. Note that the ‘marker’ value should be URLencoded prior to sending the HTTP request.

If 10,000 is larger than desired, a 'limit' parameter may be given.

If the number of container names returned equals the limit given (or 10,000 if no limit is
given), it can be assumed there are more container names to be listed. If the container
name list is exactly divisible by the limit, the last request will simply have no content.

Example 4.8. List Large Number of Containers

For example, let's use a listing of five container names
apples
bananas
kiwis
oranges
pears

We'll use a limit of two to show how things work:
GET //?limit=2
Host: storage.clouddrive.com
X-Auth-Token: eaaafd18-0fed-4b3a-81b4-663c99ec1cbbCloud Files™ Developer Guide May 24, 2011 API v1
14
apples
bananas

Since we received two items back, we can assume there are more container names to list,
so we make another request with a marker of the last item returned:
GET //?limit=2&marker=bananas
Host: storage.clouddrive.com
X-Auth-Token: eaaafd18-0fed-4b3a-81b4-663c99ec1cbb

kiwis
oranges
Again, two items are returned; there may be more:
GET //?limit=2&marker=oranges
Host: storage.clouddrive.com
X-Auth-Token: eaaafd18-0fed-4b3a-81b4-663c99ec1cbb
pears

With this one-item response we received less than the limit number of container names,
indicating that this is the end of the list

[cyberduck]

@dkocher commented

The previous tickets talked about the listing of files within containers.

[cyberduck]

@dkocher commented

In 995da5a.

[cyberduck]

a998853 commented

Yes, I was fixated on the 10,000 number that must apply to both containers AND the content of containers, so that I didn't distinguish them. So thank-you for fixing the issue.