Skip to content
This repository was archived by the owner on Sep 12, 2018. It is now read-only.

Use gevent to parallelize storage operations in get_tags#644

Merged
dmp42 merged 1 commit into
docker-archive:masterfrom
bshi:gevent-get-tags
Nov 6, 2014
Merged

Use gevent to parallelize storage operations in get_tags#644
dmp42 merged 1 commit into
docker-archive:masterfrom
bshi:gevent-get-tags

Conversation

@bshi
Copy link
Copy Markdown
Contributor

@bshi bshi commented Oct 22, 2014

This is a band-aid for #614

For context, hosted from a GCE instance with GCS being the backing
store, With this patch, we are able to 'docker pull' 859 tags without a
timeout. Prior to this patch, we were unable to pull anything from a
repository with 200 tags. This is the extent of my investigation thus
far. Unfortunately, this change is probably just a constant factor
reduction in run-time as total network round-trips still grows linearly
with tag count.

@bshi
Copy link
Copy Markdown
Contributor Author

bshi commented Oct 22, 2014

Build failures appear unrelated?

@dmp42
Copy link
Copy Markdown
Contributor

dmp42 commented Oct 22, 2014

Hello @bshi

Build failure is a style issue.

./docker_registry/tags.py:9:1: H306 imports not in alphabetical order (gevent, flask)

You may want to run tox before PR-ing to have everything checked.

About this, it's too late for 0.9 unfortunately - so, I'll merge it after the release.

@dmp42 dmp42 added this to the 1.0 milestone Oct 22, 2014
@bshi
Copy link
Copy Markdown
Contributor Author

bshi commented Oct 22, 2014

Thanks; it was perhaps overly optimistic of me to skip installing the development environment.

@dmp42
Copy link
Copy Markdown
Contributor

dmp42 commented Oct 22, 2014

It's pretty much pip install tox and you should be set.

This is a band-aid for #614

For context, hosted from a GCE instance with GCS being the backing
store, With this patch, we are able to 'docker pull' 859 tags without a
timeout.  Prior to this patch, we were *unable* to pull anything from a
repository with 200 tags.  This is the extent of my investigation thus
far.  Unfortunately, this change is probably just a constant factor
reduction in run-time as total network round-trips still grows linearly
with tag count.
@dmp42
Copy link
Copy Markdown
Contributor

dmp42 commented Nov 6, 2014

0.9 is released - master is open for this.

LGTM

@stevvooe what do you think?

@stevvooe
Copy link
Copy Markdown
Contributor

stevvooe commented Nov 6, 2014

LGTM!

@dmp42
Copy link
Copy Markdown
Contributor

dmp42 commented Nov 6, 2014

Merging for 1.0

dmp42 added a commit that referenced this pull request Nov 6, 2014
Use gevent to parallelize storage operations in get_tags
@dmp42 dmp42 merged commit 747fe18 into docker-archive:master Nov 6, 2014
@bshi bshi deleted the gevent-get-tags branch November 6, 2014 19:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants