New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mirror update: option to limit transfer rate #62

Closed
Jorilx opened this Issue Jun 5, 2014 · 9 comments

Comments

Projects
None yet
5 participants
@Jorilx

Jorilx commented Jun 5, 2014

We'd like to have a local mirror of the complete Ubuntu repository, but this would imply having the Internet connection completely occupied for hours. Is it possible to add an option to limit transfer rate during a "aptly mirror update"?

@ryanuber

This comment has been minimized.

Show comment
Hide comment
@ryanuber

ryanuber Jun 5, 2014

Contributor

@Jorilx you should take a look at trickle. I used it quite some time ago and it did very well. In theory it should work for this too. It's available in the Ubuntu base repos.

Contributor

ryanuber commented Jun 5, 2014

@Jorilx you should take a look at trickle. I used it quite some time ago and it did very well. In theory it should work for this too. It's available in the Ubuntu base repos.

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Jun 5, 2014

Member

@Jorilx, this is good idea. Also aptly has option to limit download concurrency, it is downloadConcurrency in ~/.aptly.conf. By default it is 4, you can limit it to 1.

Member

smira commented Jun 5, 2014

@Jorilx, this is good idea. Also aptly has option to limit download concurrency, it is downloadConcurrency in ~/.aptly.conf. By default it is 4, you can limit it to 1.

@smira smira added this to the v0.7 milestone Jun 5, 2014

@Jorilx

This comment has been minimized.

Show comment
Hide comment
@Jorilx

Jorilx Jun 5, 2014

@ryanuber Didn't know about Trickle, it looks interesting, thanks :)
@smira Yes I had already set downloadConcurrency to 1 but aptly still managed to consume all the bandwith :/

Jorilx commented Jun 5, 2014

@ryanuber Didn't know about Trickle, it looks interesting, thanks :)
@smira Yes I had already set downloadConcurrency to 1 but aptly still managed to consume all the bandwith :/

@nightlyone

This comment has been minimized.

Show comment
Hide comment
@nightlyone

nightlyone Jun 8, 2014

@ryanuber Are you sure trickle will work with statically linked Go programs? It is documented to work by overriding libc functions which the Go stdlib doesn't use (and thus aptly doesn't use either).

nightlyone commented Jun 8, 2014

@ryanuber Are you sure trickle will work with statically linked Go programs? It is documented to work by overriding libc functions which the Go stdlib doesn't use (and thus aptly doesn't use either).

@ryanuber

This comment has been minimized.

Show comment
Hide comment
@ryanuber

ryanuber Jun 8, 2014

Contributor

@nightlyone no, I am not sure and didn't try it myself. Just remembered the program from years ago and thought it might help in this case. Good catch, though!

Contributor

ryanuber commented Jun 8, 2014

@nightlyone no, I am not sure and didn't try it myself. Just remembered the program from years ago and thought it might help in this case. Good catch, though!

@Jorilx

This comment has been minimized.

Show comment
Hide comment
@Jorilx

Jorilx Jun 9, 2014

I've just tried Trickle but I couldn't get it to limit aptly bandwidth in any way... It looks like @nightlyone is right

Jorilx commented Jun 9, 2014

I've just tried Trickle but I couldn't get it to limit aptly bandwidth in any way... It looks like @nightlyone is right

@deknos

This comment has been minimized.

Show comment
Hide comment
@deknos

deknos Jul 7, 2014

we could use this too, since we begin migrating for now at least part of our infrastructure to aptly... :)

deknos commented Jul 7, 2014

we could use this too, since we begin migrating for now at least part of our infrastructure to aptly... :)

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Jul 10, 2014

Member

This library should help to implement that behavior: http://godoc.org/code.google.com/p/mxk/go1/flowcontrol

Member

smira commented Jul 10, 2014

This library should help to implement that behavior: http://godoc.org/code.google.com/p/mxk/go1/flowcontrol

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Jul 13, 2014

Member

Done in master.

Member

smira commented Jul 13, 2014

Done in master.

@smira smira closed this Jul 13, 2014

smira added a commit that referenced this issue Jul 13, 2014

smira added a commit to aptly-dev/aptly-bash-completion that referenced this issue Jul 26, 2014

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment