Ability to "publish" to S3... #15

Closed
diranged opened this Issue Mar 15, 2014 · 10 comments

Comments

Projects
None yet
6 participants
@diranged

Hey guys, we've been waiting for a year to see someone step up to the plate and build a great repository management tool. Thank you for finally doing it.

We host our own packages (internal ones) in Apt repos that are then stored on S3. Using the apt-transport-s3 package, we're able to securely pull down these packages from our systems in the cloud without worrying about scale, performance or mirror reliability.

What do you think about adding in S3 support to the publish command, so that you can manage your Apt repos on your Aptly host, but then explicitly publish them to S3? With a bit of intelligence (pulling down MD5 hashes from S3 and comparing them), individual updates to repos could be quick and easy.

... create repo Foo
... publish repo Foo to S3
... add package Bar to repo Foo
... publish repo Foo to S3
( only package Bar and the associated metadata files change)
... package Bar + metadata files uploaded to S3

Thoughts?

@smira smira added the enhancement label Mar 16, 2014

@smira smira added this to the v0.6 milestone Mar 16, 2014

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Mar 16, 2014

Member

I think it's a great idea! Thanks!

Member

smira commented Mar 16, 2014

I think it's a great idea! Thanks!

@diranged

This comment has been minimized.

Show comment
Hide comment
@diranged

diranged Mar 17, 2014

We don't have any Go experts here ... but we'd be happy to help where ever we can on this one. Let us know whether we can help in any of the design or testing. We'll be watching closely!

We don't have any Go experts here ... but we'd be happy to help where ever we can on this one. Let us know whether we can help in any of the design or testing. We'll be watching closely!

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Mar 18, 2014

Member

I'll start this as part of 0.6, which should be somewhere in May.

Member

smira commented Mar 18, 2014

I'll start this as part of 0.6, which should be somewhere in May.

@mlabardini

This comment has been minimized.

Show comment
Hide comment
@mlabardini

mlabardini Apr 25, 2014

+1 vote for this!

+1 vote for this!

@nikolay

This comment has been minimized.

Show comment
Hide comment
@nikolay

nikolay May 9, 2014

👍 A must-have feature nowadays!

nikolay commented May 9, 2014

👍 A must-have feature nowadays!

@smira smira modified the milestones: v0.7, v0.6 Jun 5, 2014

@michaeljoy

This comment has been minimized.

Show comment
Hide comment

+1 indeed!

smira added a commit that referenced this issue Jul 17, 2014

smira added a commit that referenced this issue Jul 17, 2014

smira added a commit that referenced this issue Jul 18, 2014

smira added a commit that referenced this issue Jul 18, 2014

smira added a commit that referenced this issue Jul 21, 2014

smira added a commit that referenced this issue Jul 28, 2014

smira added a commit that referenced this issue Jul 28, 2014

smira added a commit that referenced this issue Jul 28, 2014

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Jul 28, 2014

Member

Done in master, feature would go to 0.7 release (tomorrow).

Member

smira commented Jul 28, 2014

Done in master, feature would go to 0.7 release (tomorrow).

@smira smira closed this Jul 28, 2014

@jakedahn

This comment has been minimized.

Show comment
Hide comment
@jakedahn

jakedahn Jul 29, 2014

Awesome! @smira when will this land in deb http://repo.aptly.info/ squeeze main ?

Awesome! @smira when will this land in deb http://repo.aptly.info/ squeeze main ?

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Jul 29, 2014

Member

Hopefully today.

Member

smira commented Jul 29, 2014

Hopefully today.

@smira

This comment has been minimized.

Show comment
Hide comment
@smira

smira Aug 8, 2014

Member

aptly since 0.7 supports S3 publishing, please share your experience/problems you might encounter. Thanks!

More info on S3 publishing: http://smira.ru/en/posts/aptly-07.html

Member

smira commented Aug 8, 2014

aptly since 0.7 supports S3 publishing, please share your experience/problems you might encounter. Thanks!

More info on S3 publishing: http://smira.ru/en/posts/aptly-07.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment