Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cmd/compress: do not compress Vultr images #1595

Closed
wants to merge 1 commit into from

Conversation

lucab
Copy link
Contributor

@lucab lucab commented Jul 15, 2020

This skips the compression step for Vultr images, as the cloud import
API expects a raw disk image and does not accept compressed content.

Ref: coreos/fedora-coreos-docs#71 (comment)

@lucab lucab requested review from dustymabe and jlebon July 15, 2020 11:51
@openshift-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: lucab

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

This skips the compression step for Vultr images, as the cloud import
API expects a raw disk image and does not accept compressed content.
@lucab lucab changed the title cmd/compress: do no compress Vultr images cmd/compress: do not compress Vultr images Jul 15, 2020
@dustymabe
Copy link
Member

how much does this expand the actual storage we'll be using? In the docs could we just add a -d decompress option to coreos-installer download ?

@lucab
Copy link
Contributor Author

lucab commented Jul 15, 2020

In the docs could we just add a -d decompress option to coreos-installer download ?

I had the same idea, until I discovered that the Vultr API allows uploading images from public URLs, but not pushing a local file (i.e. one cannot fetch+decompress+upload).

@dustymabe
Copy link
Member

In the docs could we just add a -d decompress option to coreos-installer download ?

I had the same idea, until I discovered that the Vultr API allows uploading images from public URLs, but not pushing a local file (i.e. one cannot fetch+decompress+upload).

foo - that sounds like a request we should be able to take to them to be able to handle a compressed artifact.

@dustymabe
Copy link
Member

foo - that sounds like a request we should be able to take to them to be able to handle a compressed artifact.

but for now, i guess this is best

@lucab
Copy link
Contributor Author

lucab commented Jul 15, 2020

Yeah, I'd also like to be able to specify a digest for their platform to check after fetching but before decompressing/importing. Let's hold this for a few days and see if they are open to that, it would help sparing some disk space and bandwidth.

/hold

@lucab
Copy link
Contributor Author

lucab commented Jul 17, 2020

As per coreos/fedora-coreos-tracker#355 (comment) the API is not going to gain those features right now. How do we want to proceed here?

@dustymabe
Copy link
Member

As per coreos/fedora-coreos-tracker#355 (comment) the API is not going to gain those features right now. How do we want to proceed here?

I'd really like to not store the images uncompressed. Some questions/suggestions:

  • Is there a public ticket/issue tracking such a feature request (i.e. support for decompression on the server side)?
  • Since the user already has access to vultr and vultr has object storage, could we add steps to the docs to download/decompress, upload to object storage, create image using API, delete from object storage?

It's a bit backwards, but the steps would cover everything and wouldn't require the user to set up their own HTTPS server.

@dustymabe
Copy link
Member

I'd really like to not store the images uncompressed.

But... I'm not unwilling to be convinced otherwise. I'm just trying to suggest some alternatives until the server side is in a better state.

@lucab
Copy link
Contributor Author

lucab commented Jul 20, 2020

It's a bit backwards, but the steps would cover everything and wouldn't require the user to set up their own HTTPS server.

I just tried that and the flow is a bit longer but not too complex. We can keep the image compressed here, I'll update the docs adding the "decompress and upload to bucket" steps.

@lucab lucab closed this Jul 20, 2020
@lucab lucab deleted the ups/compress-skip-vultr branch July 20, 2020 12:54
@dustymabe
Copy link
Member

Thanks Luca!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants