Skip to content

feat: enable customizable storage size for ephemeral scratch volumes#2219

Merged
mergify[bot] merged 91 commits intoaws:mainlinefrom
bvtujo:feature-ees
Apr 29, 2021
Merged

feat: enable customizable storage size for ephemeral scratch volumes#2219
mergify[bot] merged 91 commits intoaws:mainlinefrom
bvtujo:feature-ees

Conversation

@bvtujo
Copy link
Copy Markdown
Contributor

@bvtujo bvtujo commented Apr 26, 2021

This enables the upcoming customizable ephemeral task storage feature. This will allow customers to specify the size of their Fargate scratch storage, from 20 to 16000 GiB. This storage is shareable between containers in the same task using bind mounts (empty volumes) using the following syntax:

count: 2

storage:
  ephemeral: 200 // Size in GiB
  volumes:
    scratch:
      path: /var/data
      read_only: false

sidecars:
  downloader:
    image: public.ecr.aws/my-image:latest
    essential: false
    mount_points:
      - source_volume: scratch
        path: /var/data
        read_only: false

This will result in 1000 GiB of ephemeral storage which can be used separately by all containers, or shared between the two service containers and the sidecar with a bind mount in the /var/data directory.

Additional charges will be incurred for volumes larger than the default 20GiB size.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Author: penghaoh <penghaoh@amazon.com>
Date: 2020-11-30T22:14:28.000Z

Address feedback

commit c09bbba6bd10d646417510d998451a1f2e141bbe
Author: penghaoh <penghaoh@amazon.com>
Date: 2020-11-23T23:23:21.000Z

chore: add boilerplate for copilot exec

cr https://code.amazon.com/reviews/CR-39357784

commit 46a0f2bea06e6436e1ecf333546f5a3fa50411e2
Author: penghaoh <penghaoh@amazon.com>
Date: 2020-11-23T20:14:22.000Z

chore: add custom aws-sdk-go for ECS

cr https://code.amazon.com/reviews/CR-39348057

commit 25be354
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: 2020-11-30T17:07:40.000Z

chore: Bump github.com/briandowns/spinner from 1.11.1 to 1.12.0 (aws#1729)

Bumps [github.com/briandowns/spinner](https://github.com/briandowns/spinner) from 1.11.1 to 1.12.0.
- [Release notes](https://github.com/briandowns/spinner/releases)
- [Commits](briandowns/spinner@v1.11.1...v1.12)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
commit ef735c9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: 2020-11-30T17:02:37.000Z

chore: Bump github.com/aws/aws-sdk-go from 1.35.33 to 1.35.35 (aws#1730)

Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.35.33 to 1.35.35.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/master/CHANGELOG.md)
- [Commits](aws/aws-sdk-go@v1.35.33...v1.35.35)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit ce836bd
Author: Janice Huang <60631893+huanjani@users.noreply.github.com>
Date: 2020-11-24T22:43:38.000Z

chore(cli): make the dashes under column headings consistent (aws#1705)

Wherever command output is in tabular format, this brings consistency to our formatting-- dashes (same length as heading, not longest element) below the headings.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

commit 6128e9c
Author: Janice Huang <60631893+huanjani@users.noreply.github.com>
Date: 2020-11-24T20:22:47.000Z

feat(cli): display secrets as subcategory in `svc_show` (aws#1704)

This change displays secrets as a separate category (not within "Variables") in `svc show`. If the secret value comes from Parameter Store, it is preceded by `parameter/`. Otherwise, if it comes from Secrets Manager, it is displayed as an ARN.

Addresses aws#720

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

commit 42567bf
Author: Efe Karakus <karakuse@amazon.com>
Date: 2020-11-23T21:39:32.000Z

docs(README): remove preview program description (aws#1722)

_By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice._
@bvtujo bvtujo added the do-not-merge Pull requests that mergify shouldn't merge until the requester allows it. label Apr 26, 2021
@bvtujo bvtujo requested a review from a team as a code owner April 26, 2021 18:54
@bvtujo bvtujo requested a review from Lou1415926 April 26, 2021 18:54
Comment thread internal/pkg/deploy/cloudformation/stack/transformers.go Outdated
Comment thread internal/pkg/deploy/cloudformation/stack/transformers.go Outdated
Copy link
Copy Markdown
Contributor

@Lou1415926 Lou1415926 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The code LGTM!

@bvtujo bvtujo removed the do-not-merge Pull requests that mergify shouldn't merge until the requester allows it. label Apr 29, 2021
@mergify mergify Bot merged commit 145cb19 into aws:mainline Apr 29, 2021
thrau pushed a commit to localstack/copilot-cli-local that referenced this pull request Dec 9, 2022
…ws#2219)

<!-- Provide summary of changes -->
This enables the upcoming customizable ephemeral task storage feature. This will allow customers to specify the size of their Fargate scratch storage, from 20 to 16000 GiB. This storage is shareable between containers in the same task using bind mounts (empty volumes) using the following syntax:

```yaml
count: 2

storage:
  ephemeral: 200 // Size in GiB
  volumes:
    scratch:
      path: /var/data
      read_only: false

sidecars:
  downloader:
    image: public.ecr.aws/my-image:latest
    essential: false
    mount_points:
      - source_volume: scratch
        path: /var/data
        read_only: false
```

This will result in 1000 GiB of ephemeral storage which can be used separately by all containers, or shared  between the two service containers and the sidecar with a bind mount in the `/var/data` directory.

 Additional charges will be incurred for volumes larger than the default 20GiB size. 

<!-- Issue number, if available. E.g. "Fixes aws#31", "Addresses aws#42, 77" -->

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants