ECS Training

Cloud Shell

1. Go to cloudshell. .
2. Check that terraform is installed.

terraform -version

3. To install terraform run the following commands.

wget https://releases.hashicorp.com/terraform/1.7.4/terraform_1.7.4_linux_amd64.zip
unzip terraform_1.7.4_linux_amd64.zip
sudo mv terraform /usr/local/bin

6. Install session manager plugin

sudo curl --silent --location "https://s3.amazonaws.com/session-manager-downloads/plugin/latest/linux_64bit/session-manager-plugin.rpm" -o "session-manager-plugin.rpm"
sudo yum install session-manager-plugin.rpm

Push and Pull and Image to ECR

Create the repository

1. Open the Amazon ECR console at https://console.aws.amazon.com/ecr/repositories.
2. From the navigation bar, choose the Region to create your repository in.
3. On the Repositories page, choose Private repositories, and then choose Create repository.
4. For Repository name, enter a unique name for your repository.
5. Use the default settings for the additional parameters.
6. Choose Create.

push the image

1. Create a Folder hello_app

mkdir hello_app

2. Inside the folder create a python script hello_world.py with the following content

cd hello_app 
echo 'print("Hello, World!")' > hello_world.py 

3. In the Same Folder create a dockerfile with the following content

 printf 'FROM python:3.8\n\n# Set the working directory to /app\nWORKDIR /app\n\n# Copy the current directory contents into the container at /app\nCOPY ./hello_world.py /app\n\n# Set the entry point to run the scripts\nENTRYPOINT ["python", "hello_world.py"]\n' > Dockerfile

 cat Dockerfile

4. Build the image docker build -t my-hello-world .
5. Select the repository and click the button view push commands

• Authenticate with the repository

aws ecr get-login-password --region ap-southeast-2 | docker login --username AWS --password-stdin <account_number>.dkr.ecr.<region>.amazonaws.com

• Tag the image

docker tag my-hello-world <account_number>.dkr.ecr.<region>.amazonaws.com/hello_app:latest

• Push the image

docker tag my-hello-world <account_number>.dkr.ecr.<region>.amazonaws.com/hello_app:latest

Create networking, cluster and ECS service

1. Clone the training repository.

git clone https://github.com/dianibar/ecs-training.git

2. Open the file ecs-training/ecs-cluster/complete/main.tf and replace the string with your own name

name   = "<user>-${basename(path.cwd)}"

2. Apply the terraform template.

cd ecs-training/ecs-cluster
terraform init
terraform apply

3. Explore the cluster and the resources created.

Access the container using ECS Exec

Open the file ecs-training/ecs-cluster/complete/main.tf and do the following modifications:

1. Modify the cluster to configure the CloudWatch log group where the exec will be logged

   ...
   cluster_name = local.name
   
   cluster_configuration = {
   execute_command_configuration = {
     logging = "OVERRIDE"
     log_configuration = {
       cloud_watch_log_group_name = "/aws/ecs/ecs-exec-demo"
     }
   }
   

}

services = { ...

2. In the container enable ecs-exec using 'enable_execute_command = true'

ecsdemo-frontend = {
  enable_execute_command = true
  cpu    = 1024

3. Add permissions to the service task to access ssm and CloudWatch Logs:

  tasks_iam_role_statements = [
    {
      actions   = ["s3:List*"]
      resources = ["arn:aws:s3:::*"]
    },
    {
      actions   = ["logs:CreateLogStream", 
        "logs:PutLogEvents", 
        "logs:DescribeLogStreams"]
      resources = ["*"]
    },
    {
      actions   = ["ssmmessages:CreateControlChannel",
        "ssmmessages:CreateDataChannel",
        "ssmmessages:OpenControlChannel",
        "ssmmessages:OpenDataChannel"]
      resources = ["*"]
    }

  ]

4. Apply the changes

terraform apply

5. Access the container

aws ecs execute-command
--region ap-southeast-2
--cluster
--task
--container
--command "/bin/bash"
--interactive

## Add Fargate Spot instances

1. Add the capacity provider to the cluster

... cluster_configuration = { execute_command_configuration = { logging = "OVERRIDE" log_configuration = { cloud_watch_log_group_name = "/aws/ecs/ecs-exec-demo" } } }

Capacity provider

fargate_capacity_providers = { FARGATE = { default_capacity_provider_strategy = { weight = 1 base = 1 } } FARGATE_SPOT = { default_capacity_provider_strategy = { weight = 1 } } }

services = { ...

2. Open the file ecs-training/ecs-cluster/complete/main.tf and add the capacity provider to the service:

services = { ecsdemo-frontend = { capacity_provider_strategy = { fargate = { capacity_provider = "FARGATE" weight = 1 base = 1 } spot = { capacity_provider = "FARGATE_SPOT" weight = 1 } }

2. Apply the changes

terraform apply

3. Modify the desired_count to four

ecsdemo-frontend = {

  capacityProviderStrategy = {
      "capacityProvider": "FARGATE_SPOT",
      "weight": 1,
      "base": 0
  }
  capacityProviderStrategy = {
      "capacityProvider": "FARGATE",
      "weight": 1,
      "base": 1
  }
  
  enable_execute_command = true
  
  desired_count          = 4
  cpu                    = 1024

5. Apply the changes

terraform apply

Create a scheduled task in the EventBridge Scheduler console

1. Open the Amazon EventBridge Scheduler console at https://console.aws.amazon.com/scheduler/home.

2. On the Schedules page, choose Create schedule.

3. On the Specify schedule detail page, in the Schedule name and description section. For Schedule group choose default.

4. Choose your schedule options. https://docs.aws.amazon.com/scheduler/latest/UserGuide/schedule-types.html#cron-based

5. Choose Next.

6. On the Select target page, do the following:

   • Choose All APIs, and then in the search box enter ECS.

   • Select Amazon ECS.

   • In the search box, enter RunTask, and then choose RunTask.

   • For ECS cluster, choose the cluster.

   • For ECS task, choose the task definition to use for the task.

   • To use a launch type, expand Compute options, and then select Launch type. Then, choose the launch type FARGATE.

   • Leave Platform version empty. If there is no platform specified, the LATEST platform version is used.

   • For Subnets, choose one of the public subnets

   • For Security groups, enter the security group IDs for the VPC the one with the port 80 open to everywhere.

   • Enable Auto-assign public IP

   • Leave the default for the other options

Acknowledgments

• Getting started with Cloud 9
• Running a Batch job using AWS Batch and Docker Image
• Using Amazon ECS Exec for debugging

(back to top)

eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJLZXkiOiJqSUN1YWRuUldsUXh1aEMxa1duUi4xNzMzNDY1NzQ2LmFJNUN5NUFiaWVBMXdMamsiLCJVc2VySUQiOiJnb29nbGU6MTA4OTc2MjY2ODY2Mzc5NDM0MDI1IiwiRG9pdE93bmVyIjpmYWxzZSwiRG9pdEVtcGxveWVlIjp0cnVlLCJhdWQiOiJjbXAiLCJpYXQiOjE3MzM0NjU3NDYsImlzcyI6ImRvaXQiLCJzdWIiOiJkaWFuYUBkb2l0LmNvbSJ9.9jLWDVjabPk8MsLvnb7ulpWp1w5GBNB7dQW4jSOG_e4