running OpenFoam job on AWS Batch
by using these scripts and commands, you can run OpenFoam job on AWS Batch.
-
building up base infrastructure and Docker build server for AWS Batch by CloudFormation
-
CloudFormation will create...
- VPC
- Public Subnet
- Security Group
- Ubuntu16.6 (for Docker Build)
- SpotFleet Role
- AWS Batch Service Role
- AWS Batch Job Role
- Docker Container repo (ECR)
- S3 Bucket
-
after the base infrastructure become ready, build docker image and push it to AWS ECR.
-
create job definition, compute environment and job queue for AWS Batch
-
submit jobs to AWS Batch
-
part of result data will be upload to S3 bucket which is created by CloudFormation
this docker image was verified with following version ubuntu = 14.04 openfoam = 4.1 paraview = 5.0 awscli = 1.11.123
- login to aws console with admin
- go to EC2
- create a KeyPair
- run CloudFormation for AWS Batch base infrastructure
- login to bastion ubuntu server
- run ubuntu setup script
- build Docker images with the Dockerfile
- push the images to AWS ECR
- edit json files based on created AWS resources
- create job definition on AWS Batch
- create computing environment on AWS Batch
- create job queue on AWS Batch
- submit jobs
Submitting OpenFOAM jobs to AWS Batch while sweeping its parameter