Our project is to develop a cloud-based image recognition service that leverages deep learning to classify and identify images provided by users. The service will be accessible to users via a web interface, and it will utilize cloud resources to perform the deep learning computations needed for image recognition.
This is an elastic application that can automatically scale out and in on-demand by leveraging the Infrastructure-as-a-Service (IaaS) resources from Amazon Web Services (AWS).
Install Unzip (If you do not have it installed)
sudo apt install unzip
Install AWS CLI
curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install
Set Up the AWS (Add access key, secret, region and format)
aws configure
Install Dependencies
pip install -r requirements.txt
Start Web-Tier
python3 server.py
Start App-Tier
python3 app/app.py
Now web server will be listening on http://127.0.0.1:3000/. It will take Image file as payload. Image will be stored on S3 Bucket and key of image will be sent to request-queue(SQS). App-Tier will continously processing images and sending output on response-queue(SQS). Web-Tier will fetch responses and return it to the client.
Create .service file
sudo touch /etc/systemd/system/myservice.service
Edit .service file
sudo nano /etc/systemd/system/myservice.service
Copy this service file into the .service created and save the .service file (change the path according to your system)
[Unit]
Description=Run AppTier Service Each Time Server Starts Up
After=network.target
[Service]
User=ubuntu
WorkingDirectory=/home/ubuntu/
ExecStart=/usr/bin/python3 /home/ubuntu/app.py
Restart=always
[Install]
WantedBy=multi-user.target
Reload the systemd daemon to read the new service file
sudo systemctl daemon-reload
Enable the service to start at boot time
sudo systemctl enable myservice.service
Start the service
sudo systemctl start myservice.service
-
SQS Request Queue: request-queue
-
SQS Response Queue: response-queue
-
S3 Input Bucket: cse546-cc-autoscale-input-bucket
-
S3 Output Bucket: cse546-image-processing-op
-
EC2 Web-Tier: CC-ImageProcessing-Web
-
EC2 App-Tier: cc-image-processing-app-tier
Web-Tier contains server.py, resources/s3.py, resources/sqs.py, resources/__init__.py
App-Tier contains app/app.py, app/image_classification.py, app/imagenet-labels.json, app/__init__.py, resources/s3.py, resources/sqs.py, resources/__init__.py
resouces folder is shared by Web-Tier and App-Tier. It contains basic operations related to S3 and SQS
requirements.txt
is common for Web-Tier and App-Tier.
workload_generator.py
and multithread_workload_generator.py
are used to test the services.