DevOps_project

Demo Video

Project Daigram

Infrastructure on AWS

GitHub Branches

main branch containes:

• Python code which uses Ansible and Terraform for configuring and building infrastructure on AWS and outputting the servers IPs, Jenkins Password and Nexus Password
• Terraform code which contains 3 models and use them to build the infrastructure on AWS
• Ansible code which contains 4 roles and uses them to Configure the infrastructure on AWS

ci branch contains:

• Java web application source code
• Dockerfile to build docker image from this source code
• Jenkinsfile for Continuous integration pipeline

cd branch contains:

• Kubernetes YAML files (Java application, Nginx ingress, ArgoCD)
• Jenkinsfile for Continuous Delivery pipeline
• Bash script that the Jenkinsfile will use to deploy Prometheus, Grafana and ArgoCD

Prequsits

• awscli configured
• Python, Terraofmr and Ansible installed
• GitHub account
• Slack account with namespace that has Jenkins CI configured in it

To configure Jenkins CI on slack

Installed Jenkins Plugins:

Note: this plugins is installed using Plugin Installation Manager by Ansible inside the python code

• Maven Integration plugin
• Oracle Java SE Development Kit Installer Plugin
• Nexus Artifact Uploader
• SonarQube Scanner for Jenkins
• Slack Notification Plugin
• Build Timestamp Plugin

Steps

clone this repo

git clone https://github.com/moe-Ali/DevOps_project

change the working directory to the cloned repo then run the python script to build the infrastructure

cd DevOps_project
python main.py

Note: Python script will output jenkins password and nexus password after the infrastructure is built and configured

Example of the python output:

on Jenkins:

• sign in using the password that the python script outputed
• Create Credentials:
  • awslogin => type: username with password
  • githublogin => type: ssh username with privatekey
  • sonartoken => type: secret text
  • nexuslogin => type: username with password
  • slacktoken => type: secret text
• Configure Global tools:
  • JDK => Name: JDK_8 , JAVA_HOME: /usr/lib/jvm/java-1.8.0-openjdk-amd64
  • SonarQube Scanner => Name: sonarscanner , check mark "Install automatically"
  • Maven => Name: maven_3.9.1 , check mark "Install automatically"
• Configure System:
  • Slack => Workspace: the workspace that has Jenkins CI , Credential: slacktoken , Default channel: the channel selected for Jenkins CI
  • SonarQube servers => check mark "Environment variables" , Name: sonarserver , Server URL: http://{your sonarqube server ip}:9000 , Server authentication token: sonartoken
• Change the Variables in the Jenkinsfile (specially the NEXUSIP)
• Create Pipeline and check mark "GitHub hook trigger for GITScm polling", choose the pipeline to be from SCM, then fork my repo branch ci and use it as Repository URL

on Nexus:

• sign in using username admin and password that the python script outputed
• go to conigration then select repository:
  • Create repository Docker (hosterd) and name it anything and make it accessible on HTTP port 5000
• Configure DNS for the Nexus server (I used duckdns)
• Configure Nginx proxy for the Nexus Docker repository
• Configure SSL/TLS for Nginx (I used lets Encrypt)
• Change the environment values in the ci Jenkinsfile

run the pipeline manauly, it will abort due to a SonarQube webhook not being configured

on SonarQube:

• From projects select devops_project
• From project settings select configure webhook then create a webhook with anyname and the url: http://{your jenkins private ip}:8080/sonarqube-webhook

on github

• create a webhook from the forked repo to your jenkins ip (http://{your jenkins ip}/github-webhook/)