This document will describe how to install Logstash on IBM Cloud using Kubernetes services.
- Introduction
- Provision Kubernetes Cluster
- Deploy IBM Cloud Block-Storage Plugin
- Deploy Logstash
- Verifying the Logstash Installation
To complete this tutorial, you should have an IBM Cloud account, if you do not have one, please register/signup here. For installing Logstash, we have used the Kubernetes cluster, and used the IBM Cloud Block-Storage plugin for our persistent volume. Upon the completion of this tutorial, you would have the HashiCorp Consul up and running on the Kubernetes cluster.
- Provision the Kubernetes cluster, if you have already setup one, skip to step 2.
- Deploy the IBM Cloud Block-Storage Plugin to the created cluster, if you have already done this, skip to step 3.
- Deploy the Logstash.
-
Click on the Catalog button on top center. Open Catalog.
-
In search catalog box, search for Kubernetes Service and click on it.
-
You are now at Create Kubernetes Cluster page, there you have the two plans to create the Kubernetes cluster, either using free plan or standard plan.
Option1- Using Free Plan:
- Select Pricing Plan as “Free”.
- Click on Create.
- Wait a few minutes, and then your Cloud would be ready.
Note: Please be careful when choosing free cluster, as your pods could be stuck at pending state due to insufficient compute and memory resources, if you face such kind of issue please increase your resource by creating them choosing the standard plan.
Option2- Using Standard Plan:
-
Select Pricing Plan as “Standard”
-
Select your Kubernetes Version as latest available or desired one by application. In our example we have set it to be '1.18.14'.
-
Select Infrastructure as “Classic”
-
Leave Resource Group to “Default”
-
Select Geography as “Asia” or your desired one.
-
Select Availability as “Single Zone”.
This option allows you to create the resources in either single or multi availability zones. Multi availability zone provides you the option to create the resources in more than one availability zones so in case of catastrophe, it could sustain the disaster and continues to work.
-
Select Worker Zone as Chennai 01.
-
In Worker Pool, input your desired number of nodes as “3”
-
Leave the Encrypt Local Disk option to “On”
-
Select Master Service Endpoint to “Both private and public endpoints”
-
Give your cluster-name as “Logstash-Cluster”
-
Provide tags to your cluster and click on Create.
-
Wait a few minutes, and then your Cloud would be ready.
- Click on the Catalog button on top center.
- In search catalog box, search for IBM Cloud Block Storage Plug-In and click on it
- Select your cluster as "Logstash-Cluster"
- Provide Target Namespace as “logstash-storage”, leave name and resource group to default values.
- Click on Install
-
Again go to the Catalog and search for Logstash.
-
Provide the details as below.
-
Target: IBM Kubernetes Service
-
Method: Helm chart
-
Kubernetes cluster: Logstash-Cluster(jp-tok)
-
Target namespace: logstash
-
Workspace: logstash-01-13-2021
-
Resource group: Default
-
Click on Additional Parameters with Default Values, you can set the deployment values or use the default ones, we have used the default in this example.
-
Click on Install.
-
Go to the Resources List in the Left Navigation Menu and click on Kubernetes and then Clusters
-
Click on your created Logstash-Cluster.
-
A screen would come up for your created cluster, click on Actions, and then Web Terminal
-
A warning will appear asking you to install the Web Terminal, click on Install.
-
When the terminal is installed, click on the action button again and click on web terminal and type the following command in below command window. It will show you the workspaces of your cluster, you can see Logstash active.
$ kubectl get ns 
$ kubectl get pod –n Namespace –o wide 
$ kubectl get service –n Namespace 
$ kubectl exec --stdin --tty PODNAME -n NAMESPACE -- /bin/bash
$ logstash --version 
The installation is done. Enjoy!