Manual testing: Logstash module tutorials for 6.4.0 release

[justinkambic]

Netflow module tutorial

Mac OS

Scenario 1: On-Premise

This tests the scenario where Kibana and Elasticsearch are both running on localhost, listening on their default ports, 5601 and 9200, respectively.

• Download Elasticsearch + Kibana 6.4.0 (https://staging.elastic.co/6.4.0-26ea826c/summary-6.4.0.html#artifacts)
• Unzip/untar Elasticsearch
• Run Elasticsearch
• Unzip/untar Kibana
• Run Kibana
• Navigate to http://localhost:5601/app/kibana#/home/tutorial/netflow?_g=()
• Choose the On premise and macOS tabs and follow the instructions shown.
• After completing all the instructions:
  • Verify that the Netflow template is created in Elasticsearch: http://localhost:9200/_template/netflow

* [X] Verify that Netflow Kibana objects are created: http://localhost:5601/app/kibana#/management/kibana/objects

Scenario 2: On-Premise + Elastic Cloud

This tests the scenario where Kibana is running on localhost:5601 but Elasticsearch is running in Elastic Cloud.

Because Elastic Cloud won't have Elasticsearch 6.4.0 available (it hasn't been released yet!), we simulate this by running Elasticsearch 6.4.0 locally but with X-Pack installed (as is the case in Elastic Cloud).

• Download Elasticsearch + Kibana + X-Pack 6.4.0 (https://staging.elastic.co/6.4.0-26ea826c/summary-6.4.0.html#artifacts)
• Unzip/untar Elasticsearch
• Install the X-Pack plugin in Elasticsearch: bin/elasticsearch-plugin install file:///path/to/downloaded/x-pack-6.4.0.zip
• In the Elasticsearch install folder, run bin/elasticsearch-keystore add "bootstrap.password" and, when prompted for a password, enter changeme
• Run Elasticsearch
• Unzip/untar Kibana
• Install the X-Pack plugin in Kibana: bin/kibana-plugin install file:///path/to/downloaded/x-pack-6.4.0.zip
• In the Kibana install folder, edit config/kibana.yml and add:

  elasticsearch.username: elastic
  elasticsearch.password: changeme
  

• Run Kibana
• Navigate to http://localhost:5601/app/kibana#/home/tutorial/netflow?_g=()
• Choose the Elastic Cloud and macOS tabs and follow the instructions shown.
  • Go with Option 2 ("Connect local Kibana to a Cloud instance"). For <es_url> use http://localhost:9200.
• After completing all the instructions:
  • Verify that the Netflow template is created in Elasticsearch: http://localhost:9200/_template/netflow
  • Verify that Netflow Kibana objects are created: http://localhost:5601/app/kibana#/management/kibana/objects

Scenario 3: Elastic Cloud

This tests the scenario where both Kibana and Elasticsearch are running in Elastic Cloud.

Because Elastic Cloud won't have Kibana or Elasticsearch 6.4.0 available (they haven't been released yet!), we simulate this by running Kibana and Elasticsearch 6.4.0 locally but with X-Pack installed (as is the case in Elastic Cloud). Additionally, we enable a special plugin in Kibana that is normally only enabled when Kibana is running in Elastic Cloud.

• Download Elasticsearch + Kibana + X-Pack 6.4.0 (https://staging.elastic.co/6.4.0-26ea826c/summary-6.4.0.html#artifacts)
• Unzip/untar Elasticsearch
  * [X] Install the X-Pack plugin in Elasticsearch: bin/elasticsearch-plugin install file:///path/to/downloaded/x-pack-6.4.0.zip
• In the Elasticsearch install folder, run bin/elasticsearch-keystore add "bootstrap.password" and, when prompted for a password, enter changeme
• Run Elasticsearch
• Unzip/untar Kibana
• Install the X-Pack plugin in Kibana: bin/kibana-plugin install file:///path/to/downloaded/x-pack-6.4.0.zip
• In the Kibana install folder, edit config/kibana.yml and add:

  elasticsearch.username: elastic
  elasticsearch.password: changeme
  
  xpack.cloud.enabled: true
  xpack.cloud.id: doesnt_really_matter
  

• Run Kibana
• Visit http://cloud.elastic.co and create an Elastic Cloud cluster with default values.
  • Note the elastic user's password.
  • Note the Cloud ID.
  • Note the Elasticsearch URL.
  • Note the Kibana URL.
• Navigate to http://localhost:5601/app/kibana#/home/tutorial/netflow?_g=()
• Choose the macOS tab and follow the instructions shown.
  • In step 3 ("Edit the configuration") use the elastic user's password and Cloud ID you noted when you created the Elastic Cloud cluster.
• After completing all the instructions:
  • Verify that the Netflow template is created in Elasticsearch: ELASTIC_CLOUD_ES_URL/_template/netflow
  • Verify that Netflow Kibana objects are created: ELASTIC_CLOUD_KIBANA_URL/app/kibana#/management/kibana/objects

Windows

Scenario 1: On-Premise

This tests the scenario where Kibana and Elasticsearch are both running on localhost, listening on their default ports, 5601 and 9200, respectively.

• Download Elasticsearch + Kibana 6.4.0 (https://staging.elastic.co/6.4.0-26ea826c/summary-6.4.0.html#artifacts)
• Unzip/untar Elasticsearch
• Run Elasticsearch
• Unzip/untar Kibana
• Run Kibana
• Navigate to http://localhost:5601/app/kibana#/home/tutorial/netflow?_g=()
• Choose the On premise and Windows tabs and follow the instructions shown.
• After completing all the instructions:
  • Verify that the Netflow template is created in Elasticsearch: http://localhost:9200/_template/netflow
  • Verify that Netflow Kibana objects are created: http://localhost:5601/app/kibana#/management/kibana/objects

Scenario 2: On-Premise + Elastic Cloud

This tests the scenario where Kibana is running on localhost:5601 but Elasticsearch is running in Elastic Cloud.

Because Elastic Cloud won't have Elasticsearch 6.4.0 available (it hasn't been released yet!), we simulate this by running Elasticsearch 6.4.0 locally but with X-Pack installed (as is the case in Elastic Cloud).

• Download Elasticsearch + Kibana + X-Pack 6.4.0 (https://staging.elastic.co/6.4.0-26ea826c/summary-6.4.0.html#artifacts)
• Unzip/untar Elasticsearch
• Install the X-Pack plugin in Elasticsearch: bin\elasticsearch-plugin install file:\\\\C:\path\to\downloaded\x-pack-6.4.0.zip
• In the Elasticsearch install folder, run bin\elasticsearch-keystore add "bootstrap.password" and, when prompted for a password, enter changeme
• Run Elasticsearch
  • If you get an error about Machine Learning not being available for windows-x86, edit config\elasticsearch.yml, add xpack.ml.enabled: false, and re-run Elasticsearch
• Unzip/untar Kibana
• Install the X-Pack plugin in Kibana: bin\kibana-plugin install file:\\\C:\path\to\downloaded\x-pack-6.4.0.zip
• In the Kibana install folder, edit config\kibana.yml and add:

  elasticsearch.username: elastic
  elasticsearch.password: changeme
  

• Run Kibana
• Navigate to http://localhost:5601/app/kibana#/home/tutorial/netflow?_g=()
• Choose the Elastic Cloud and Windows tabs and follow the instructions shown.
  • Go with Option 2 ("Connect local Kibana to a Cloud instance"). For <es_url> use http://localhost:9200.
• After completing all the instructions:
  • Verify that the Netflow template is created in Elasticsearch: http://localhost:9200/_template/netflow
  • Verify that Netflow Kibana objects are created: http://localhost:5601/app/kibana#/management/kibana/objects

Scenario 3: Elastic Cloud

This tests the scenario where both Kibana and Elasticsearch are running in Elastic Cloud.

Because Elastic Cloud won't have Kibana or Elasticsearch 6.4.0 available (they haven't been released yet!), we simulate this by running Kibana and Elasticsearch 6.4.0 locally but with X-Pack installed (as is the case in Elastic Cloud). Additionally, we enable a special plugin in Kibana that is normally only enabled when Kibana is running in Elastic Cloud.

• Download Elasticsearch + Kibana + X-Pack 6.4.0 (https://staging.elastic.co/6.4.0-26ea826c/summary-6.4.0.html#artifacts)
• Unzip/untar Elasticsearch
• Install the X-Pack plugin in Elasticsearch: bin\elasticsearch-plugin install file:\\\\C:\path\to\downloaded\x-pack-6.4.0.zip
• In the Elasticsearch install folder, run bin\elasticsearch-keystore add "bootstrap.password" and, when prompted for a password, enter changeme
• Run Elasticsearch
• Unzip/untar Kibana
• Install the X-Pack plugin in Kibana: bin\kibana-plugin install file:\\\C:\path\to\downloaded\x-pack-6.4.0.zip
• In the Kibana install folder, edit config\kibana.yml and add:

  elasticsearch.username: elastic
  elasticsearch.password: changeme
  
  xpack.cloud.enabled: true
  xpack.cloud.id: doesnt_really_matter
  

• Run Kibana
• Visit http://cloud.elastic.co and create an Elastic Cloud cluster with default values.
  • Note the elastic user's password.
  • Note the Cloud ID.
  • Note the Elasticsearch URL.
  • Note the Kibana URL.
• Navigate to http://localhost:5601/app/kibana#/home/tutorial/netflow?_g=()
• Choose the Windows tab and follow the instructions shown.
  • In step 3 ("Edit the configuration") use the elastic user's password and Cloud ID you noted when you created the Elastic Cloud cluster.
• After completing all the instructions:
  • Verify that the Netflow template is created in Elasticsearch: ELASTIC_CLOUD_ES_URL/_template/netflow
  • Verify that Netflow Kibana objects are created: ELASTIC_CLOUD_KIBANA_URL/app/kibana#/management/kibana/objects