ElasticSearch-Log-Analysis

Requriements

Requires a Machine with at least 8GB of RAM

Configure WSL2 to use max only 4GB of ram

wsl --shutdown
notepad "$env:USERPROFILE/.wslconfig"

.wslconfig file:

[wsl2]
memory=4GB   # Limits VM memory in WSL 2 up to 4GB

Enter in WSL before Start

sudo sysctl -w vm.max_map_count=262144

Kibana

SELECT * FROM "etl_monitori*" WHERE date = '2022-03-02'

Logging

1 Execute 01 to create index

2 go in Kibana :5601 and Stack management

2.1 in index management show new index

2.2 click on it to see the mapping

3 go to index patterns and create new index pattern for etl monitoring

4 execute 04 to bring in data

5 go to discover and show that the data is in

6 create a dashboard

7 create a visualization (use TSVB)

8 go back to discover and search for status error - see the error