ES Toolkit

ES ToolKit is a standalone solution to navigate and backup data for a wide range of Elasticsearch and Kibana versions.

Features

• Automatic software and version detection
• Query support
• Low memory/CPU footprint
• Dump directly to file or stdout
• Live progress
• Proxy support

Usage

List index

estk list -h

Displays help for the list command.

Flag	Description
--url	Elasticsearch/Kibana root URL

Dump index

estk dump -h

Displays help for the dump command.

Flag	Description
--url	Elasticsearch/Kibana root URL
--index	Name of the index to dump ( wildcard supported )
--query-string	Dump specific documents
--size	Bulk size, max amount of document per request

Installation Instructions

From Binary

The installation is easy. You can download the pre-built binaries for your platform from the Releases page.

▶ chmod +x estk-linux-64
▶ mv estk-linux-64 /usr/local/bin/estk

From Source

▶ GO111MODULE=on go get -u -v github.com/LeakIX/estk
▶ ${GOPATH}/bin/estk -h

Running estk

▶ estk --url http://127.0.0.1:5602 dump -i "hostserviceleak" -o hostserviceleak.json -d -q "type:mysql"
2020/12/16 20:12:15 Detecting version...
2020/12/16 20:12:15 Trying elasticsearch
2020/12/16 20:12:15 Trying Kibana
2020/12/16 20:12:15 Found kibana, major version 7
2020/12/16 20:12:15 Dump starting...
2020/12/16 20:12:15 Endpoint : http://127.0.0.1:5602
2020/12/16 20:12:15 Index : hostserviceleak
2020/12/16 20:12:15 Output file : hostserviceleak.json
2020/12/16 20:12:16 Got scrollId : FGluY2x1ZGVfY29udGV4dF91dWlkDnF1ZXJ5VGhlbkZldGNoAhRLRVQzYkhZQnowRHZjdlFkblNHWgAAAAABlhWbFnpNNWpoU3RhUk5Td3hCVXAxd1k2TUEUS1VUM2JIWUJ6MER2Y3ZRZG5TR1oAAAAAAZYVnBZ6TTVqaFN0YVJOU3d4QlVwMXdZNk1B
2020/12/16 20:12:16 Dumping 2292659 documents :
   1% |                                                    | (34201/2292659, 242 it/s) [2m23s:2h35m22s]