Skip to content

Releases: miku/esbulk

esbulk 0.3.8

08 Sep 14:36
Compare
Choose a tag to compare

Allow reuse of document ids for elasticsearch via -id flag.

If you want to reuse IDs from your documents in elasticsearch, you
can specify the ID field via -id flag:

$ cat file.json
{"x": "doc-1", "db": "mysql"}
{"x": "doc-2", "db": "mongo"}

Here, we would like to reuse the ID from field x.

$ esbulk -id x -index throwaway -verbose file.json
...

$ curl -s http://localhost:9200/throwaway/_search | jq
{
  "took": 2,
  "timed_out": false,
  "_shards": {
    "total": 5,
    "successful": 5,
    "failed": 0
  },
  "hits": {
    "total": 2,
    "max_score": 1,
    "hits": [
      {
        "_index": "throwaway",
        "_type": "default",
        "_id": "doc-2",
        "_score": 1,
        "_source": {
          "x": "doc-2",
          "db": "mongo"
        }
      },
      {
        "_index": "throwaway",
        "_type": "default",
        "_id": "doc-1",
        "_score": 1,
        "_source": {
          "x": "doc-1",
          "db": "mysql"
        }
      }
    ]
  }
}

esbulk 0.3.7

22 Jun 17:54
Compare
Choose a tag to compare
  • added -server flag, so we can use https as well, e.g. esbulk -server https://localhost:9200
  • -host and -port are still there but are deprecated

esbulk 0.3.5

10 Nov 11:03
Compare
Choose a tag to compare
  • add -purge and -mapping flag

esbulk 0.3.3

07 May 18:47
Compare
Choose a tag to compare

Slightly better error handling.

esbulk 0.3.2

01 Dec 14:50
Compare
Choose a tag to compare
  • fix panics on connection errors

esbulk 0.3.1

30 Nov 21:56
Compare
Choose a tag to compare

Fix index.refresh_interval handling. Improve performance by 10-30%.

esbulk 0.3.0

30 Nov 21:22
Compare
Choose a tag to compare
  • backwards-incompatible change: removed -q, added -verbose
  • added support for gzipped input files
  • move bulk indexing functions from package main to package esbulk, so other libraries can import it

esbulk 0.2.4

23 Oct 09:38
Compare
Choose a tag to compare

Minor documentation updates.

esbulk 0.2.3

29 Sep 16:34
Compare
Choose a tag to compare

Flush index at the end. Minor improvements.

esbulk 0.2.2

29 Sep 15:48
Compare
Choose a tag to compare

Adjust index.refresh_interval during indexing.