Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions docs/reference/how-to/size-your-shards.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -544,3 +544,36 @@ PUT _cluster/settings
}
}
----

[discrete]
==== Number of documents in the shard cannot exceed [2147483519]


Elasticsearch shards reflect Lucene's underlying https://github.com/apache/lucene/issues/5176[index
`MAX_DOC` hard limit] of 2,147,483,519 (`(2^31)-129`) docs. This figure is
the sum of `docs.count` plus `docs.deleted` as reported by the <<indices-stats,Index stats API>>
per shard. Exceeding this limit will result in errors like the following:

[source,txt]
----
Elasticsearch exception [type=illegal_argument_exception, reason=Number of documents in the shard cannot exceed [2147483519]]
----

TIP: This calculation may differ from the <<search-count,Count API's>> calculation, because the Count API does not include nested documents.


Try using the <<indices-forcemerge,Force Merge API>> to clear deleted docs. For example:

[source,console]
----
POST my-index-000001/_forcemerge?only_expunge_deletes=true
----
// TEST[setup:my_index]

This will launch an asynchronous task which can be monitored via the <<tasks,Task Management API>>.

For a long-term solution try:

* <<docs-delete-by-query,deleting unneeded documents>>
* aligning the index to recommendations on this page by either
<<indices-split-index,Splitting>> or <<docs-reindex,Reindexing>> the index