Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SLM metadata incorrects skips parsing operation mode #46499

Closed
dakrone opened this issue Sep 9, 2019 · 2 comments
Closed

SLM metadata incorrects skips parsing operation mode #46499

dakrone opened this issue Sep 9, 2019 · 2 comments
Assignees
@dakrone
Labels
blocker :Data Management/ILM+SLM Index and Snapshot lifecycle management v7.4.0

Comments

@dakrone
Copy link
Member

dakrone commented Sep 9, 2019

In SnapshotLifecycleMetadata the XContent parser skips adding a parser for the operation mode. This causes the following exception on startup:

[2019-09-09T09:34:57,864][ERROR][o.e.g.GatewayMetaState   ] [perelandra] failed to read or upgrade local state, exiting...
org.elasticsearch.ElasticsearchException: java.io.IOException: failed to read /home/hinmanm/elasticsearch-7.4.0-SNAPSHOT/data/nodes/0/_state/global-22.st
	at org.elasticsearch.ExceptionsHelper.maybeThrowRuntimeAndSuppress(ExceptionsHelper.java:167) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:414) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:81) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(GatewayMetaState.java:141) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaState.java:95) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:485) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:255) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) [elasticsearch-cli-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) [elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
Caused by: java.io.IOException: failed to read /home/hinmanm/elasticsearch-7.4.0-SNAPSHOT/data/nodes/0/_state/global-22.st
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:408) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 15 more
Caused by: org.elasticsearch.common.xcontent.XContentParseException: [-1:24494] [snapshot_lifecycle] failed to parse field [policies]
	at org.elasticsearch.common.xcontent.ObjectParser.parseValue(ObjectParser.java:386) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseSub(ObjectParser.java:396) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parse(ObjectParser.java:238) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.parse(ConstructingObjectParser.java:169) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.xpack.ilm.IndexLifecycle.lambda$getNamedXContent$3(IndexLifecycle.java:186) ~[?:?]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry$Entry.lambda$new$0(NamedXContentRegistry.java:63) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:141) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:385) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$Builder.fromXContent(MetaData.java:1403) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1448) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1439) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.read(MetaDataStateFormat.java:302) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:404) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 15 more
Caused by: org.elasticsearch.common.xcontent.XContentParseException: Failed to build [snapshot_lifecycle] after last required field arrived
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.buildTarget(ConstructingObjectParser.java:476) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.constructorArg(ConstructingObjectParser.java:402) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.access$900(ConstructingObjectParser.java:350) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.lambda$declareNamedObjects$5(ConstructingObjectParser.java:288) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.lambda$declareNamedObjects$7(ObjectParser.java:345) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseValue(ObjectParser.java:384) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseSub(ObjectParser.java:396) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parse(ObjectParser.java:238) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.parse(ConstructingObjectParser.java:169) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.xpack.ilm.IndexLifecycle.lambda$getNamedXContent$3(IndexLifecycle.java:186) ~[?:?]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry$Entry.lambda$new$0(NamedXContentRegistry.java:63) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:141) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:385) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$Builder.fromXContent(MetaData.java:1403) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1448) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1439) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.read(MetaDataStateFormat.java:302) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:404) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 15 more
Caused by: java.lang.ArrayIndexOutOfBoundsException: Index 1 out of bounds for length 1
	at org.elasticsearch.xpack.core.slm.SnapshotLifecycleMetadata.lambda$static$1(SnapshotLifecycleMetadata.java:51) ~[?:?]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.lambda$new$2(ConstructingObjectParser.java:132) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.buildTarget(ConstructingObjectParser.java:463) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.constructorArg(ConstructingObjectParser.java:402) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.access$900(ConstructingObjectParser.java:350) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.lambda$declareNamedObjects$5(ConstructingObjectParser.java:288) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.lambda$declareNamedObjects$7(ObjectParser.java:345) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseValue(ObjectParser.java:384) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseSub(ObjectParser.java:396) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parse(ObjectParser.java:238) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.parse(ConstructingObjectParser.java:169) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.xpack.ilm.IndexLifecycle.lambda$getNamedXContent$3(IndexLifecycle.java:186) ~[?:?]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry$Entry.lambda$new$0(NamedXContentRegistry.java:63) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:141) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:385) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$Builder.fromXContent(MetaData.java:1403) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1448) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1439) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.read(MetaDataStateFormat.java:302) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:404) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 15 more
[2019-09-09T09:34:57,907][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [perelandra] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: ElasticsearchException[java.io.IOException: failed to read /home/hinmanm/elasticsearch-7.4.0-SNAPSHOT/data/nodes/0/_state/global-22.st]; nested: IOException[failed to read /home/hinmanm/elasticsearch-7.4.0-SNAPSHOT/data/nodes/0/_state/global-22.st]; nested: XContentParseException[[-1:24494] [snapshot_lifecycle] failed to parse field [policies]]; nested: XContentParseException[Failed to build [snapshot_lifecycle] after last required field arrived]; nested: ArrayIndexOutOfBoundsException[Index 1 out of bounds for length 1];
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
Caused by: org.elasticsearch.ElasticsearchException: java.io.IOException: failed to read /home/hinmanm/elasticsearch-7.4.0-SNAPSHOT/data/nodes/0/_state/global-22.st
	at org.elasticsearch.ExceptionsHelper.maybeThrowRuntimeAndSuppress(ExceptionsHelper.java:167) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:414) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:81) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(GatewayMetaState.java:141) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaState.java:95) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:485) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:255) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 6 more
Caused by: java.io.IOException: failed to read /home/hinmanm/elasticsearch-7.4.0-SNAPSHOT/data/nodes/0/_state/global-22.st
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:408) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:81) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(GatewayMetaState.java:141) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaState.java:95) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:485) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:255) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 6 more
Caused by: org.elasticsearch.common.xcontent.XContentParseException: [-1:24494] [snapshot_lifecycle] failed to parse field [policies]
	at org.elasticsearch.common.xcontent.ObjectParser.parseValue(ObjectParser.java:386) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseSub(ObjectParser.java:396) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parse(ObjectParser.java:238) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.parse(ConstructingObjectParser.java:169) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.xpack.ilm.IndexLifecycle.lambda$getNamedXContent$3(IndexLifecycle.java:186) ~[?:?]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry$Entry.lambda$new$0(NamedXContentRegistry.java:63) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:141) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:385) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$Builder.fromXContent(MetaData.java:1403) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1448) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1439) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.read(MetaDataStateFormat.java:302) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:404) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:81) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(GatewayMetaState.java:141) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaState.java:95) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:485) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:255) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 6 more
Caused by: org.elasticsearch.common.xcontent.XContentParseException: Failed to build [snapshot_lifecycle] after last required field arrived
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.buildTarget(ConstructingObjectParser.java:476) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.constructorArg(ConstructingObjectParser.java:402) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.access$900(ConstructingObjectParser.java:350) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.lambda$declareNamedObjects$5(ConstructingObjectParser.java:288) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.lambda$declareNamedObjects$7(ObjectParser.java:345) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseValue(ObjectParser.java:384) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseSub(ObjectParser.java:396) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parse(ObjectParser.java:238) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.parse(ConstructingObjectParser.java:169) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.xpack.ilm.IndexLifecycle.lambda$getNamedXContent$3(IndexLifecycle.java:186) ~[?:?]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry$Entry.lambda$new$0(NamedXContentRegistry.java:63) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:141) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:385) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$Builder.fromXContent(MetaData.java:1403) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1448) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1439) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.read(MetaDataStateFormat.java:302) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:404) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:81) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(GatewayMetaState.java:141) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaState.java:95) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:485) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:255) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 6 more
Caused by: java.lang.ArrayIndexOutOfBoundsException: Index 1 out of bounds for length 1
	at org.elasticsearch.xpack.core.slm.SnapshotLifecycleMetadata.lambda$static$1(SnapshotLifecycleMetadata.java:51) ~[?:?]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.lambda$new$2(ConstructingObjectParser.java:132) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.buildTarget(ConstructingObjectParser.java:463) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.constructorArg(ConstructingObjectParser.java:402) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser$Target.access$900(ConstructingObjectParser.java:350) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.lambda$declareNamedObjects$5(ConstructingObjectParser.java:288) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.lambda$declareNamedObjects$7(ObjectParser.java:345) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseValue(ObjectParser.java:384) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parseSub(ObjectParser.java:396) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ObjectParser.parse(ObjectParser.java:238) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.ConstructingObjectParser.parse(ConstructingObjectParser.java:169) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.xpack.ilm.IndexLifecycle.lambda$getNamedXContent$3(IndexLifecycle.java:186) ~[?:?]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry$Entry.lambda$new$0(NamedXContentRegistry.java:63) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:141) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:385) ~[elasticsearch-x-content-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$Builder.fromXContent(MetaData.java:1403) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1448) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.cluster.metadata.MetaData$1.fromXContent(MetaData.java:1439) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.read(MetaDataStateFormat.java:302) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaDataStateFormat.loadGeneration(MetaDataStateFormat.java:404) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:81) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(GatewayMetaState.java:141) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaState.java:95) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:485) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.node.Node.<init>(Node.java:255) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0-SNAPSHOT.jar:7.4.0-SNAPSHOT]
	... 6 more

And prevents the node from starting.
@dakrone dakrone added blocker :Data Management/ILM+SLM Index and Snapshot lifecycle management v7.4.0 labels Sep 9, 2019
@dakrone dakrone self-assigned this Sep 9, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features

@dakrone dakrone mentioned this issue Sep 9, 2019
Merged
dakrone added a commit that referenced this issue Sep 9, 2019
@dakrone
Fix SnapshotLifecycleMetadata xcontent serialization (#46500)
7cd54be 
This adds the missing xcontent parser for the operation_mode of SLM. It
also adds serialization test for the class.

Resolves #46499
@dakrone dakrone mentioned this issue Sep 11, 2019
Closed
26 tasks
@dakrone
Copy link
Member Author

dakrone commented Sep 11, 2019

This has been resolved in #46500

@dakrone dakrone closed this as completed Sep 11, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dakrone dakrone

Labels
blocker :Data Management/ILM+SLM Index and Snapshot lifecycle management v7.4.0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dakrone @elasticmachine