Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error on job cleanup in RODA initialization after forced crash #1102

Closed
luis100 opened this issue Nov 28, 2017 · 3 comments
Closed

Error on job cleanup in RODA initialization after forced crash #1102

luis100 opened this issue Nov 28, 2017 · 3 comments
Assignees
@luis100
Labels
bug
Milestone
2.2.0-beta2

Comments

@luis100
Copy link
Member

luis100 commented Nov 28, 2017

Running a big ingest process in a docker swarm setup and then doing a drain in the node which had RODA (while ingesting). When RODA initiates on another node, it starts cleaning up the job, but the following error occurs:

RODA_roda.1.vajb6v1s80pe@lzwork    | 2017-11-28 14:37:52,985 [localhost-startStop-1] ERROR org.roda.core.RodaCoreFactory - Error instantiating RodaCoreFactory
RODA_roda.1.vajb6v1s80pe@lzwork    | java.util.NoSuchElementException: Index: 0, Size: 0
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.index.utils.IterableIndexResult$IteratorIndexResult.next(IterableIndexResult.java:68)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.index.utils.IterableIndexResult$IteratorIndexResult.next(IterableIndexResult.java:42)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.plugins.orchestrate.JobsHelper.doJobCleanup(JobsHelper.java:395)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.plugins.orchestrate.JobsHelper.doJobObjectsCleanup(JobsHelper.java:387)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.plugins.orchestrate.AkkaEmbeddedPluginOrchestrator.cleanUnfinishedJobs(AkkaEmbeddedPluginOrchestrator.java:453)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.plugins.orchestrate.AkkaEmbeddedPluginOrchestrator.cleanUnfinishedJobs(AkkaEmbeddedPluginOrchestrator.java:435)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.RodaCoreFactory.instantiateMasterNodeSpecificObjects(RodaCoreFactory.java:883)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.RodaCoreFactory.instantiateNodeSpecificObjects(RodaCoreFactory.java:863)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.RodaCoreFactory.instantiate(RodaCoreFactory.java:305)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.RodaCoreFactory.instantiateMaster(RodaCoreFactory.java:235)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.core.RodaCoreFactory.instantiate(RodaCoreFactory.java:224)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.roda.wui.servlets.RodaWuiServlet.init(RodaWuiServlet.java:27)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at javax.servlet.GenericServlet.init(GenericServlet.java:158)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1183)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1099)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:989)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:4931)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5241)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:752)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:728)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:734)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1144)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at org.apache.catalina.startup.HostConfig$DeployDirectory.run(HostConfig.java:1878)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
RODA_roda.1.vajb6v1s80pe@lzwork    | 	at java.lang.Thread.run(Thread.java:748)
@luis100 luis100 added the bug label Nov 28, 2017
@luis100 luis100 added this to the 2.2.0 milestone Nov 28, 2017
@luis100
Copy link
Member Author

luis100 commented Nov 28, 2017

Also, allow to start RODA even if the cleanup was not successful.

hsilva-keep added a commit that referenced this issue Nov 29, 2017
@hsilva-keep
core: fixed job clean error during startup (due to iteration over res…
1131f68 
…ult that is changing; fixes #1102)
@hsilva-keep hsilva-keep assigned luis100 and unassigned hsilva-keep Nov 29, 2017
@hsilva-keep
Copy link
Member

@luis100 please test the fix using your specific deployment

luis100 pushed a commit that referenced this issue Nov 30, 2017
@hsilva-keep @luis100
core: fixed job clean error during startup (due to iteration over res…
efad5d9 
…ult that is changing; fixes #1102)
@luis100
Copy link
Member Author

luis100 commented Jan 2, 2018

Tested it and its works, thanks.

@luis100 luis100 closed this as completed Jan 2, 2018
@luis100 luis100 modified the milestones: 2.2.0, 2.2.0-beta2 Jan 5, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@luis100 luis100

Labels
bug
Projects
None yet
Milestone
2.2.0-beta2
Development

No branches or pull requests
2 participants
@luis100 @hsilva-keep