Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reimplement the feature of resubmitting failed index tasks #1603

Closed
taojing2002 opened this issue Jan 30, 2023 · 4 comments
Closed

Reimplement the feature of resubmitting failed index tasks #1603

taojing2002 opened this issue Jan 30, 2023 · 4 comments
Assignees
Milestone

Comments

@taojing2002
Copy link
Contributor

Currently the class of IndexGeneratorTimerTask.java in metacat-index can resubmit the failed index tasks periodically. However, the implementation directly uses the hazelcast code, which is obsoleted in this release. We need to reimplement the class in the metacat component.

@taojing2002 taojing2002 added this to the 2.19.0 milestone Jan 30, 2023
@taojing2002 taojing2002 self-assigned this Jan 30, 2023
@taojing2002 taojing2002 modified the milestones: 2.19.0, 3.0.0 Apr 5, 2023
@taojing2002
Copy link
Contributor Author

We found there is a database table (index_event) and java class IndexEventDAO behind hazelcast. So now we directly use the code in Metacat.

@mbjones
Copy link
Member

mbjones commented Nov 1, 2023

@jeanetteclark could you please review this with @taojing2002 to ensure the rabbitmq tasks are fully handled in Metacat, based on your experience implementing it for MetaDIG?

@taojing2002
Copy link
Contributor Author

Now, the feature, which resubmits the index tasks which fails to be put into RabbitMQ (e.g., the RabbitMQ is down), has been done.

However, we still need to think about how to resubmit the index tasks, which fail in Dataone-Index.

@artntek artntek closed this as completed Feb 7, 2024
@artntek
Copy link
Contributor

artntek commented Feb 7, 2024

see DataONEorg/dataone-indexer#23

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants