Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update async. groups of IOs in ES, refs #11855 #684

Merged
merged 1 commit into from
Mar 26, 2018

Conversation

jraddaoui
Copy link
Contributor

@jraddaoui jraddaoui commented Mar 21, 2018

Creates a job to update information object documents in the Elasticsearch
index. This job is launched in places where multiples IOs may be updated,
like updating the descendants of an IO and the related IOs of terms, actors
and repositories. The new job, called arUpdateEsIoDocumentsJob will not
be triggered in CLI tasks or other jobs, where the update will be done sync.

Main changes:

  • Creates arUpdateEsIoDocumentsJob, capable of updating a group of IOs
    and their descendants, skipping ones or the others if requested.
  • Update descendants when a higher level IO changes.
  • Update related descriptions when an actor changes, including their
    descendants if the relating event is a creation event.
  • Update related descriptions and descendants on repository changes.
  • Update related descriptions on term label changes of subjects, places and
    genres.

For now, descendants are being updated entirely, but we should use partial
updates in the future to only update the inherited data.

@jraddaoui jraddaoui self-assigned this Mar 21, 2018
@jraddaoui jraddaoui added this to the 2.5.0 milestone Mar 21, 2018
@qubot qubot force-pushed the dev/issue-11855-async-es-update branch from 7772abe to efdcde0 Compare March 22, 2018 16:51
@jraddaoui jraddaoui changed the title Update descendants in ES IO update, refs #11855 Update async. groups of IOs in ES, refs #11855 Mar 22, 2018
@sbreker sbreker self-requested a review March 26, 2018 16:14
@sbreker
Copy link
Member

sbreker commented Mar 26, 2018

Looks great @jraddaoui! This will be a great feature to have!

Creates a job to update information object documents in the Elasticsearch
index. This job is launched in places where multiples IOs may be updated,
like updating the descendants of an IO and the related IOs of terms, actors
and repositories. The new job, called `arUpdateEsIoDocumentsJob` will not
be triggered in CLI tasks or other jobs, where the update will be done sync.

Main changes:
- Creates `arUpdateEsIoDocumentsJob`, capable of updating a group of IOs
  and their descendants, skipping ones or the others if requested.
- Update descendants when a higher level IO changes.
- Update related descriptions when an actor changes, including their
  descendants if the relating event is a creation event.
- Update related descriptions and descendants on repository changes.
- Update related descriptions on term label changes of subjects, places and
  genres.

For now, descendants are being updated entirely, but we should use partial
updates in the future to only update the inherited data.
@qubot qubot force-pushed the dev/issue-11855-async-es-update branch from 6ae8dc6 to 794abc1 Compare March 26, 2018 17:42
@qubot qubot merged commit 794abc1 into qa/2.5.x Mar 26, 2018
@jraddaoui
Copy link
Contributor Author

Thanks @sbreker!!

@qubot qubot deleted the dev/issue-11855-async-es-update branch March 27, 2018 05:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants