Skip to content
This repository has been archived by the owner on Aug 2, 2022. It is now read-only.

Refactor JobSweeper to do sweep on certain clusterChangedEvent #10

Merged

Conversation

zengyan-amazon
Copy link
Member

Issue #, if available:

Description of changes: This is a optimization to JobSweeper, when the routing table changes, the sweeper will only do sweeping against changed indices, instead of doing sweep on all job indices for all ClusterChangedEvents

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Copy link
Contributor

@dbbaughe dbbaughe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zengyan-amazon zengyan-amazon merged commit da70f6d into opendistro-for-elasticsearch:master Jun 11, 2019
dbbaughe pushed a commit to dbbaughe/job-scheduler that referenced this pull request Feb 6, 2020
dbbaughe added a commit that referenced this pull request Feb 20, 2020
* Updated README.md w spelling correction

* Uses primary_term/seq_no for job doc versioning

*  support scheduledJob with locks. (#8)

* support scheduledJob with locks.

* Use ClusterService instead of Client to check the index exists.

address some minor comment.

* Updated through the comment.

1. Move the LockService in the SPI package
1. Added deleteLock to test.
1. Updated naming from job_type to job_index_name
1. updated delete lock to be safe with non existing index name.

* Use ClusterStateService for lockIndexExist

* Update acquireLock to take JobParam and JobContext

* add some documentation to LockService

* Fixes access denied issue and testing randomly failing because if es test framework

* Debian package build

* Refactor JobSweeper to do sweep on certain clusterChangedEvent (#10)

* Filter clusterChangedEvent when doing sweeping
* Format code

* Change log level when sweeper already have latest job version (#11)

* Update release lock log level
* Update sweeper version compare log level

* Override equals and hashCode for LockModel (#12)

* Adds equals, hashCode, toString overrides to IntervalSchedule and CronSchedule (#13)

* Use ROOT Locale for Strings to prevent inconsistencies in format (#14)

* update ScheduledJobParser to use the JobDocVersion (#15)

* update ScheduledJobParser to use the JobDocVersion

* Fixes byte charset default

* Add maven publish task for spi (#23)

* Add spi subproject maven publish task

* Converts lock service to async

* Updates lockservice to work in 6.8

* Updates plugin version and updates release notes

Co-authored-by: Alolita Sharma <1942529+alolita@users.noreply.github.com>
Co-authored-by: Jinsoo <46536764+jinsoor-amzn@users.noreply.github.com>
Co-authored-by: Yan Zeng <46499415+zengyan-amazon@users.noreply.github.com>
Co-authored-by: Mohammad Qureshi <47198598+qreshi@users.noreply.github.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants