Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HSEARCH-3084 Initialize and close index managers / backends in parallel #2109

Merged
merged 15 commits into from
Oct 3, 2019

Commits on Oct 2, 2019

  1. HSEARCH-3084 Retrieve Elasticsearch metadata (mapping + settings) usi…

    …ng a single REST API call
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    621bc45 View commit details
    Browse the repository at this point in the history
  2. HSEARCH-3084 Make failure collectors thread-safe

    Necessary because of ES schema validation in particular.
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    3ccb9cd View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e42058b View commit details
    Browse the repository at this point in the history
  4. HSEARCH-3084 Delay shard starting until after all shards are created …

    …in Lucene index managers
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    9d90de9 View commit details
    Browse the repository at this point in the history
  5. HSEARCH-3084 Delay directory creation/initialization until shards are…

    … started in Lucene index managers
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    be6446f View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    51cbe1f View commit details
    Browse the repository at this point in the history
  7. HSEARCH-3084 Handle index names more consistently in Lucene index man…

    …agers
    
    Make sure to always include the shard ID, in particular.
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    bb8ca2f View commit details
    Browse the repository at this point in the history
  8. HSEARCH-3084 Simplify Lucene write orchestrator creation

    There's no reason to go through an interface exposed in a separate
    package: the consumer and the implementation of the
    createWriteOrchestrator() method are located in the same package.
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    350270f View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    bf74917 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    841c435 View commit details
    Browse the repository at this point in the history
  11. HSEARCH-3084 Simplify BatchingExecutor

    1. Get rid of the Phaser and use much simpler code.
    2. Expose a CompletableFuture<?> to wait for full completion (will be
    useful in the next commits).
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    d9889a2 View commit details
    Browse the repository at this point in the history
  12. HSEARCH-3084 Pre-stop backends and index managers in parallel

    Mainly, this means that on shutdown, we'll stop accepting works
    for all backends/index managers immediately, and *then* we'll wait for
    ongoing works to complete.
    
    The improvement over the previous behavior will probably be negligible,
    but what's more important is that the path towards an API for explicitly
    starting/pre-stopping/stopping index managers is now clearer.
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    4bec870 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    266198e View commit details
    Browse the repository at this point in the history
  14. HSEARCH-3084 Add basic unit tests for BatchingExecutor

    It's not a lot, but it's better than nothing.
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    ea3a46e View commit details
    Browse the repository at this point in the history
  15. HSEARCH-3084 Always execute all worksets in BatchingExecutor, even if…

    … a previous workset failed
    
    The problem is unrelated to this PR, but was detected thanks to the tests
    I added to make sure the new implementation works correctly.
    yrodiere committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    927af64 View commit details
    Browse the repository at this point in the history