Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync loggly fork with current master #2

Merged
merged 10,000 commits into from May 12, 2016
Merged

Sync loggly fork with current master #2

merged 10,000 commits into from May 12, 2016
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Apr 28, 2016

  1. Merge pull request elastic#18046 from gmoskovicz/master

    Allow import of all projects in Eclipse on Windows
    gmoskovicz committed Apr 28, 2016
  2. removed duplicated code

    martijnvg committed Apr 28, 2016
  3. Build: Explicitly set target and source compatibility for javac

    Gradle has a "shortcut" which omits the target and source compatibility
    we set when it thinks it is not necessary (eg gradle is running on the
    same version as the target compat). However, the way we compile against
    java 9 is to set javac to use java 9, while gradle still runs on java 8.
    This change makes -source and -target explicit for now, until these
    "optimizations" can be removed from gradle.
    
    closes elastic#18039
    rjernst committed Apr 28, 2016
  4. Merge pull request elastic#18047 from rjernst/javac_target

    Build: Explicitly set target and source compatibility for javac
    rjernst committed Apr 28, 2016
  5. Merge pull request elastic#17949 from jaymode/list_setting_exists

    fix exists method for list settings when using numbered setting format
    jaymode committed Apr 28, 2016
  6. Build: Fix plugin properties generation when version changes

    This change fixes the generation of plugin properties files when the
    version changes. Before, it would not regenerate, and running integTest
    would fail with an incompatibile version error.
    rjernst committed Apr 28, 2016
  7. Merge pull request elastic#18050 from rjernst/plugin_props_uptodate

    Build: Fix plugin properties generation when version changes
    rjernst committed Apr 28, 2016
  8. Merge pull request elastic#17902 from talevy/fix/17659-set-override

    add ability to disable ability to override values of existing fields in set processor
    talevy committed Apr 28, 2016

Commits on Apr 29, 2016

  1. Fix line-length violation in SetProcessor

    This commit addresses a checkstyle line-length violation in
    SetProcessor.java.
    jasontedor committed Apr 29, 2016
  2. Drop top level inner hits in favour of inner hits defined in the quer…

    …y dsl.
    
    Fix a limitation that prevent from hierarchical inner hits be defined in query dsl.
    
    Removed the nested_path, parent_child_type and query options from inner hits dsl. These options are only set by ES
    upon parsing the has_child, has_parent and nested queries are using their respective query builders.
    
    These options are still used internally, when these options are set a new private copy is created based on the
    provided InnerHitBuilder and configuring either nested_path or parent_child_type and the inner query of the query builder
    being used.
    
    Closes elastic#11118
    martijnvg committed Apr 29, 2016
  3. Avoid sliced locked contention in internal engine

    Today we use a sliced lock strategy for acquiring locks to prevent
    concurrent updates to the same document. The number of sliced locks is
    computed as a linear function of the number of logical
    processors. Unfortunately, the probability of a collision against a
    sliced lock is prone to the birthday problem and grows faster than
    expected. In fact, the mathematics works out such that for a fixed
    target probability of collision, the number of lock slices should grow
    like the square of the number of logical processors. This is
    less-than-ideal, and we can do better anyway. This commit introduces a
    strategy for avoiding lock contention within the internal
    engine. Ideally, we would only have lock contention if there were
    concurrent updates to the same document. We can get close to this ideal
    world by associating a lock with the ID of each document. This
    association can be held in a concurrent hash map. Now, the JDK
    ConcurrentHashMap also uses a sliced lock internally, but it has several
    strategies for avoiding taking the locks and these locks are only held
    for a very short period of time. This implementation associates a
    reference count with the lock that is associated with a document ID and
    automatically removes the document ID from the concurrent hash map when
    the reference count reaches zero.
    
    Relates elastic#18060
    jasontedor committed Apr 29, 2016
  4. Merge pull request elastic#17994 from eskibars/master

    Add new IPv6 types to docs where it's supported
    eskibars committed Apr 29, 2016
  5. test: changed test's expectation that a BooleanQuery is returned. A N…

    …oMatchDocsQuery is returned instead now.
    martijnvg committed Apr 29, 2016
  6. Return null for "same" thread pool info

    This commit modifes the EsThreadPoolTestCase#info helper method to
    return null when info for the thread pool can not be found. This really
    should only happen for the "same" thread pool, and so we also assert
    that we only get to a place where there is no info if the thread pool
    that info was requested for is in fact the "same" thread pool. Not
    returning null here and instead throwing an exception would fail tests
    that tried to lookup info on the "same" thread pool.
    jasontedor committed Apr 29, 2016
  7. When checking if an index tombstone can be applied, use both the index

    name and uuid because the cluster state may contain an active index of
    the same name (but different uuid).
    
    Closes elastic#18058
    Closes elastic#18054
    Ali Beyad
    Ali Beyad committed Apr 29, 2016
  8. Fixed the documentation formatting. (elastic#17990)

    The source code example for the initial example was missing the correct JSON object formatting and syntax.  That has been fixed with my change.
    josefsalyer authored and clintongormley committed Apr 29, 2016
  9. Tests: Fix TermsQueryBuilderTests expectations when lookup returns no…

    … terms
    
    When the termslookup (mocked in this case) doesn't return any terms, the
    query used to rewrite to an empty boolean query. Now it rewrites to a
    MatchNoDocsQuery. This changes the test expectation accordingly.
    
    Closes elastic#18071
    cbuescher committed Apr 29, 2016
  10. Remove racy but unnecessary assertion

    This commit removes a racy but unnecessary assertion in scaling thread
    pool idle test. Namely, the main test thread can reach the removed
    assertion before the last few threads in the thread pool have completed
    their tasks and caused the completed tasks count on the underlying
    executor to be updated. But this assertion is unnecessary. The main test
    thread already waits on a latch that is only decremented immediately
    before a task completes. This ensures that it was in fact the case that
    every submitted task was executed.
    
    Closes elastic#18072
    jasontedor committed Apr 29, 2016

Commits on May 2, 2016

  1. Merge branch 'master' into tests/switch_to_random_value_other_than_fo…

    …r_sort
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 2, 2016
  2. Change qoutes to quotes (elastic#18078)

    Updated misspelling in documentation
    tdicken73 authored and clintongormley committed May 2, 2016
  3. Update keyword.asciidoc

    `ignore_above` doesn't apply to analyzed `text` fields
    clintongormley committed May 2, 2016
  4. Use plain random values for generating *SortBuilders

    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 2, 2016
  5. Switch to using predicate for testing existing value

    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 2, 2016
  6. Add system bootstrap checks escape hatch

    Today when running in production mode the bootstrap checks are
    completely unforgiving. But there are cases where an end-user might not
    have the ability to modify some of the system-level settings that cause
    the bootstrap checks to trip (e.g., guest settings that are inherited
    from a host and can not be modified). This commit adds a setting that
    allows system-level bootstrap checks to be ignored for these
    end-users. We classify certain bootstrap checks into system-level checks
    and only those bootstrap checks will be ignored if this flag is
    enabled. All other bootstrap checks are still subject to being enforced
    if the user is in production mode. We will still log warnings for these
    bootstrap checks because the end-user does still need to be made aware
    that they are running in a configuration that is less-than-ideal from a
    resiliency perspective.
    
    Relates elastic#18088
    jasontedor committed May 2, 2016
  7. Mark MaxMapCountCheck#isSystemCheck as final

    This commit marks the method MaxMapCountCheck#isSystemCheck as final as
    this method should not be modifiable by inheriting classes (used in
    tests).
    jasontedor committed May 2, 2016
  8. Kill redundant conditional in BootstrapCheck#check

    This commit removes an unnecessary if statement in Bootstrap#check. The
    removed if statement was duplicating the conditionals in the nested if
    statements and was merely an artifact of an earlier refactoring.
    jasontedor committed May 2, 2016
  9. Merge pull request elastic#18094 from mikemccand/completion_stats_once

    Don't try to compute completion stats on a reader after we already closed it
    
    Conflicts:
    	core/src/main/java/org/elasticsearch/index/shard/IndexShard.java
    Michael McCandless authored and mikemccand committed May 2, 2016
  10. Merge pull request elastic#18099 from rmuir/expression_boolean

    Add tests/doc for boolean fields with expressions
    rmuir committed May 2, 2016

Commits on May 3, 2016

  1. Enable HTTP compression by default with compression level 3

    With this commit we compress HTTP responses provided the client
    supports it (as indicated by the HTTP header 'Accept-Encoding').
    
    We're also able to process compressed HTTP requests if needed.
    
    The default compression level is lowered from 6 to 3 as benchmarks
    have indicated that this reduces query latency with a negligible
    increase in network traffic.
    
    Closes elastic#7309
    danielmitterdorfer committed May 3, 2016
  2. Use object equality to compare versions in IndexSettings (elastic#18103)

    Fixes an issue where updating index metadata on a index from a version that it does not have in its static list of known versions fails.
    ywelsch committed May 3, 2016
  3. Add note on configuring assertions in IDEs

    This commit adds a note to the contributing docs on how to configure
    assertions inside Eclipse and IntelliJ.
    
    Relates elastic#18107
    jasontedor committed May 3, 2016
  4. Bumped docs version

    clintongormley committed May 3, 2016
  5. Avoid string concatentation in IngestDocument.FieldPath

    Today, the constructor for IngestDocument#FieldPath does a string
    concatentation and two object allocation on every field path. This
    commit removes these unnecessary operations.
    
    Relates elastic#18108
    jasontedor committed May 3, 2016
  6. Revert "Removing old documentation mentioning NodeBuilder."

    This reverts commit 3ca02d6.
    pickypg committed May 3, 2016
  7. Make reset() in QueryShardContext private

    The query shard reset() method resets some internal state in the
    query shard context, like clearing query names, the filter flag
    or named queries. The problem with this method being public is
    that it currently (miss?) used for modifying an existing context
    for recursive invocatiob, but the contexts that have been reseted
    that way cannot be properly set back to their previous state.
    
    This PR is a step towards removing reset() entirely by first making
    it only be used internally in QueryShardContext. In places where
    reset() was used we can either create new QueryShardContexts or
    modify the existing context because it is discarded afterwards anyway.
    cbuescher committed May 3, 2016

Commits on May 4, 2016

  1. Update client.asciidoc

    as of elastic@42526ac
    5.0.0 alpha2 have no settingsBuilder() method.
    jeesim2 committed May 4, 2016
  2. Merge pull request elastic#18125 from jeesim2/patch-3

    Update java client.asciidoc - Settings.settingsBuilder() removal.
    dadoonet committed May 4, 2016
  3. Merge branch 'master' into tests/switch_to_random_value_other_than_fo…

    …r_sort
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  4. Fold helper class into abstract sort test class.

    Folds the helper class for random object generation into the
    abstract sort test class. Removes a few references to ESTestCase
    that were not needed due to inheriting from it along the way.
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  5. Merge branch 'master' into enhancement/switch_geodistancesortbuilder_…

    …to_geovalidationmethod
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  6. Add deprecation warnings for ignore_malformed to reference docs

    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  7. Remove left over references to ESTestCase

    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  8. Merge pull request elastic#18042 from MaineC/tests/switch_to_random_v…

    …alue_other_than_for_sort
    
    Get (mostly) rid of random test data generator for sort tests
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  9. Merge branch 'master' into enhancement/switch_geodistancesortbuilder_…

    …to_geovalidationmethod
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  10. Clean up merge commit changes

    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  11. Merge pull request elastic#18036 from MaineC/enhancement/switch_geodi…

    …stancesortbuilder_to_geovalidationmethod
    
    Introduces GeoValidationMethod to GeoDistanceSortBuilder
    Isabel Drost-Fromm
    Isabel Drost-Fromm committed May 4, 2016
  12. Remove Strings#splitStringToArray

    This commit removes the method Strings#splitStringToArray and replaces
    the call sites with invocations to String#split. There are only two
    explanations for the existence of this method. The first is that
    String#split is slightly tricky in that it accepts a regular expression
    rather than a character to split on. This means that if s is a string,
    s.split(".")  does not split on the character '.', but rather splits on
    the regular expression '.' which splits on every character (of course,
    this is easily fixed by invoking s.split("\\.") instead). The second
    possible explanation is that (again) String#split accepts a regular
    expression. This means that there could be a performance concern
    compared to just splitting on a single character. However, it turns out
    that String#split has a fast path for the case of splitting on a single
    character and microbenchmarks show that String#split has 1.5x--2x the
    throughput of Strings#splitStringToArray. There is a slight behavior
    difference between Strings#splitStringToArray and String#split: namely,
    the former would return an empty array in cases when the input string
    was null or empty but String#split will just NPE at the call site on
    null and return a one-element array containing the empty string when the
    input string is empty. There was only one place relying on this behavior
    and the call site has been modified accordingly.
    jasontedor committed May 4, 2016
  13. Remove arbitrary separator/wildcard from PathTrie

    PathTrie has a constructor that allows for an arbitrary separtor and
    wildcard, but this constructor is unused and internally we always use
    '/' as the separator and '*' as the wildcard. There are no tests for the
    case where the separator differs from the default separator and
    wildcard. This commit removes this constructor and now all instances of
    PathTrie have the default separator and wildcard.
    jasontedor committed May 4, 2016
  14. Add the ability to use the breadth_first mode with nested aggregation…

    …s (such as `top_hits`) which require access to score information.
    
    The score is recomputed lazily for each document belonging to a top bucket.
    Relates to elastic#9825
    jimczi committed May 4, 2016
  15. Merge pull request elastic#18110 from jasontedor/strings-split-as-array

    Remove Strings#splitStringToArray
    
    Remove arbitrary separator/wildcard from PathTrie
    jasontedor committed May 4, 2016
  16. Merge pull request elastic#18127 from jimferenczi/breadth_first_needs…

    …_score
    
    Add the ability to use the breadth_first mode with nested aggregations (such as `top_hits`) which require access to score information.
    jimczi committed May 4, 2016
  17. Consolidate query generation in QueryShardContext

    Currently we have a lot of methods left in QueryShardContext that
    take parsers or BytesReference arguments to do some xContent
    parsing on the shard. While this still seems necessary in some cases
    (e.g. percolation, phrase suggester), the shard context should only
    be concerned with generating lucene queries from QueryBuilders.
    
    This change removes all of the parseX() methods in favour of two
    public methods toQuery(QueryBuilder) and toFilter(QueryBuilder) that
    either call the query builders toFilter() or toQuery() method and
    move all code required for parsing out to the respective callers.
    cbuescher committed May 4, 2016
  18. [docs] Modernize README.textile

    * camel_case all the things
    * `?pretty` all the things (we tell people to do this in bug reports)
    
    Closes elastic#18136
    nik9000 committed May 4, 2016
  19. Change scriptFields member in InnerHitBuilder to set

    Adding random shuffling of xContent to InnterHitBuilderTests shows
    that the scriptFields are stored in order as a list internally although
    they are an unordered json objects in the query dsl.
    
    This changes the internal representation to a set and updates
    serialization accordingly.
    cbuescher committed May 4, 2016
  20. Reorganise scripting docs (elastic#18132)

    * Reorganize scripting documentation
    
    * Further changes to tidy up scripting docs
    
    Closes elastic#18116
    
    * Add note about .lat/lon potentially returning null
    
    * Added .value to expressions example
    
    * Fixed two bad ASCIIDOC links
    clintongormley committed May 4, 2016
  21. Pass ES_JAVA_OPTS to JVM for plugins script

    This commit adds support for ES_JAVA_OPTS to the elasticsearch-plugin
    script.
    
    Relates elastic#18140
    jasontedor committed May 4, 2016
  22. docs: remove null from expressions case.

    Expressions don't have nulls, only doubles. If the field is missing, then its
    treated as 0.0. You can query .empty to see if its missing and substitute something else.
    
    See elastic#18132 (comment)
    rmuir committed May 4, 2016
  23. Remove client option for JVM for plugins script

    Today we specify the client option for the JVM when executing plugin
    commands. Yet, this option does nothing on a 64-bit capable JDK as such
    JDKs always select the Hotspot server VM. And for 32-bit JDKs, running
    plugin commands with the server VM is okay. Thus, we should just remove
    this unnecessary flag and just let the default VM be selected.
    
    Relates elastic#18142
    jasontedor committed May 4, 2016
  24. Update misc.asciidoc

    Added documentation for the cluster.indices.tombstones.size property for maximum tombstones in the cluster state.
    Ali Beyad
    Ali Beyad committed May 4, 2016
  25. [reindex] Switch throttle to Float.POSITIVE_INFITINTY/"unlimited"

    All other values are errors.
    
    Add java test for throttling. We had a REST test but it only ran against
    one node so it didn't catch serialization errors.
    
    Add Simple round trip test for rethrottle request
    nik9000 committed May 4, 2016

Commits on May 5, 2016

  1. Introduce node handshake

    This commit introduces a handshake when initiating a light
    connection. During this handshake, node information, cluster name, and
    version are received from the target node of the connection. This
    information can be used to immediately validate that the target node is
    a member of the same cluster, and used to set the version on the
    stream. This will allow us to extend APIs that are used during initial
    cluster recovery without a major version change.
    
    Relates elastic#15971
    jasontedor committed May 5, 2016
  2. Tests: improve logging for vagrant to emit entire output on failure

    This change makes the vagrant tasks extend LoggedExec, so that the
    entire vagrant output can be dumped on failure (and completely logged
    when using --info). It should help for debugging issues like elastic#18122.
    rjernst committed May 5, 2016
  3. Merge pull request elastic#18147 from rjernst/vagrant_logging

    Tests: improve logging for vagrant to emit entire output on failure
    rjernst committed May 5, 2016
  4. Merge pull request elastic#18151 from rmuir/easy_win

    painless: optimize/simplify dynamic field and method access
    rmuir committed May 5, 2016
  5. Default to server VM and add client VM check

    Today we softly warn about running with the client VM. However, we
    should really refuse to start in production mode if running with the
    client VM as the performance of the client VM is too devastating for a
    server application. This commit adds an option to jvm.options to ensure
    that we are starting with the server VM (on all 32-bit non-Windows
    platforms on server-class machines (2+ CPUs, 2+ GB physical RAM) this is
    the default and on all 64-bit platforms this is the only option) and
    adds a bootstrap check for the client VM.
    
    Relates elastic#18155
    jasontedor committed May 5, 2016
  6. Added single-quoted strings.

    jdconrad committed May 5, 2016
  7. Generate and run tests from the docs

    Adds infrastructure so `gradle :docs:check` will extract tests from
    snippets in the documentation and execute the tests. This is included
    in `gradle check` so it should happen on CI and during a normal build.
    
    By default each `// AUTOSENSE` snippet creates a unique REST test. These
    tests are executed in a random order and the cluster is wiped between
    each one. If multiple snippets chain together into a test you can annotate
    all snippets after the first with `// TEST[continued]` to have the
    generated tests for both snippets joined.
    
    Snippets marked as `// TESTRESPONSE` are checked against the response
    of the last action.
    
    See docs/README.asciidoc for lots more.
    
    Closes elastic#12583. That issue is about catching bugs in the docs during build.
    This catches *some* bugs in the docs during build which is a good start.
    nik9000 committed May 5, 2016
  8. [docs] Add wait_until_yellow to fix build failure

    The snippet in the docs creates and index and uses it with the
    _analyze api. The trouble is that if the index hasn't been created
    fully the _analyze API will fail. This adds a
    GET _cluster/health?wait_for_status=yellow
    which fixes the issue.
    
    While this does make the docs more cluttered, it also makes the snippets
    actually runnable.
    
    Closes elastic#18165
    nik9000 committed May 5, 2016
  9. Remove the Snapshot class in favor of using SnapshotInfo

    o/e/snapshots/Snapshot and o/e/snapshots/SnapshotInfo contain the same
    fields and represent the same information.  Snapshot was used to
    maintain snapshot information to the snapshot repository, while
    SnapshotInfo was used to represent the snapshot information as presented
    through the REST layer.  This removes the Snapshot class and combines
    all uses into the SnapshotInfo class.
    
    Closes elastic#18167
    Ali Beyad
    Ali Beyad committed May 5, 2016
  10. Painless: add fielddata accessors (.value/.values/.distance()/etc)

    This gives better coverage and consistency with the scripting APIs, by
    whitelisting the primary search scripting API classes and using them instead
    of only Map and List methods.
    
    For example, accessing fields can now be done with `.value` instead of `.0`
    because `getValue()` is whitelisted. For now, access to a document's fields in
    this way (loads) are fast-pathed in the code, to avoid dynamic overhead.
    
    Access to geo fields and geo distance functions is now supported.
    
    TODO: date support (e.g. whitelist ReadableDateTime methods as a start)
    TODO: improve docs (like expressions and groovy have for document's fields)
    TODO: remove fast-path hack
    
    Closes elastic#18169
    
    Squashed commit of the following:
    
    commit ec9f24b
    Author: Robert Muir <rmuir@apache.org>
    Date:   Thu May 5 17:59:37 2016 -0400
    
        cutover to <Def> instead of <Object> here
    
    commit 9edb155
    Author: Robert Muir <rmuir@apache.org>
    Date:   Thu May 5 17:03:02 2016 -0400
    
        add fast-path for docvalues field loads
    
    commit f8e38c0
    Author: Robert Muir <rmuir@apache.org>
    Date:   Thu May 5 16:47:31 2016 -0400
    
        Painless: add fielddata accessors (.value/.values/.distance()/etc)
    rmuir committed May 5, 2016
  11. Another wait_for_yellow to the docs

    All in service of the snippets passing consistently.
    nik9000 committed May 5, 2016
  12. Tests: Delay starting progress loggers for vagrant until test is running

    This was broken recently as part of making the vagrant tasks extend
    LoggedExec. This change fixes the progress logger to not be started
    until we start seeing output from vagrant.
    rjernst committed May 5, 2016
  13. Merge pull request elastic#18170 from rjernst/rpm_dirs

    Packaging: Make rpm not include parent dirs
    rjernst committed May 5, 2016
  14. Fix error message on ES_MAX_MEM set

    This commit fixes a typo in the error message when the now unsupported
    environment variable ES_MAX_MEM is set on Windows.
    jasontedor committed May 5, 2016
  15. Fix typo in message for variable setup ES_MAX_MEM

    Small typo fix in startup script.
    
    Relates elastic#18168
    radoondas authored and jasontedor committed May 5, 2016

Commits on May 6, 2016

  1. Mark IHBT#testFromAndToXContent as awaits fix

    This commit marks InnerHitsBuilderTests#testFromAndToXContent as
    awaiting a fix.
    jasontedor committed May 6, 2016
  2. Build: Add pom generation to assemble task

    In preparation for a unified release process, we need to be able to
    generate the pom files independently of trying to actually publish. This
    change adds back the maven-publish plugin just for that purpose. The
    nexus plugin still exists for now, so that we do not break snapshots,
    but that can be removed at a later time once snapshots are happenign
    through the unified tools. Note I also changed the dir jars are written
    into so that all our artifacts are under build/distributions.
    rjernst committed May 6, 2016
  3. QueryBuilder does not need generics. elastic#18133

    QueryBuilder has generics, but those are never used: all call sites use
    `QueryBuilder<?>`. Only `AbstractQueryBuilder` needs generics so that the base
    class can contain a default implementation for setters that returns `this`.
    jpountz committed May 6, 2016
  4. Fixed bad asciidoc

    clintongormley committed May 6, 2016
  5. Allow binary sort values. elastic#17959

    The `ip` field uses a binary representation internally. This breaks when
    rendering sort values in search responses since elasticsearch tries to write a
    binary byte[] as an utf8 json string. This commit extends the `DocValueFormat`
    API in order to give fields a chance to choose how to render values.
    
    Closes elastic#6077
    jpountz committed May 6, 2016
  6. Fix and test handling of `null_value`. elastic#18090

    This was mostly untested and had some bugs.
    
    Closes elastic#18085
    jpountz committed May 6, 2016
  7. Add xContent shuffling to some more tests

    This adds some random shuffling of xContent to some more test cases.
    
    Relates to elastic#5831
    cbuescher committed May 6, 2016
  8. Add back Version.V_5_0_0. elastic#18176

    This was lost whene releasing alpha2 since the version constant got renamed.
    jpountz committed May 6, 2016
  9. Remove StringBuilder reuse for uid creation. elastic#18181

    This would be better handled by escape analysis.
    jpountz committed May 6, 2016
  10. Exclude all but string fields from highlighting if wildcards are used…

    … in fieldname
    
    We should prevent highlighting if a field is anything but a text or keyword field.
    However, someone might implement a custom field type that has text and still want to
    highlight on that. We cannot know in advance if the highlighter will be able to
    highlight such a field and so we do the following:
    If the field is only highlighted because the field matches a wildcard we assume
    it was a mistake and do not process it.
    If the field was explicitly given we assume that whoever issued the query knew
    what they were doing and try to highlight anyway.
    
    closes elastic#17537
    brwe committed May 6, 2016
  11. Pipeline Stats: Fix concurrent modification exception (elastic#18177)

    Due to trying to modify a map while iterating it, a concurrent modification
    in the pipeline stats could be thrown. This uses an iterator to prevent this.
    
    Closes elastic#18126
    spinscale committed May 6, 2016
  12. Random script fields can't overlap

    This causes round tripping through xcontent to fail.
    
    Closes elastic#18166
    nik9000 committed May 6, 2016
  13. Remove unused chechstyle_supressions line length checks

    The files removed are below the 140 character line length limit.
    cbuescher committed May 6, 2016
  14. Remove handshake from transport client

    This commit removes handshaking from the transport client. This
    handshaking is not needed because of the existence of the liveness
    check.
    
    Relates elastic#18174
    jasontedor committed May 6, 2016
  15. Allow leading `/` in AUTOSENSE path

    Relates to elastic#18160
    nik9000 committed May 6, 2016
  16. Add semicolon query string parameter delimiter

    This commit adds support for the semicolon character as a valid query
    string parameter delimiter.
    
    Relates elastic#18186
    jasontedor committed May 6, 2016
  17. add string to documentation

    brwe committed May 6, 2016
  18. Merge pull request elastic#18183 from brwe/exclude-all-but-text-from-…

    …wildcard-highlighting
    
    Exclude all but string fields from highlighting if wildcards are used…
    brwe committed May 6, 2016
  19. Add node name to Cat Recovery

    tlrx committed May 6, 2016
  20. Preserve config files from RPM install

    This commit modifies the packaging for the RPM package so that edits to
    config files will not get lost during removal and upgrade.
    
    Relates elastic#18188
    jasontedor committed May 6, 2016
  21. Add Failure Details to every NodesResponse

    Most of the current implementations of BaseNodesResponse (plural Nodes) ignore FailedNodeExceptions.
    
    - This adds a helper function to do the grouping to TransportNodesAction
    - Requires a non-null array of FailedNodeExceptions within the BaseNodesResponse constructor
    - Reads/writes the array to output
    - Also adds StreamInput and StreamOutput methods for generically reading and writing arrays
    pickypg committed May 6, 2016
  22. Merge pull request elastic#18173 from rjernst/pom_gen

    Build: Add pom generation to assemble task
    rjernst committed May 6, 2016
  23. Fix exception message in lifecycle

    This commit fixes the exception messages for lifecycles when stopping in
    illegal states.
    
    Relates elastic#18189
    jasontedor committed May 6, 2016

Commits on May 7, 2016

  1. Mappings: Fix ip mapper to correctly serialize a null null_value

    We recently added correct serialization for null values, but the helper
    method used does not allow null. This fixes serialization to handle the
    null.
    rjernst committed May 7, 2016
  2. Merge pull request elastic#18194 from rjernst/null_ip_default

    Mappings: Fix ip mapper to correctly serialize a null null_value
    rjernst committed May 7, 2016
  3. Build: Add fake project to include buildSrc as normal project

    This is a follow up to elastic#18173 and includes adding pom generation to the
    fake build-tools project, which is really just buildSrc, but builds
    during normal builds.
    rjernst committed May 7, 2016
  4. Add link to field data docs from field data fields

    This commit adds a link to the field data docs from the field data
    fields docs for completeness.
    
    Closes elastic#17672
    jasontedor committed May 7, 2016
  5. Correct docs for dynamic mapping of fields

    Floating point numbers are added as `float`, and Strings are added as `text` with `keyword sub-field
    clintongormley committed May 7, 2016

Commits on May 9, 2016

  1. Determine content length eagerly in HttpServer

    With this commit we eagerly evaluate content length in HttpServer
    and also pass the same value to ResourceHandlingHttpChannel. With
    this change it easier to reason about the content length that is
    freed leaving no doubt that it must be identical to the reserved
    amount.
    danielmitterdorfer committed May 9, 2016
  2. Free bytes reserved on request breaker

    With this commit we free all bytes reserved on the request
    circuit breaker.
    
    Closes elastic#18144
    danielmitterdorfer committed May 9, 2016
  3. CONSOLE is the new AUTOSENSE

    This makes the test generation support both while we move from
    `// AUTOSENSE` to `// CONSOLE`.
    
    Will bother elastic#18160
    nik9000 committed May 9, 2016
  4. Rest tests: More defense around stashing body

    Integration tests failed:
    https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+multijob-intake/483/console
    
    We'll see if the rest tests were hiding some other failure.
    nik9000 committed May 9, 2016
  5. Account for rpm behavior difference on directories

    This commit modifies the packaging tests to account for the fact that
    rpm behaves differently with respect to preserving directories marked as
    "CONFIG | NOREPLACE" on older versions versus newer versions. Older
    versions will leave the directory as-is while newer versions will append
    the suffix ".rpmsave" to the directory name.
    
    Relates elastic#18216
    jasontedor committed May 9, 2016
  6. Improve logging of raw rest actions on failure

    Log the method and the path.
    nik9000 committed May 9, 2016
  7. Remove plugin script parsing of system properties

    The plugin script parses command-line options looking for Java system
    properties and extracts these arguments to pass to the java command when
    starting the JVM. Since elasticsearch-plugin allows arbitrary user
    arguments to the JVM via ES_JAVA_OPTS, this parsing is unnecessary. This
    commit removes this unnecessary 
    
    Relates elastic#18207
    jasontedor committed May 9, 2016
  8. Merge pull request elastic#18172 from rjernst/vagrant_logging2

    Tests: Delay starting progress loggers for vagrant until test is running
    rjernst committed May 9, 2016
  9. Do not return fieldstats information for fields that exist in the map…

    …ping
    
    but not in the index.
    jimczi committed May 9, 2016
  10. Merge pull request elastic#18196 from rjernst/build_tools_pom

    Build: Add fake project to include buildSrc as normal project
    rjernst committed May 9, 2016
  11. Merge pull request elastic#18212 from jimferenczi/field_stats_null

    Do not return fieldstats information for fields that exist in the mapping but not in the index.
    jimczi committed May 9, 2016
  12. Build a plugin for testing docs

    This makes it much easier to apply to other projects.
    
    Fixes to doc tests infrastructure:
    * Fix comparing lists. Was totally broken.
    * Fix order of actual vs expected parameters.
    * Allow multiple `// TESTRESPONSE` lines with substitutions to join
    into one big list of subtitutions. This makes lets the docs look
    tidier.
    * Exclude build from snippet scanning
    * Allow subclasses of ESRestTestCase access to the admin execution context
    nik9000 committed May 9, 2016
  13. Docs tests: rename autoSense to console

    Since `// AUTOSENSE` has been replaced by `// CONSOLE` we should use
    the new name for the variable name.
    nik9000 committed May 9, 2016
  14. Fail build when docs contain // AUTOSENSE

    It is deprecated and should be replaced with // CONSOLE.
    nik9000 committed May 9, 2016
  15. Increaes timeout on Netty handshake tests

    This commit increases the timeout on the Netty handshake tests because
    the previous value could cause timeout exceptions on slow machines.
    jasontedor committed May 9, 2016

Commits on May 10, 2016

  1. Switch over dynamic method calls, loads and stores to invokedynamic.

    Remove performance hack for accessing a document's fields, its not needed.
    Add support for accessing is-getter methods like List.isEmpty() as .empty
    
    Closes elastic#18201
    rmuir committed May 10, 2016
  2. Mapping cleanups. elastic#18180

    This removes dead/duplicate code and makes the `_index` field not configurable.
    (Configuration used to jus be ignored, now we would throw an exception if any
    is provided.)
    jpountz committed May 10, 2016
  3. Remove old backward compatibility layer for version lookups. elastic#…

    …18215
    
    The current code tries to handle the case that document versions are either
    missing or stored in payloads rather than doc values. Since none of the 2.x
    releases allowed this, we can remove this logic.
    jpountz committed May 10, 2016
  4. Remove FieldMapper.Builder.indexName. elastic#18219

    The ability to configure index names that are different from the full name was
    removed in 2.0.
    jpountz committed May 10, 2016
  5. Remove code duplication in FieldsVisitor. elastic#18218

    It currently has twice the same method, once with a MapperService instance and
    once with a DocumentMapper. This commits only keeps the former.
    jpountz committed May 10, 2016
  6. Fix minor typo (elastic#18222)

    jasonquick authored and clintongormley committed May 10, 2016
  7. Removes the now obsolete SearchParseElement implementations

    All implementations of SearchParseElement have been removed since they are no longer used now that parsing is done on the coordinating node. The SearchParseElement and FetchSubPhaseParseElement classes are not removed as currently they are needed for plugins that add a custom fetch sub phase. These will be removed in a follow up PR that will allow fetch sub phase plugins to register a parser in a different way.
    colings86 committed May 10, 2016
  8. Update full-text-queries.asciidoc

    Updated the full text query intro to add `match_phrase` and `match_phrase_prefix`
    clintongormley committed May 10, 2016
  9. Merge pull request elastic#18232 from uschindler/array_invoke_dynamic

    painless: Array load/store and length with invokedynamic
    rmuir committed May 10, 2016
  10. painless: Add synthetic length property as alias to Lists, so they ca…

    …n really be used like arrays
    uschindler committed May 10, 2016
  11. Further simplifications of plugin script

    In 7d1fd17 the parsing of command-line
    properties in the plugin script was removed. That commit missed
    additional parsing of the properties for es.default.path.conf. This
    commit removes that parsing and also replaces the use of eval with exec.
    
    Relates elastic#18239
    jasontedor committed May 10, 2016
  12. Improving parsing of sigma param for Extended Stats Bucket Aggregatio

    Improving parsing of sigma param for Extended Stats Bucket Aggregation
    colings86 committed May 10, 2016
  13. Merge branch 'pr/18068'

    dakrone committed May 10, 2016
  14. Add plugin information for Verbose mode

    gmoskovicz authored and jasontedor committed May 10, 2016
  15. hack

    rmuir committed May 10, 2016
  16. add test and cleanup

    rmuir committed May 10, 2016
  17. Log exception when join validation fails

    Today when join validation fails, we log a warning but do not log the
    exception that led to the join validation failing. This commit modifies
    this so that we do log this exception.
    jasontedor committed May 10, 2016
  18. Merge pull request elastic#18241 from uschindler/painless_list_length

    painless: Add synthetic length property as alias to Lists, so they can be used like arrays
    jdconrad committed May 10, 2016
  19. Make ShardRouting and UnassignedInfo immutable (elastic#17821)

    This makes defensive copying of ShardRouting objects obsolete whenever we do a reroute and trashes less objects.
    ywelsch committed May 10, 2016
  20. [TEST] Ensure creation of valid routing table

    An additional sanity check introduced by elastic#17821 makes some tests fail. This check verifies that
    only one shard with same shard id is allocated to a node. This commit fixes a bug in
    ClusterStateCreationUtils which would construct a cluster state that allocated two shards with same
    id to the same node.
    ywelsch committed May 10, 2016
  21. Switch scripts to use bash

    This commit switches the command-line scripts to use bash instead of sh
    so that we can take advantage of features that bash provides like
    arrays.
    
    Relates elastic#18251
    jasontedor committed May 10, 2016
  22. Fix handling of default path conf in plugin script

    In the plugin script we set the setting default.path.conf to control the
    path to the configuration file. But the default directory might not
    exist in which case we can run into exceptions. This commit restores a
    guard against this directory not existing.
    jasontedor committed May 10, 2016
  23. Add TAG_SETTING to list of allowed tags for the ec2 discovery plugin.

    I am unable to set ec2 discovery tags because this setting was
    accidentally omitted from the register settings list in
    Ec2DiscoveryPlugin.java. I get this:
    
    java.lang.IllegalArgumentException: unknown setting [discovery.ec2.tag.project]
    j16r committed May 10, 2016
  24. Merge pull request elastic#18234 from rmuir/more_indy_type_data

    painless: use better typing for dynamic method calls
    rmuir committed May 10, 2016
  25. Merge pull request elastic#18247 from rmuir/needsScore

    painless: implement needsScore() correctly.
    rmuir committed May 10, 2016

Commits on May 11, 2016

  1. Require /bin/bash in packaging

    This commit adds a hard requirement to the RPM and Debian packages for
    /bin/bash to be present, and adds a note regarding this to the migration
    docs.
    
    Relates elastic#18259
    jasontedor committed May 11, 2016
  2. Sort plugins in list plugins command

    This commit modifies the list plugins command to produce deterministic
    output by sorting the plugins by comparing paths.
    
    Relates elastic#18260
    jasontedor committed May 11, 2016
  3. Merge pull request elastic#18258 from rmuir/painless_faster_score

    painless: retrieve _score directly from Scorer
    rmuir committed May 11, 2016
  4. special access to doc

    rmuir committed May 11, 2016
  5. Merge pull request elastic#18262 from rmuir/painless_doc_access

    Painless doc access
    rmuir committed May 11, 2016
  6. Merge pull request elastic#18263 from jdconrad/mapfix

    Fix bracket shortcuts
    jdconrad committed May 11, 2016
  7. Merge pull request elastic#18257 from j16r/master

    Add TAG_SETTING to list of allowed tags for the ec2 discovery plugin.
    dadoonet committed May 11, 2016
  8. Add 'ctx' keyword to painless.

    rmuir committed May 11, 2016
  9. Merge pull request elastic#18264 from rmuir/painless_ctx

    Add 'ctx' keyword to painless.
    rmuir committed May 11, 2016
  10. Clean up tests in Reindex module

    tlrx committed May 11, 2016
  11. First pass at improving analyzer docs (elastic#18269)

    * Docs: First pass at improving analyzer docs
    
    I've rewritten the intro to analyzers plus the docs
    for all analyzers to provide working examples.
    
    I've also removed:
    
    * analyzer aliases (see elastic#18244)
    * analyzer versions (see elastic#18267)
    * snowball analyzer (see elastic#8690)
    
    Next steps will be tokenizers, token filters, char filters
    
    * Fixed two typos
    clintongormley committed May 11, 2016
  12. Log setting key not setting object in IMC

    This commit modifies two logging statements in the
    IndexingMemoryController to log the key for the setting
    indices.memory.index_buffer_size instead of the object.
    
    Relates elastic#18191
    jasontedor committed May 11, 2016
  13. Equal default min and max heap settings

    Today we encourage users to set their minimum and maximum heap settings
    equal to each other to prevent the heap from resizing. Yet, the default
    heap settings do not start Elasticsearch in this fashion. This commit
    addresses this discrepancy by setting the default min heap to '512m' and
    the default max heap to the default min heap.
    
    Relates elastic#16334
    jasontedor committed May 11, 2016
  14. Make significant terms work on fields that are indexed with points. e…

    …lastic#18031
    
    It will keep using the caching terms enum for keyword/text fields and falls back
    to IndexSearcher.count for fields that do not use the inverted index for
    searching (such as numbers and ip addresses). Note that this probably means that
    significant terms aggregations on these fields will be less efficient than they
    used to be. It should be ok under a sampler aggregation though.
    
    This moves tests back to the state they were in before numbers started using
    points, and also adds a new test that significant terms aggs fail if a field is
    not indexed.
    
    In the long term, we might want to follow the approach that Robert initially
    proposed that consists in collecting all documents from the background filter in
    order to compute frequencies using doc values. This would also mean that
    significant terms aggregations do not require fields to be indexed anymore.
    jpountz committed May 11, 2016
  15. Merge pull request elastic#18277 from rmuir/painless_score_as_double

    painless: _score as double, not float
    rmuir committed May 11, 2016
  16. Give long priority over float in Def math calcs. Promotion of types

    still works correclty.
    jdconrad committed May 11, 2016
  17. Remove dead code.

    jpountz committed May 11, 2016
  18. Dangling indices are not imported if a tombstone for the same index

    (same name and UUID) exists in the cluster state.  This resolves a
    situation where if an index data folder was copied into a node's data
    directory while the node is running and that index had a tombstone in
    the cluster state, the index would still get imported.
    
    Closes elastic#18250
    Closes elastic#18249
    Ali Beyad
    Ali Beyad committed May 11, 2016
  19. When CORS is enabled, permit requests from the same origin as the

    request host, as the request is not a cross origin.
    
    Relates elastic#18256
    Ali Beyad
    Ali Beyad committed May 11, 2016
  20. CORS handling triggered whether User-Agent is a browser or not

    This commit ensures that if CORS is enabled, then Origin headers are
    checked regardless of whether the request came from a browser or not.
    In the past, we only proceeded with CORS checks if the User-Agent was a
    browser.
    Ali Beyad
    Ali Beyad committed May 11, 2016
  21. this makes aggregations per-document _value fast (bypass hash put, ha…

    …sh get, etc) for painless.
    
    but i have no clue how to test it, it seems this feature never worked via REST?
    
    Should we drop the feature instead?
    rmuir committed May 11, 2016

Commits on May 12, 2016

  1. Fix Debian package bash requires clause

    This commit fixes the Debian package requires clause for bash. For the
    RPM it is okay to specify the binary, but for the Debian package the
    package name must be specified.
    jasontedor committed May 12, 2016
  2. Merge pull request elastic#18284 from rmuir/painless_value_aggregations

    _value support in painess?
    rmuir committed May 12, 2016
  3. Merge pull request elastic#18287 from rmuir/input_goes_params

    painless: remove input, support params instead
    rmuir committed May 12, 2016
  4. add debugger

    rmuir committed May 12, 2016
  5. Merge pull request elastic#18282 from jdconrad/longs

    Long priority over Float
    jdconrad committed May 12, 2016
  6. Merge pull request elastic#18288 from rmuir/painless_debug

    painless: add debugging tool to tests
    rmuir committed May 12, 2016
  7. Add tests that packages depend on bash

    This commit adds bats tests that the RPM and Debian packages depend on
    bash.
    
    Relates elastic#18292
    jasontedor committed May 12, 2016
  8. Move AsciiFolding earlier in FingerprintAnalyzer filter chain

    Rearranges the FingerprintAnalyzer so that AsciiFolding comes earlier in the chain (after lowercasing, before stop removal, for maximum deduping power)
    
    Closes elastic#18266
    polyfractal committed May 12, 2016
  9. Add wait_for_health=yellow to reindex snippets

    This should help the tests pass more consistently. Should.
    
    This also removes from `?pretty` from the docs. It isn't a thing
    with `// CONSOLE`.
    
    Relates to
    https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+multijob-os-compatibility/os=oraclelinux/399/console
    nik9000 committed May 12, 2016
  10. Remove period in min master node check log message

    As most of our log messages are not sentences and do not end with
    periods, this commit removes a period from the end of the min master
    node bootstrap check log message.
    jasontedor committed May 12, 2016
  11. Merge pull request elastic#18298 from jdconrad/line

    Make Line Number Available in Painless
    jdconrad committed May 12, 2016
  12. Removing the superfluous 's'

    Pretty sure we're not making a brand new `/var/logs` directory when everything else goes into `/var/log`
    
    Relates elastic#18305
    untergeek authored and jasontedor committed May 12, 2016
  13. Switch init.d scripts to use bash

    This commit modifies the init.d scripts to use bash now that bash is a
    required dependency.
    
    Relates elastic#18308
    jasontedor committed May 12, 2016
You can’t perform that action at this time.