Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AggregationSpout for field collapsing on ES. Implements #233 #237

Merged
merged 5 commits into from Jan 28, 2016

Conversation

jnioche
Copy link
Contributor

@jnioche jnioche commented Jan 27, 2016

See #233

Currently implemented as a separate implementation from the existing one.

jnioche and others added 4 commits January 27, 2016 15:16
The `bucketSortField` variable was initialised with the default of `nextFetchDate` but then later overwritten.
Unlikely to be a problem since the default is also in the conf file.
* bucketSortField initialised with empty string  - see #238
* Min time to allow between 2 successive queries to ES
* display shard Id in logs
* log number of documents already processed
* shuffle content of buffer
Use default of "nextFetchDate" for bucket sorting
jnioche added a commit that referenced this pull request Jan 28, 2016
AggregationSpout for field collapsing on ES. Implements #233
@jnioche jnioche merged commit 4a9a0b3 into master Jan 28, 2016
@jnioche jnioche deleted the aggregationSpout branch January 28, 2016 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants