Skip to content

Improvements to distributed indexing service and auto scaling#20

Merged
cheddar merged 17 commits intomasterfrom
autoscaling
Nov 8, 2012
Merged

Improvements to distributed indexing service and auto scaling#20
cheddar merged 17 commits intomasterfrom
autoscaling

Conversation

@fjy
Copy link
Contributor

@fjy fjy commented Oct 31, 2012

  1. Improve remote task runner to be completely event driven
  2. S3 auto scaling for worker nodes
  3. Some general stability/robustness improvements
  4. redirect filters now return 302s

*Note: These changes also include the bug fix for merging with empty strings, which is open in another pull request

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another option for these is to load a "Duration" and then convert that into millis.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yup, pretty sure this has nothing to do with S3. Should perhaps be EC2 instead?

Fangjin Yang added 7 commits November 2, 2012 15:56
Conflicts:
	client/src/main/java/com/metamx/druid/http/BrokerMain.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
	merger/src/main/java/com/metamx/druid/merger/worker/http/WorkerNode.java
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What protection do we have from some sort of state problem that stops us from ever clearing out the currentlyTerminating list? Would probably be good to start emitting alerts after some amount of time has passed and it still isn't clear.

@fjy
Copy link
Contributor Author

fjy commented Nov 8, 2012

Pushed latest set of changes according to some of the code review comments.

cheddar added a commit that referenced this pull request Nov 8, 2012
Improvements to distributed indexing service and auto scaling
@cheddar cheddar merged commit f8a5d08 into master Nov 8, 2012
AmatyaAvadhanula pushed a commit that referenced this pull request Aug 4, 2023
* delete old website directory

* upgrade 27.0.0 branch

* convert code tabs

* delete script

* update redirects

* add .spelling file

* fix tasks-api page syntax

* fix spelling file

* fix spelling errors

* delete hidden section

* add service status update into doc2 update

* add service-status

* fix license tab

* fix spelling conflict for supervisor cherrypick

* code tabs for supervisor-api

* fix kinesis link in supervisor-api, bc #14529 heading change

* undo link fix with kinesis doc backported

* JSON-querying API documentation refactor (#14589)

Co-authored-by: Jill Osborne <jill.osborne@imply.io>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
(cherry picked from commit 53733d2)

* code tabs for json querying

* remove <br> tags

* minor format fix

* docs: update admonitions to the Docusaurus 2 style (#20)

---------

Co-authored-by: Nhi Pham <56242907+demo-kratia@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants