Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

River RabbitMQ Plugin #380

Closed
kimchy opened this issue Sep 21, 2010 · 2 comments
Closed

River RabbitMQ Plugin #380

kimchy opened this issue Sep 21, 2010 · 2 comments

Comments

@kimchy
Copy link
Member

kimchy commented Sep 21, 2010

Allow to have a river plugin that automatically index changes by listening to a rabbitmq queue. The format of the message is the same as the bulk API (#371), here is an example:

{ "index" : { "index" : "test", "type" : "type1", "id" : "1" }
{ "type1" : { "field1" : "value1" } }
{ "delete" : { "index" : "test", "type" : "type1", "id" : "2" } }
{ "create" : { "index" : "test", "type" : "type1", "id" : "1" }
{ "type1" : { "field1" : "value1" } }

Creating a rabbitmq river is simple:

curl -XPUT 'localhost:9200/_river/my_river/_meta' -d '{
    "type" : "rabbitmq",
}'

There are several configuration that can be set along with the type on an rabbitmq element:

  • host: The host to connect to, defaults to localhost.
  • port: The port to connect to, defaults to the default AMQP port.
  • user: The user name. Default to not being set.
  • password: The password. Defaults to not being set.
  • vhost: The virtual host.
  • queue: The queue name. Defaults to elasticsearch.
  • exchange: The exchange name. Defaults to elasticsearch.
  • routing_key: The routing key. Defaults to elasticsearch.

On the index element, the following can be controlled:

  • bulk_size: The total bulk size when aggregating messages.
  • bulk_timeout: One a first message is received, how much time to wait to try and aggregate more messages to a single bulk.
@kimchy
Copy link
Member Author

kimchy commented Sep 21, 2010

implemented.

@monadic
Copy link

monadic commented Sep 23, 2010

nice!

williamrandolph pushed a commit to williamrandolph/elasticsearch that referenced this issue Jun 4, 2020
williamrandolph pushed a commit to williamrandolph/elasticsearch that referenced this issue Jun 4, 2020
mindw pushed a commit to mindw/elasticsearch that referenced this issue Sep 5, 2022
…elastic#380)

MPC-4164: update stack_power for EKS

* explicitly require ingress-nginx before deploying engageli kube namespaces

* add StackName and Role tags to EKS ASG, update stack_power.py


Approved-by: Andre Sodermans
Approved-by: Can Yildiz
costin added a commit that referenced this issue Dec 6, 2022
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants