Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Has anyone integrated hive with AWS ElasticSearch service #1145

Open
devps opened this issue Oct 16, 2019 · 4 comments
Open

Has anyone integrated hive with AWS ElasticSearch service #1145

devps opened this issue Oct 16, 2019 · 4 comments

Comments

@devps
Copy link

devps commented Oct 16, 2019

We are implementing hive 3.4 ( latest version) with AWS ElasticSearch 6.7.
After creating the AWS ELK service we got and end point and while redirecting that endpoint we are getting result below:

{
"name" : "7wcfm5H",
"cluster_name" : "954753222468:sec",
"cluster_uuid" : "zvWGA-6-R163KXcigmlSow",
"version" : {
"number" : "6.7.0",
"build_flavor" : "oss",
"build_type" : "zip",
"build_hash" : "8453f77",
"build_date" : "2019-08-21T18:49:19.475514Z",
"build_snapshot" : false,
"lucene_version" : "7.7.0",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}

When I am trying to connect with hive , getting "Elasticsearch cluster is unreachable"

I think, I am not able to connect with elastic database.

Can someone please suggest me what I am missing here? thanks

@ArnaudLhutereau
Copy link

Hi,
I don't think it's possible due to the transport protocol :
https://github.com/TheHive-Project/TheHiveDocs/blob/master/FAQ.md#can-i-connect-thehive-to-an-aws-elasticsearch-service

@devps
Copy link
Author

devps commented Oct 19, 2019

Thank you 🙏

@devps devps closed this as completed Oct 19, 2019
@saadkadhi
Copy link
Contributor

@devps, the FAQ @ArnaudLhutereau pointed to is outdated and we haven't gotten around to update it yet. Sorry for that.

TheHive 3.4.0 supports ES6 as does Cortex 3.0.0. While we have not tested them on AWS, they should be able to work given they support the HTTP transport protocol. @arnydo may be able to help here as he asked a related question on Twitter a few days ago.

Please let us know if it works and what you have done to get it working so we can update the FAQ accordingly.

@kesh-stripe
Copy link

This is an old topic, but we were able to get this to work, some details can be found in this blog post: https://robertheaton.com/2020/01/14/how-to-set-up-the-hive-on-aws-elasticsearch/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants