Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for multi-node installations with Ansible roles #339

Merged
merged 6 commits into from
Jan 22, 2019
Merged

Add support for multi-node installations with Ansible roles #339

merged 6 commits into from
Jan 22, 2019

Conversation

bndabbs
Copy link
Contributor

@bndabbs bndabbs commented Jan 13, 2019

No description provided.

bndabbs and others added 5 commits January 16, 2019 15:12
Move elasticsearch to role

Move lighttpd to role

Move Kafka handlers to role

Move kibana to role

Move ROCK dashboards to Kibana role

Move mappings to ES role

Move more configs to ES and Kibana roles

Move logstash to role

Move Bro to role

Move FSF to role

Move suricata to role

Cleanup vars and add plays for each role

Move GeoIP to Bro role

Move monitor interface out of sensor-common

Cleanup ES tasks

Move common packages to sensor-common

Move firewall tasks to sensor-common

Update source for ES firewall rules

Move bro packages into role

Remove java from common packages

Move fsf package install to role

Move all packages to roles

Modularize filebeat config

Move ROCK customizations to sensor-common

Cleanup handlers and grammar

Add sample multi-node inventory

Cleanup capitalization and add conf dir

Deploy sensor-common to all hosts

Remove vars file mapping

This model doesn't work when doing a multinode deployment

Fix handler syntax and capitalization

Fix indentation

Add multi-node config for Elasticsearch

Fix grammar

Add task to create filebeat config dir

Standardize casing across all roles and remove meta folders

Add missing handler for filebeat

Fix handler name

Fix elasticsearch firewall rule

Update elasticsearch ports

Add env vars for logstash

Add tasks to download rock-dashboards

Make kafka and ES hosts dynamic in LS configs

Update hosts file to work with multinode installs

Update firewall ports

Update firewall ports

Fix handler name

Update rock version

Scope hosts file to play_hosts

Remove docket prefix from names

Remove hardcoded loopback addresses

Update roles to work with docket in multinode

Add gpg keys for offline environments

Set steno listener to routable interface

Remove kibana ports from firewall

Add playbook to setup requirements on deployment host

Sort host list to keep it idempotent

Update formatting

Update sample inventory to work with ES roles

Update rock version and move packages to central location

Add transport port to ES ports

Reconfigure to allow single and multinode from same playbook

Tell steno to always listen in non-loopback

This greatly simplifies docket configuration.

Fix firewall task for steno

Move cache to home dir by default

Fix elasticsearch address to work with multinode and singlenode

Make es_url dynamic

Update inventory path

Fix host variable
Switched away from using host_vars, because it would be very easy to 
overlook or misconfigure. This approach is much more approachable.
Copy link
Contributor

@jeffgeiger jeffgeiger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wunderbar.

@jeffgeiger jeffgeiger merged commit 1f48e71 into rocknsm:devel Jan 22, 2019
@bndabbs bndabbs deleted the multinode branch January 22, 2019 06:06
@dcode dcode mentioned this pull request Feb 22, 2019
dcode added a commit that referenced this pull request Feb 22, 2019
* New: Add ability to do multi-host deployment of sensor + data tiers (#339, [bndabbs@gmail.com](mailto:bndabbs@gmail.com))
* New: Integrate Docket into Kibana by default ([derek@rocknsm.io](mailto:derek@rocknsm.io))
* New: Improvements and additional Kibana dashboards (spartan782)
* Fixes: issue with Bro failing when monitor interface is down (#343, [bndabbs@gmail.com](mailto:bndabbs@gmail.com))
* Fixes: issue with services starting that shouldn’t (#346, [therealneu5ron@gmail.com](mailto:therealneu5ron@gmail.com))
* Fixes: race condition on loading dashboards into Kibana (#356, [derek@rocknsm.io](mailto:derek@rocknsm.io))
* Fixes: configuration for Docket allowing serving from non-root URI (#361, [derek@rocknsm.io](mailto:derek@rocknsm.io))
* Change: bro log retention value to one week rather than forever (#345, [sean.cochran@gmail.com](mailto:sean.cochran@gmail.com))
* Change: Greatly improve documentation  (#338, [sean.cochran@gmail.com](mailto:sean.cochran@gmail.com))
* Change: Reorganize README (#308, [bradford.dabbs@elastic.co](mailto:bradford.dabbs@elastic.co))
* Change: Move ECS to rock-dashboards repo (#305, [derek@rocknsm.io](mailto:derek@rocknsm.io))
* Change: Move RockNSM install paths to filesystem heirarchy standard locations (#344, [bndabbs@gmail.com](mailto:bndabbs@gmail.com))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants