Skip to content

Latest commit

 

History

History
431 lines (371 loc) · 43.6 KB

README.md

File metadata and controls

431 lines (371 loc) · 43.6 KB

PNDA Heat Templates

Requirements

Python

To use the PNDA command line interface, you will need to install the python, heat and nova clients. To install them on Ubuntu, run:

$ sudo apt-get -y update
$ sudo apt-get -y install python python-pip python-dev
$ sudo pip install python-heatclient
$ sudo pip install python-openstackclient

Git credentials

The stack will make use of git repositories. In case git authentication is required, a private key is required. It is then necessary to have an ssl keypair, whose public key is registered in the git server. To authenticate against the server the private key value must be passed. By default a deploy file must be present in the templates directory. If you already own a keypair, it probably stands in the .ssh subdirectory of your home directory. If this keypair is registered against the git server, it is only necessary to copy its content into the deploy file.

$ cd pnda-heat-templates
$ cp ~/.ssh/id_rsa deploy

If you do not own a keypair or if your public key value is not stored on the git server, please follow this guide to generate a public key.

Also uncomment #deploy and specifiy url of your git repo in pnda_env_standard.yaml file

Deploy PNDA using the CLI

Pre-requisite

As a pre-requisite to use the CLI, it is necessary to setup some openstack required environment variables. The easy way to do so is to retrieve an rc file from the horizon dashboard of your OpenStack platform, in the context of the targeted OpenStack project. Once retrieved just source it.

$ . <project>-openrc.sh

Environment configuration

The Heat PNDA stack default parameters can be set in the pnda_env_standard.yaml file. Please refer to the file ENVIRONMENTS.md in the pnda-heat-templates repository for a full description of every configuration point.

As this file is specific to the target environment it needs to be created by the PNDA integrator. You can start by copying the example pnda_env_standard.yaml found in environments_examples or create your own following this guide and the instructions in ENVIRONMENTS.md.

A brief summary of the main points follows.

You MUST update the KEYSTONE CREDENTIALS section in the pnda_env_standard.yaml file with your openstack credentials in order for PNDA to use swift. For example:

keystone_user: 'pnda'
keystone_password: '32165468321654'
keystone_tenant: 'pnda'
keystone_auth_url: 'https://openstack.example.com:5000/v2.0'
keystone_region_name: 'europe'

You MUST edit the pnda_apps_container, pnda_apps_folder parameters to change which location to use for the application repository in Swift. For example:

pnda_apps_container: 'pnda.applications'
pnda_apps_folder: 'releases'

You MUST edit the pnda_archive_container to point to the Swift container where data will be archived. For example:

pnda_archive_container: 'pnda_archives'

You can optionally add the JavaMirror or ClouderaParcelsMirror parameters to point to your private mirrors of the Sun Oracle Java tarball and Cloudera Parcels mirror. It can make deployment faster. For example:

JavaMirror: 'http://pnda-mirror.example.com/java/jdk/8u74-b02/jdk-8u74-linux-x64.tar.gz'
ClouderaParcelsMirror: 'http://pnda-mirror.example.com/mirror/archive.cloudera.com/cdh5/parcels/5.5.2/'

The CLI

The heat_cli.py scripts allows to launch a PNDA deployment. It sits in the cli subdirectory.

$ cd cli
$ ./heat_cli.py
usage: heat_cli.py [-h] [-y] [-e PNDA_CLUSTER] [-n DATANODES]
                   [-o OPENTSDB_NODES] [-k KAFKA_NODES] [-z ZK_NODES]
                   [-f {standard}] [-b BRANCH] [-s KEYPAIR]
                   {create,destroy}

"the -s KEYPAIR will be used to connect to the bastion instance through ssh. KEYPAIR refers to the name given to the public key of the pair in the target OpenStack tenant. Therefore, a pre-requisite is that you should create a new OpenStack keypair, or import an existing one to the OpenStack platform.

Make sure you have access to the private key of KEYPAIR otherwise you will not be able to connect to the bastion node and access the cluster."

There are various PNDA flavors: this allows changing role distribution across the resources.

Creating a PNDA cluster

We create a standard deployment named cation. We specify 3 data nodes, 1 opentsdb node, 2 kafka nodes, 3 zookeeper nodes:

$ ./heat_cli.py -e cation -n 3 -o 1 -k 2 -z 3 -f standard -s <existing_neutron_keypair> create
+--------------------------------------+------------------+--------------------+----------------------+--------------+
| id                                   | stack_name       | stack_status       | creation_time        | updated_time |
+--------------------------------------+------------------+--------------------+----------------------+--------------+
| 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 | cation           | CREATE_IN_PROGRESS | 2016-04-11T12:47:22Z | None         |
+--------------------------------------+------------------+--------------------+----------------------+--------------+
+-----------------------+------------------------------------------------------------------------------------------------------------------------+
| Property              | Value                                                                                                                  |
+-----------------------+------------------------------------------------------------------------------------------------------------------------+
| capabilities          | []                                                                                                                     |
| creation_time         | 2016-04-11T12:47:22Z                                                                                                   |
| description           | No description                                                                                                         |
| disable_rollback      | True                                                                                                                   |
| id                    | 80d510fe-8fb5-4fbc-b4ba-a65cafa12103                                                                                   |
| links                 | http://XXX.XXX.XXX.XXX:8004/v1/7875ed368a8043449c9dc58aac73ab7e/stacks/cation/80d510fe-8fb5-4fbc-b4ba-a65cafa12103 (self) |
| notification_topics   | []                                                                                                                     |
| parameters            | {                                                                                                                      |
|                       |   "OS::project_id": "7875ed368a8043449c9dc58aac73ab7e",                                                                |
|                       |   "private_net_cidr": "10.10.10.0/24",                                                                                 |
|                       |   "EdgeFlavor": "m1.xlarge",                                                                                           |
|                       |   "private_net_pool_end": "10.10.10.200",                                                                              |

[...]

| stack_user_project_id | d4e029af62ee4b9bbc7c038e2b5ef350                                                                                       |
| template_description  | No description                                                                                                         |
| timeout_mins          | None                                                                                                                   |
| updated_time          | None                                                                                                                   |
+-----------------------+------------------------------------------------------------------------------------------------------------------------+
2016-04-11 12:47:23Z [cation]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-11 12:47:23Z [saltmaster_sec_group]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:24Z [highstate_config]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:24Z [swift_config]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:24Z [PndaSecGroup]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:25Z [private_net]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:25Z [orchestrate_config]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:25Z [router]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:26Z [install_config]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:26Z [Key]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:26Z [orchestrate_config]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [saltmaster_sec_group]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [router]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [install_config]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [private_net]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [swift_config]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [highstate_config]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [Key]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [PndaSecGroup]: CREATE_COMPLETE  state changed
2016-04-11 12:47:27Z [private_subnet]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:29Z [private_subnet]: CREATE_COMPLETE  state changed
2016-04-11 12:47:29Z [saltmaster_port]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:30Z [router_interface]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:47:31Z [saltmaster_port]: CREATE_COMPLETE  state changed
2016-04-11 12:47:31Z [router_interface]: CREATE_COMPLETE  state changed
2016-04-11 12:47:31Z [saltmaster_server]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:48:04Z [saltmaster_server]: CREATE_COMPLETE  state changed
2016-04-11 12:48:04Z [deploy_install]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:50:40Z [deploy_install]: CREATE_COMPLETE  state changed
2016-04-11 12:50:40Z [pnda_cluster]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:53:31Z [pnda_cluster]: CREATE_COMPLETE  state changed
2016-04-11 12:53:31Z [deploy_swift]: CREATE_IN_PROGRESS  state changed
2016-04-11 12:54:36Z [deploy_swift]: CREATE_COMPLETE  state changed
2016-04-11 12:54:36Z [deploy_highstate]: CREATE_IN_PROGRESS  state changed
2016-04-11 13:01:34Z [deploy_highstate]: CREATE_COMPLETE  state changed
2016-04-11 13:01:34Z [deploy_orchestrate]: CREATE_IN_PROGRESS  state changed
2016-04-11 13:33:31Z [deploy_orchestrate]: CREATE_COMPLETE  state changed
2016-04-11 13:33:31Z [cation]: CREATE_COMPLETE  Stack CREATE completed successfully

[...]

 Stack cation CREATE_COMPLETE

Anatomy of a PNDA stack

If we examine the previously created stack :

$ heat stack-list -n | grep cation
| 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 | cation                                                                  | CREATE_COMPLETE | 2016-04-11T12:47:22Z | None         | None                                 |
| d8c4e4aa-b4de-4742-a430-d85553e66987 | cation-pnda_cluster-obz7kxxsnatx                                       | CREATE_COMPLETE | 2016-04-11T12:50:40Z | None         | 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 |
| 3ed6689c-45c1-4201-aab2-96beb2a82974 | cation-pnda_cluster-obz7kxxsnatx-bastion-ccdyikzg2gar                  | CREATE_COMPLETE | 2016-04-11T12:50:44Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 7e911922-a4d5-416b-a69f-5ec3871f2677 | cation-pnda_cluster-obz7kxxsnatx-edge-pribufdbiz3s                     | CREATE_COMPLETE | 2016-04-11T12:50:45Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| cc35476a-e5ab-4620-9d38-0f28ce2dc84d | cation-pnda_cluster-obz7kxxsnatx-cm-anaz62owf25q                       | CREATE_COMPLETE | 2016-04-11T12:50:46Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| fa48786c-84c1-42ed-adac-167e850b396b | cation-pnda_cluster-obz7kxxsnatx-manager1-pkyrsg6kywg5                 | CREATE_COMPLETE | 2016-04-11T12:50:49Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| d5c7baf7-0115-4b97-ac6c-2a9ae2a9f8e4 | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz                 | CREATE_COMPLETE | 2016-04-11T12:50:52Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| f4bd32b0-9df8-40eb-a13f-b8ee3f7c5260 | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4                | CREATE_COMPLETE | 2016-04-11T12:50:52Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 689e88ca-0ea0-4747-8753-dfbcd25c0bcd | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh  | CREATE_COMPLETE | 2016-04-11T12:50:54Z | None         | d5c7baf7-0115-4b97-ac6c-2a9ae2a9f8e4 |
| 436f9371-8430-4937-9580-bd923d9e8f78 | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le                    | CREATE_COMPLETE | 2016-04-11T12:50:55Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 482f1e2a-ba44-48f3-92d5-3aa7f4e15515 | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 | CREATE_COMPLETE | 2016-04-11T12:50:56Z | None         | f4bd32b0-9df8-40eb-a13f-b8ee3f7c5260 |
| d7e4d502-4057-4afa-be87-fd27c93323c0 | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx                       | CREATE_COMPLETE | 2016-04-11T12:50:57Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 557f23e6-205b-4ad4-8ef3-d489c692ca46 | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v     | CREATE_COMPLETE | 2016-04-11T12:50:58Z | None         | 436f9371-8430-4937-9580-bd923d9e8f78 |
| ca0ed237-3026-44b9-8bb9-7813913f561a | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk                    | CREATE_COMPLETE | 2016-04-11T12:50:58Z | None         | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 52e1a7ed-c7f4-419d-b7d5-6749dcc498a4 | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        | CREATE_COMPLETE | 2016-04-11T12:50:59Z | None         | d7e4d502-4057-4afa-be87-fd27c93323c0 |
| 8e0318ed-5b1b-46f7-ae0f-766fb8077a82 | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb     | CREATE_COMPLETE | 2016-04-11T12:51:00Z | None         | ca0ed237-3026-44b9-8bb9-7813913f561a |

A PNDA deployment is a heat stack, and nested stacks deploying a cluster made of again another nested stack per role/cluster. Each line in the previous output describes a heat stack which can be examinded again.

We can have a look at the resources of the stack :

$ heat resource-list cation
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+
| resource_name        | physical_resource_id                                                                | resource_type                | resource_status | updated_time         |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+
| deploy_highstate     | 2bc4d5ba-441d-439e-ba41-f2ebb3009b76                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| deploy_orchestrate   | 04c82c5a-470c-4bbf-8105-6b602b0e3994                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| deploy_swift         | 92ca062d-ed22-4167-a02f-31ee4eb902c9                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| pnda_cluster        | d8c4e4aa-b4de-4742-a430-d85553e66987                                                | OS::Pnda::cluster           | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| Key                  | cation                                                                              | OS::Nova::KeyPair            | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| PndaSecGroup        | 5852df8a-2c10-4d27-b11e-acdfcc2b40f2                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| deploy_install       | e625e78c-15b1-430f-ae69-6bb41f05efd4                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| highstate_config     | 1cd5fbee-c6b9-4596-858f-deac94dc1060                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| install_config       | b664a413-0a2e-46c8-b6ba-3303045a582c                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| orchestrate_config   | f70201c2-5814-41b2-bdb1-9158903a8a4e                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| private_net          | c232c59f-9cb7-457f-aa8b-50bc285ba14f                                                | OS::Neutron::Net             | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| private_subnet       | 54156224-3749-496c-b39c-bd5c6121e9d6                                                | OS::Neutron::Subnet          | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| router               | 31a1a963-d686-4488-aa66-5d655f416308                                                | OS::Neutron::Router          | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| router_interface     | 31a1a963-d686-4488-aa66-5d655f416308:subnet_id=54156224-3749-496c-b39c-bd5c6121e9d6 | OS::Neutron::RouterInterface | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| saltmaster_port      | 94177921-9829-4630-93aa-ba50117980c0                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| saltmaster_sec_group | b06b1142-3c7e-4115-8b04-5424071fd134                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| saltmaster_server    | d5f4f0d7-70e0-4d54-bb94-11766e25c471                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| swift_config         | b49e4621-995e-4779-b360-1067f9082928                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+

And ultimately the resources from the nested stacks as well :

$ heat resource-list -n 5 cation                                                                                                                                                        [113/489]
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+---------------------------------------
----------------------------------+
| resource_name        | physical_resource_id                                                                | resource_type                | resource_status | updated_time         | stack_name
                                  |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+---------------------------------------
----------------------------------+
| deploy_highstate     | 2bc4d5ba-441d-439e-ba41-f2ebb3009b76                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
                                  |
| deploy_orchestrate   | 04c82c5a-470c-4bbf-8105-6b602b0e3994                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
                                  |
| deploy_swift         | 92ca062d-ed22-4167-a02f-31ee4eb902c9                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
                                  |
| pnda_cluster        | d8c4e4aa-b4de-4742-a430-d85553e66987                                                | OS::Pnda::cluster           | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
                                  |
| Key                  | cation                                                                              | OS::Nova::KeyPair            | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| PndaSecGroup        | 5852df8a-2c10-4d27-b11e-acdfcc2b40f2                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| deploy_install       | e625e78c-15b1-430f-ae69-6bb41f05efd4                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| highstate_config     | 1cd5fbee-c6b9-4596-858f-deac94dc1060                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| install_config       | b664a413-0a2e-46c8-b6ba-3303045a582c                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| orchestrate_config   | f70201c2-5814-41b2-bdb1-9158903a8a4e                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| private_net          | c232c59f-9cb7-457f-aa8b-50bc285ba14f                                                | OS::Neutron::Net             | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| private_subnet       | 54156224-3749-496c-b39c-bd5c6121e9d6                                                | OS::Neutron::Subnet          | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| router               | 31a1a963-d686-4488-aa66-5d655f416308                                                | OS::Neutron::Router          | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| router_interface     | 31a1a963-d686-4488-aa66-5d655f416308:subnet_id=54156224-3749-496c-b39c-bd5c6121e9d6 | OS::Neutron::RouterInterface | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| saltmaster_port      | 94177921-9829-4630-93aa-ba50117980c0                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| saltmaster_sec_group | b06b1142-3c7e-4115-8b04-5424071fd134                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| saltmaster_server    | d5f4f0d7-70e0-4d54-bb94-11766e25c471                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| swift_config         | b49e4621-995e-4779-b360-1067f9082928                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
                                  |
| bastion              | 3ed6689c-45c1-4201-aab2-96beb2a82974                                                | OS::Pnda::bastion           | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| cm                   | cc35476a-e5ab-4620-9d38-0f28ce2dc84d                                                | OS::Pnda::cm                | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| edge                 | 7e911922-a4d5-416b-a69f-5ec3871f2677                                                | OS::Pnda::edge              | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| opentsdb             | d5c7baf7-0115-4b97-ac6c-2a9ae2a9f8e4                                                | OS::Heat::ResourceGroup      | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| DNSecGroup           | fb6e6b38-40d1-4b80-85a1-626969c8dbe7                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| KafkaSecGroup        | 958ada28-4e65-47c6-929c-e2b4445313ad                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| OpentsdbSecGroup     | 191320d3-3ecf-47e8-8e6b-bb259a282e05                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| ToolsSecGroup        | 4141c2fb-ee52-4828-a125-433234f1b14b                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| ZKSecGroup           | 332fe76d-4c66-486a-8b8c-6f4550ea8588                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| dn                   | d7e4d502-4057-4afa-be87-fd27c93323c0                                                | OS::Heat::ResourceGroup      | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| kafka                | ca0ed237-3026-44b9-8bb9-7813913f561a                                                | OS::Heat::ResourceGroup      | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| manager1             | fa48786c-84c1-42ed-adac-167e850b396b                                                | OS::Pnda::manager1          | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| tools                | 436f9371-8430-4937-9580-bd923d9e8f78                                                | OS::Heat::ResourceGroup      | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| zookeeper            | f4bd32b0-9df8-40eb-a13f-b8ee3f7c5260                                                | OS::Heat::ResourceGroup      | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
                                  |
| floatingIP           | 0c45ee3f-0817-4cd7-852f-c2331cb367e9                                                | OS::Neutron::FloatingIP      | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar                  |
| install_config       | 03f94be1-2673-43eb-ae22-1f90ef71e2f6                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar                  |
| install_deployment   | 8a83fe6a-e494-4460-b9a0-1bd2860be5e0                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar                  |
| port                 | ecbb0a84-9da8-4ed4-af52-4d58c97fe029                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar                  |
| sec_group            | 6447961b-b12c-4719-a068-4a8cb4161b3a                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar                  |
| server               | 62b63880-a80a-4142-adc7-6a0e258546c1                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar                  |
| install_config       | 3c54dbfc-5fcc-4b8f-bef4-b443806363f5                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s                     |
| install_deployment   | 3c7e3df2-1520-4eec-84e7-4ef764c95614                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s                     |
| port                 | 1628aace-0f3f-4edb-8152-31fb6c098a03                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s                     |
| sec_group            | 510b83e9-bf7c-424e-8dc1-a8dc60bc701a                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s                     |
| server               | feeff5db-e3c6-4035-8654-38bf70f09677                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s                     |
| install_config       | 219ea1b4-730d-4e0a-8928-70de06c0cf20                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q                       |
| install_deployment   | 24d36818-2447-4161-8b22-40e5c9373e2f                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q                       |
| port                 | 9992d132-918b-4121-a8d9-d17078bdbbdc                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q                       |
| sec_group            | 01ce3f03-1740-4769-924c-5698206c7714                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q                       |
| server               | 3a71802d-c5f7-40f7-aae2-56ea64b25071                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q                       |
| install_config       | b6e42e21-d4eb-4c71-b5be-29ac4bd514d8                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5                 |
| install_deployment   | 0388f83f-dab8-4398-a812-1fae1d3648c4                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5                 |
| port                 | 51fb1400-7067-4434-9dce-3b714efb0eaa                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5                 |
| sec_group            | ae76a14a-3f4d-4309-a0b9-3f54ea24072b                                                | OS::Neutron::SecurityGroup   | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5                 |
| server               | 8cd4101f-efa3-4fe3-9a2e-8ba55fcd1885                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5                 |
| 0                    | 482f1e2a-ba44-48f3-92d5-3aa7f4e15515                                                | OS::Pnda::zookeeper         | CREATE_COMPLETE | 2016-04-11T12:50:52Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4                |
| 0                    | 689e88ca-0ea0-4747-8753-dfbcd25c0bcd                                                | OS::Pnda::opentsdb          | CREATE_COMPLETE | 2016-04-11T12:50:52Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz                 |
| install_deployment   | d8016fcb-ee82-43c8-ae63-dbd87bd607cc                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:54Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh  |
| port                 | 3741d558-040e-4899-aa09-0acd55fa5ed1                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:55Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh  |
| 0                    | 557f23e6-205b-4ad4-8ef3-d489c692ca46                                                | OS::Pnda::tools             | CREATE_COMPLETE | 2016-04-11T12:50:56Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le                    |
| install_config       | 95cca8b6-e463-4383-803e-8c5729714834                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:56Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh  |
| server               | e8f63fb4-36cd-4e2d-be3b-c4e2e58d2da8                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:56Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh  |
| 0                    | 52e1a7ed-c7f4-419d-b7d5-6749dcc498a4                                                | OS::Pnda::dn                | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx                       |
| install_config       | dd671a45-fb27-4b76-a10d-807bf87fd7b0                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| install_deployment   | 87147bbb-7a4d-46e9-8d27-0a45a0678f84                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| port                 | 6b55e5d5-6309-4a38-ad58-8fe588ab7f57                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| server               | 834e3201-316b-4b77-81c8-6e48af9f6476                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| install_config       | d1d4046a-6537-411d-9bb1-846243215801                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:50:58Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v     |
| install_deployment   | e2acf060-ad02-4785-9900-1cf71c365097                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:58Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v     |
| 0                    | 8e0318ed-5b1b-46f7-ae0f-766fb8077a82                                                | OS::Pnda::kafka             | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk                    |
| port                 | 7061585f-3b60-41b4-a458-3ad443f59adf                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        |
| port                 | c2ad7911-67ed-4632-8a9f-2e2238ce2836                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v     |
| server               | 38fd7a6b-e846-410d-90ba-dd222e5aabd9                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v     |
| install_config       | b678c181-2e12-4d0b-9a8c-1cd85cb78348                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        |
| install_deployment   | 6d46cb0b-0066-4b24-bb53-fc3a1b92c2dd                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        |
| server               | d4013a0c-8ae5-4bda-a101-2b618471cfdd                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        |
| volume               | ccd54e94-ed5d-40de-9e44-7ac0ea68c599                                                | OS::Cinder::Volume           | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        |
| volume_attachment    | ccd54e94-ed5d-40de-9e44-7ac0ea68c599                                                | OS::Cinder::VolumeAttachment | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6        |
| install_config       | f35da354-b6af-47c2-b242-10e0cda7f697                                                | OS::Heat::SoftwareConfig     | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb     |
| install_deployment   | 2f62cb64-19c7-4cb5-ac9e-57d1f57f520e                                                | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb     |
| port                 | 11b75015-7178-4830-a1a4-dbab9a360562                                                | OS::Neutron::Port            | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb     |
| server               | c420c207-ae8e-47de-b81d-c3551ce3254e                                                | OS::Nova::Server             | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb     |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+-------------------------------------------------------------------------+

Examining the provisioned instances :

$ nova list | grep cation
| 61f96b51-264a-4e76-8b2b-d0d287f24be8 | cation-lab-0-bastion     | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.18, 10.60.18.34 |
| e8091ceb-222f-4d91-b5bf-04943da01558 | cation-lab-0-cdh-cm      | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.19              |
| 953c4e1e-6671-49ee-aced-838547f71514 | cation-lab-0-cdh-dn-0    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.31              |
| af64183c-e674-4824-8fb0-bcaf193e7ea7 | cation-lab-0-cdh-dn-1    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.35              |
| a802878e-32a9-49fe-9d6a-3b431d6f888c | cation-lab-0-cdh-dn-2    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.36              |
| a6d86587-04ca-4385-8871-faf3fd67061b | cation-lab-0-cdh-edge    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.24              |
| 22c6fcd0-ebfe-4bd9-ae48-401f6a83dcbb | cation-lab-0-cdh-jupyter | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.20              |
| 35987268-b218-4f46-9fa1-6a81ea7a982a | cation-lab-0-cdh-mgr1    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.17              |
| 7c9f25d8-ee58-4d43-9177-d0a40e19b6c6 | cation-lab-0-cdh-mgr2    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.16              |
| a7411e57-34b0-4d87-ad62-1d1b471cfe5e | cation-lab-0-cdh-mgr3    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.14              |
| eebf2ac7-d25e-49db-8b70-78c3b7c49774 | cation-lab-0-cdh-mgr4    | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.15              |
| fcb087ab-789f-4a13-891a-71ac70fc2b3f | cation-lab-0-collector   | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.38, 10.60.18.57 |
| e7941b24-dec3-405c-b61d-cbedd315b0c8 | cation-lab-0-kafka-0     | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.25              |
| b3ba4c44-939d-4fc4-bc88-c2657ffafc52 | cation-lab-0-kafka-1     | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.23              |
| 9854cc56-780f-49d8-bd11-1e2086ab886a | cation-lab-0-logserver   | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.22              |
| 4aca9943-b5f1-4599-8fdb-0f9f4b4df3c4 | cation-lab-0-opentsdb-0  | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.37              |
| 95a21ded-71ab-4576-9850-3ab0ac82938d | cation-lab-0-saltmaster  | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.13              |
| aa4c214d-1d9a-423e-b8e4-43bcaec2fa5c | cation-lab-0-tools-0     | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.28              |
| 49090d85-3d2b-4135-b1e7-f28c00b982fd | cation-lab-0-zookeeper-0 | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.32              |
| bf1cbadb-5910-45ec-8aaf-918f2b7f4231 | cation-lab-0-zookeeper-1 | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.29              |
| cae2fd4d-6d81-4c29-b75f-b15510329a7c | cation-lab-0-zookeeper-2 | ACTIVE | -          | Running     | cation-lab-0-net=192.168.10.26              |

The only instance reachable from outside the deployment is the bastion instance. It can be sshed:

$ ssh -i <your_private_key file> cloud-user@10.60.18.197

From the bastion instance you can then ssh to the other instances using the dynamically created private key whose file sits in the cloud-user home directory.

cloud-user@cation-bastion:~$ ls -l
total 4
-rw------- 1 cloud-user cloud-user 1675 Apr 11 12:51 cation-pnda_cluster-obz7kxxsnatx-bastion-ccdyikzg2gar.pem

ssh to the saltmaster instance:

cloud-user@cation-bastion:~$ ssh -i cation-pnda_cluster-obz7kxxsnatx-bastion-ccdyikzg2gar.pem salt
The authenticity of host 'salt (10.10.10.13)' can't be established.
ECDSA key fingerprint is 67:f4:3d:79:7e:a1:7f:94:59:6e:83:ba:2d:bd:23:1c.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'salt,10.10.10.13' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 3.13.0-83-generic x86_64)

[...]

cloud-user@cation-saltmaster:~$

References

Some interesting links: