To use the PNDA command line interface, you will need to install the python, heat and nova clients. To install them on Ubuntu, run:
$ sudo apt-get -y update
$ sudo apt-get -y install python python-pip python-dev
$ sudo pip install python-heatclient
$ sudo pip install python-openstackclient
The stack will make use of git repositories. In case git authentication is required, a private key is required. It is then necessary to have an ssl keypair, whose public key is registered in the git server. To authenticate against the server the private key value must be passed. By default a deploy file must be present in the templates directory. If you already own a keypair, it probably stands in the .ssh subdirectory of your home directory. If this keypair is registered against the git server, it is only necessary to copy its content into the deploy file.
$ cd pnda-heat-templates
$ cp ~/.ssh/id_rsa deploy
If you do not own a keypair or if your public key value is not stored on the git server, please follow this guide to generate a public key.
Also uncomment #deploy and specifiy url of your git repo in pnda_env_standard.yaml file
As a pre-requisite to use the CLI, it is necessary to setup some openstack required environment variables. The easy way to do so is to retrieve an rc file from the horizon dashboard of your OpenStack platform, in the context of the targeted OpenStack project. Once retrieved just source it.
$ . <project>-openrc.sh
The Heat PNDA stack default parameters can be set in the pnda_env_standard.yaml file. Please refer to the file ENVIRONMENTS.md in the pnda-heat-templates repository for a full description of every configuration point.
As this file is specific to the target environment it needs to be created by the PNDA integrator. You can start by copying the example pnda_env_standard.yaml found in environments_examples or create your own following this guide and the instructions in ENVIRONMENTS.md.
A brief summary of the main points follows.
You MUST update the KEYSTONE CREDENTIALS section in the pnda_env_standard.yaml file with your openstack credentials in order for PNDA to use swift. For example:
keystone_user: 'pnda'
keystone_password: '32165468321654'
keystone_tenant: 'pnda'
keystone_auth_url: 'https://openstack.example.com:5000/v2.0'
keystone_region_name: 'europe'
You MUST edit the pnda_apps_container, pnda_apps_folder parameters to change which location to use for the application repository in Swift. For example:
pnda_apps_container: 'pnda.applications'
pnda_apps_folder: 'releases'
You MUST edit the pnda_archive_container to point to the Swift container where data will be archived. For example:
pnda_archive_container: 'pnda_archives'
You can optionally add the JavaMirror or ClouderaParcelsMirror parameters to point to your private mirrors of the Sun Oracle Java tarball and Cloudera Parcels mirror. It can make deployment faster. For example:
JavaMirror: 'http://pnda-mirror.example.com/java/jdk/8u74-b02/jdk-8u74-linux-x64.tar.gz'
ClouderaParcelsMirror: 'http://pnda-mirror.example.com/mirror/archive.cloudera.com/cdh5/parcels/5.5.2/'
The heat_cli.py scripts allows to launch a PNDA deployment. It sits in the cli subdirectory.
$ cd cli
$ ./heat_cli.py
usage: heat_cli.py [-h] [-y] [-e PNDA_CLUSTER] [-n DATANODES]
[-o OPENTSDB_NODES] [-k KAFKA_NODES] [-z ZK_NODES]
[-f {standard}] [-b BRANCH] [-s KEYPAIR]
{create,destroy}
"the -s KEYPAIR will be used to connect to the bastion instance through ssh. KEYPAIR refers to the name given to the public key of the pair in the target OpenStack tenant. Therefore, a pre-requisite is that you should create a new OpenStack keypair, or import an existing one to the OpenStack platform.
Make sure you have access to the private key of KEYPAIR otherwise you will not be able to connect to the bastion node and access the cluster."
There are various PNDA flavors: this allows changing role distribution across the resources.
We create a standard deployment named cation. We specify 3 data nodes, 1 opentsdb node, 2 kafka nodes, 3 zookeeper nodes:
$ ./heat_cli.py -e cation -n 3 -o 1 -k 2 -z 3 -f standard -s <existing_neutron_keypair> create
+--------------------------------------+------------------+--------------------+----------------------+--------------+
| id | stack_name | stack_status | creation_time | updated_time |
+--------------------------------------+------------------+--------------------+----------------------+--------------+
| 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 | cation | CREATE_IN_PROGRESS | 2016-04-11T12:47:22Z | None |
+--------------------------------------+------------------+--------------------+----------------------+--------------+
+-----------------------+------------------------------------------------------------------------------------------------------------------------+
| Property | Value |
+-----------------------+------------------------------------------------------------------------------------------------------------------------+
| capabilities | [] |
| creation_time | 2016-04-11T12:47:22Z |
| description | No description |
| disable_rollback | True |
| id | 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 |
| links | http://XXX.XXX.XXX.XXX:8004/v1/7875ed368a8043449c9dc58aac73ab7e/stacks/cation/80d510fe-8fb5-4fbc-b4ba-a65cafa12103 (self) |
| notification_topics | [] |
| parameters | { |
| | "OS::project_id": "7875ed368a8043449c9dc58aac73ab7e", |
| | "private_net_cidr": "10.10.10.0/24", |
| | "EdgeFlavor": "m1.xlarge", |
| | "private_net_pool_end": "10.10.10.200", |
[...]
| stack_user_project_id | d4e029af62ee4b9bbc7c038e2b5ef350 |
| template_description | No description |
| timeout_mins | None |
| updated_time | None |
+-----------------------+------------------------------------------------------------------------------------------------------------------------+
2016-04-11 12:47:23Z [cation]: CREATE_IN_PROGRESS Stack CREATE started
2016-04-11 12:47:23Z [saltmaster_sec_group]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:24Z [highstate_config]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:24Z [swift_config]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:24Z [PndaSecGroup]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:25Z [private_net]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:25Z [orchestrate_config]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:25Z [router]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:26Z [install_config]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:26Z [Key]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:26Z [orchestrate_config]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [saltmaster_sec_group]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [router]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [install_config]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [private_net]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [swift_config]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [highstate_config]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [Key]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [PndaSecGroup]: CREATE_COMPLETE state changed
2016-04-11 12:47:27Z [private_subnet]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:29Z [private_subnet]: CREATE_COMPLETE state changed
2016-04-11 12:47:29Z [saltmaster_port]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:30Z [router_interface]: CREATE_IN_PROGRESS state changed
2016-04-11 12:47:31Z [saltmaster_port]: CREATE_COMPLETE state changed
2016-04-11 12:47:31Z [router_interface]: CREATE_COMPLETE state changed
2016-04-11 12:47:31Z [saltmaster_server]: CREATE_IN_PROGRESS state changed
2016-04-11 12:48:04Z [saltmaster_server]: CREATE_COMPLETE state changed
2016-04-11 12:48:04Z [deploy_install]: CREATE_IN_PROGRESS state changed
2016-04-11 12:50:40Z [deploy_install]: CREATE_COMPLETE state changed
2016-04-11 12:50:40Z [pnda_cluster]: CREATE_IN_PROGRESS state changed
2016-04-11 12:53:31Z [pnda_cluster]: CREATE_COMPLETE state changed
2016-04-11 12:53:31Z [deploy_swift]: CREATE_IN_PROGRESS state changed
2016-04-11 12:54:36Z [deploy_swift]: CREATE_COMPLETE state changed
2016-04-11 12:54:36Z [deploy_highstate]: CREATE_IN_PROGRESS state changed
2016-04-11 13:01:34Z [deploy_highstate]: CREATE_COMPLETE state changed
2016-04-11 13:01:34Z [deploy_orchestrate]: CREATE_IN_PROGRESS state changed
2016-04-11 13:33:31Z [deploy_orchestrate]: CREATE_COMPLETE state changed
2016-04-11 13:33:31Z [cation]: CREATE_COMPLETE Stack CREATE completed successfully
[...]
Stack cation CREATE_COMPLETE
If we examine the previously created stack :
$ heat stack-list -n | grep cation
| 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 | cation | CREATE_COMPLETE | 2016-04-11T12:47:22Z | None | None |
| d8c4e4aa-b4de-4742-a430-d85553e66987 | cation-pnda_cluster-obz7kxxsnatx | CREATE_COMPLETE | 2016-04-11T12:50:40Z | None | 80d510fe-8fb5-4fbc-b4ba-a65cafa12103 |
| 3ed6689c-45c1-4201-aab2-96beb2a82974 | cation-pnda_cluster-obz7kxxsnatx-bastion-ccdyikzg2gar | CREATE_COMPLETE | 2016-04-11T12:50:44Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 7e911922-a4d5-416b-a69f-5ec3871f2677 | cation-pnda_cluster-obz7kxxsnatx-edge-pribufdbiz3s | CREATE_COMPLETE | 2016-04-11T12:50:45Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| cc35476a-e5ab-4620-9d38-0f28ce2dc84d | cation-pnda_cluster-obz7kxxsnatx-cm-anaz62owf25q | CREATE_COMPLETE | 2016-04-11T12:50:46Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| fa48786c-84c1-42ed-adac-167e850b396b | cation-pnda_cluster-obz7kxxsnatx-manager1-pkyrsg6kywg5 | CREATE_COMPLETE | 2016-04-11T12:50:49Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| d5c7baf7-0115-4b97-ac6c-2a9ae2a9f8e4 | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz | CREATE_COMPLETE | 2016-04-11T12:50:52Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| f4bd32b0-9df8-40eb-a13f-b8ee3f7c5260 | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4 | CREATE_COMPLETE | 2016-04-11T12:50:52Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 689e88ca-0ea0-4747-8753-dfbcd25c0bcd | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh | CREATE_COMPLETE | 2016-04-11T12:50:54Z | None | d5c7baf7-0115-4b97-ac6c-2a9ae2a9f8e4 |
| 436f9371-8430-4937-9580-bd923d9e8f78 | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le | CREATE_COMPLETE | 2016-04-11T12:50:55Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 482f1e2a-ba44-48f3-92d5-3aa7f4e15515 | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 | CREATE_COMPLETE | 2016-04-11T12:50:56Z | None | f4bd32b0-9df8-40eb-a13f-b8ee3f7c5260 |
| d7e4d502-4057-4afa-be87-fd27c93323c0 | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx | CREATE_COMPLETE | 2016-04-11T12:50:57Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 557f23e6-205b-4ad4-8ef3-d489c692ca46 | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v | CREATE_COMPLETE | 2016-04-11T12:50:58Z | None | 436f9371-8430-4937-9580-bd923d9e8f78 |
| ca0ed237-3026-44b9-8bb9-7813913f561a | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk | CREATE_COMPLETE | 2016-04-11T12:50:58Z | None | d8c4e4aa-b4de-4742-a430-d85553e66987 |
| 52e1a7ed-c7f4-419d-b7d5-6749dcc498a4 | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 | CREATE_COMPLETE | 2016-04-11T12:50:59Z | None | d7e4d502-4057-4afa-be87-fd27c93323c0 |
| 8e0318ed-5b1b-46f7-ae0f-766fb8077a82 | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb | CREATE_COMPLETE | 2016-04-11T12:51:00Z | None | ca0ed237-3026-44b9-8bb9-7813913f561a |
A PNDA deployment is a heat stack, and nested stacks deploying a cluster made of again another nested stack per role/cluster. Each line in the previous output describes a heat stack which can be examinded again.
We can have a look at the resources of the stack :
$ heat resource-list cation
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+
| resource_name | physical_resource_id | resource_type | resource_status | updated_time |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+
| deploy_highstate | 2bc4d5ba-441d-439e-ba41-f2ebb3009b76 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| deploy_orchestrate | 04c82c5a-470c-4bbf-8105-6b602b0e3994 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| deploy_swift | 92ca062d-ed22-4167-a02f-31ee4eb902c9 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| pnda_cluster | d8c4e4aa-b4de-4742-a430-d85553e66987 | OS::Pnda::cluster | CREATE_COMPLETE | 2016-04-11T12:47:22Z |
| Key | cation | OS::Nova::KeyPair | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| PndaSecGroup | 5852df8a-2c10-4d27-b11e-acdfcc2b40f2 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| deploy_install | e625e78c-15b1-430f-ae69-6bb41f05efd4 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| highstate_config | 1cd5fbee-c6b9-4596-858f-deac94dc1060 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| install_config | b664a413-0a2e-46c8-b6ba-3303045a582c | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| orchestrate_config | f70201c2-5814-41b2-bdb1-9158903a8a4e | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| private_net | c232c59f-9cb7-457f-aa8b-50bc285ba14f | OS::Neutron::Net | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| private_subnet | 54156224-3749-496c-b39c-bd5c6121e9d6 | OS::Neutron::Subnet | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| router | 31a1a963-d686-4488-aa66-5d655f416308 | OS::Neutron::Router | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| router_interface | 31a1a963-d686-4488-aa66-5d655f416308:subnet_id=54156224-3749-496c-b39c-bd5c6121e9d6 | OS::Neutron::RouterInterface | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| saltmaster_port | 94177921-9829-4630-93aa-ba50117980c0 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| saltmaster_sec_group | b06b1142-3c7e-4115-8b04-5424071fd134 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| saltmaster_server | d5f4f0d7-70e0-4d54-bb94-11766e25c471 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
| swift_config | b49e4621-995e-4779-b360-1067f9082928 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+
And ultimately the resources from the nested stacks as well :
$ heat resource-list -n 5 cation [113/489]
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+---------------------------------------
----------------------------------+
| resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name
|
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+---------------------------------------
----------------------------------+
| deploy_highstate | 2bc4d5ba-441d-439e-ba41-f2ebb3009b76 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
|
| deploy_orchestrate | 04c82c5a-470c-4bbf-8105-6b602b0e3994 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
|
| deploy_swift | 92ca062d-ed22-4167-a02f-31ee4eb902c9 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
|
| pnda_cluster | d8c4e4aa-b4de-4742-a430-d85553e66987 | OS::Pnda::cluster | CREATE_COMPLETE | 2016-04-11T12:47:22Z | cation
|
| Key | cation | OS::Nova::KeyPair | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| PndaSecGroup | 5852df8a-2c10-4d27-b11e-acdfcc2b40f2 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| deploy_install | e625e78c-15b1-430f-ae69-6bb41f05efd4 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| highstate_config | 1cd5fbee-c6b9-4596-858f-deac94dc1060 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| install_config | b664a413-0a2e-46c8-b6ba-3303045a582c | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| orchestrate_config | f70201c2-5814-41b2-bdb1-9158903a8a4e | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| private_net | c232c59f-9cb7-457f-aa8b-50bc285ba14f | OS::Neutron::Net | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| private_subnet | 54156224-3749-496c-b39c-bd5c6121e9d6 | OS::Neutron::Subnet | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| router | 31a1a963-d686-4488-aa66-5d655f416308 | OS::Neutron::Router | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| router_interface | 31a1a963-d686-4488-aa66-5d655f416308:subnet_id=54156224-3749-496c-b39c-bd5c6121e9d6 | OS::Neutron::RouterInterface | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| saltmaster_port | 94177921-9829-4630-93aa-ba50117980c0 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| saltmaster_sec_group | b06b1142-3c7e-4115-8b04-5424071fd134 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| saltmaster_server | d5f4f0d7-70e0-4d54-bb94-11766e25c471 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| swift_config | b49e4621-995e-4779-b360-1067f9082928 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:47:23Z | cation
|
| bastion | 3ed6689c-45c1-4201-aab2-96beb2a82974 | OS::Pnda::bastion | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
|
| cm | cc35476a-e5ab-4620-9d38-0f28ce2dc84d | OS::Pnda::cm | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
|
| edge | 7e911922-a4d5-416b-a69f-5ec3871f2677 | OS::Pnda::edge | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
|
| opentsdb | d5c7baf7-0115-4b97-ac6c-2a9ae2a9f8e4 | OS::Heat::ResourceGroup | CREATE_COMPLETE | 2016-04-11T12:50:41Z | cation-pnda_cluster-obz7kxxsnatx
|
| DNSecGroup | fb6e6b38-40d1-4b80-85a1-626969c8dbe7 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| KafkaSecGroup | 958ada28-4e65-47c6-929c-e2b4445313ad | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| OpentsdbSecGroup | 191320d3-3ecf-47e8-8e6b-bb259a282e05 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| ToolsSecGroup | 4141c2fb-ee52-4828-a125-433234f1b14b | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| ZKSecGroup | 332fe76d-4c66-486a-8b8c-6f4550ea8588 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| dn | d7e4d502-4057-4afa-be87-fd27c93323c0 | OS::Heat::ResourceGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| kafka | ca0ed237-3026-44b9-8bb9-7813913f561a | OS::Heat::ResourceGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| manager1 | fa48786c-84c1-42ed-adac-167e850b396b | OS::Pnda::manager1 | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| tools | 436f9371-8430-4937-9580-bd923d9e8f78 | OS::Heat::ResourceGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| zookeeper | f4bd32b0-9df8-40eb-a13f-b8ee3f7c5260 | OS::Heat::ResourceGroup | CREATE_COMPLETE | 2016-04-11T12:50:42Z | cation-pnda_cluster-obz7kxxsnatx
|
| floatingIP | 0c45ee3f-0817-4cd7-852f-c2331cb367e9 | OS::Neutron::FloatingIP | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar |
| install_config | 03f94be1-2673-43eb-ae22-1f90ef71e2f6 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar |
| install_deployment | 8a83fe6a-e494-4460-b9a0-1bd2860be5e0 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar |
| port | ecbb0a84-9da8-4ed4-af52-4d58c97fe029 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar |
| sec_group | 6447961b-b12c-4719-a068-4a8cb4161b3a | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar |
| server | 62b63880-a80a-4142-adc7-6a0e258546c1 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:44Z | cation-pnda_cluster-obz7kxxsnatx-bast
ion-ccdyikzg2gar |
| install_config | 3c54dbfc-5fcc-4b8f-bef4-b443806363f5 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s |
| install_deployment | 3c7e3df2-1520-4eec-84e7-4ef764c95614 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s |
| port | 1628aace-0f3f-4edb-8152-31fb6c098a03 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s |
| sec_group | 510b83e9-bf7c-424e-8dc1-a8dc60bc701a | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s |
| server | feeff5db-e3c6-4035-8654-38bf70f09677 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:45Z | cation-pnda_cluster-obz7kxxsnatx-edge
-pribufdbiz3s |
| install_config | 219ea1b4-730d-4e0a-8928-70de06c0cf20 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q |
| install_deployment | 24d36818-2447-4161-8b22-40e5c9373e2f | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q |
| port | 9992d132-918b-4121-a8d9-d17078bdbbdc | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q |
| sec_group | 01ce3f03-1740-4769-924c-5698206c7714 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q |
| server | 3a71802d-c5f7-40f7-aae2-56ea64b25071 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:46Z | cation-pnda_cluster-obz7kxxsnatx-cm-a
naz62owf25q |
| install_config | b6e42e21-d4eb-4c71-b5be-29ac4bd514d8 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5 |
| install_deployment | 0388f83f-dab8-4398-a812-1fae1d3648c4 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5 |
| port | 51fb1400-7067-4434-9dce-3b714efb0eaa | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5 |
| sec_group | ae76a14a-3f4d-4309-a0b9-3f54ea24072b | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5 |
| server | 8cd4101f-efa3-4fe3-9a2e-8ba55fcd1885 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:49Z | cation-pnda_cluster-obz7kxxsnatx-mana
ger1-pkyrsg6kywg5 |
| 0 | 482f1e2a-ba44-48f3-92d5-3aa7f4e15515 | OS::Pnda::zookeeper | CREATE_COMPLETE | 2016-04-11T12:50:52Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4 |
| 0 | 689e88ca-0ea0-4747-8753-dfbcd25c0bcd | OS::Pnda::opentsdb | CREATE_COMPLETE | 2016-04-11T12:50:52Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz |
| install_deployment | d8016fcb-ee82-43c8-ae63-dbd87bd607cc | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:54Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh |
| port | 3741d558-040e-4899-aa09-0acd55fa5ed1 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:55Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh |
| 0 | 557f23e6-205b-4ad4-8ef3-d489c692ca46 | OS::Pnda::tools | CREATE_COMPLETE | 2016-04-11T12:50:56Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le |
| install_config | 95cca8b6-e463-4383-803e-8c5729714834 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:56Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh |
| server | e8f63fb4-36cd-4e2d-be3b-c4e2e58d2da8 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:56Z | cation-pnda_cluster-obz7kxxsnatx-opentsdb-pdzsym7ukyvz-0-koz6d4y52euh |
| 0 | 52e1a7ed-c7f4-419d-b7d5-6749dcc498a4 | OS::Pnda::dn | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx |
| install_config | dd671a45-fb27-4b76-a10d-807bf87fd7b0 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| install_deployment | 87147bbb-7a4d-46e9-8d27-0a45a0678f84 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| port | 6b55e5d5-6309-4a38-ad58-8fe588ab7f57 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| server | 834e3201-316b-4b77-81c8-6e48af9f6476 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:57Z | cation-pnda_cluster-obz7kxxsnatx-zookeeper-2pqkyjnmt4b4-0-ekw7zjofmcr6 |
| install_config | d1d4046a-6537-411d-9bb1-846243215801 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:50:58Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v |
| install_deployment | e2acf060-ad02-4785-9900-1cf71c365097 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:50:58Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v |
| 0 | 8e0318ed-5b1b-46f7-ae0f-766fb8077a82 | OS::Pnda::kafka | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk |
| port | 7061585f-3b60-41b4-a458-3ad443f59adf | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 |
| port | c2ad7911-67ed-4632-8a9f-2e2238ce2836 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v |
| server | 38fd7a6b-e846-410d-90ba-dd222e5aabd9 | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:50:59Z | cation-pnda_cluster-obz7kxxsnatx-tools-rlnmhbimn7le-0-ww3hsajtgf6v |
| install_config | b678c181-2e12-4d0b-9a8c-1cd85cb78348 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 |
| install_deployment | 6d46cb0b-0066-4b24-bb53-fc3a1b92c2dd | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 |
| server | d4013a0c-8ae5-4bda-a101-2b618471cfdd | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 |
| volume | ccd54e94-ed5d-40de-9e44-7ac0ea68c599 | OS::Cinder::Volume | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 |
| volume_attachment | ccd54e94-ed5d-40de-9e44-7ac0ea68c599 | OS::Cinder::VolumeAttachment | CREATE_COMPLETE | 2016-04-11T12:51:00Z | cation-pnda_cluster-obz7kxxsnatx-dn-c47jwj3v4idx-0-yykdys4kctd6 |
| install_config | f35da354-b6af-47c2-b242-10e0cda7f697 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb |
| install_deployment | 2f62cb64-19c7-4cb5-ac9e-57d1f57f520e | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb |
| port | 11b75015-7178-4830-a1a4-dbab9a360562 | OS::Neutron::Port | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb |
| server | c420c207-ae8e-47de-b81d-c3551ce3254e | OS::Nova::Server | CREATE_COMPLETE | 2016-04-11T12:51:01Z | cation-pnda_cluster-obz7kxxsnatx-kafka-cz7budcvxmvk-0-r2e7tx2lmlkb |
+----------------------+-------------------------------------------------------------------------------------+------------------------------+-----------------+----------------------+-------------------------------------------------------------------------+
Examining the provisioned instances :
$ nova list | grep cation
| 61f96b51-264a-4e76-8b2b-d0d287f24be8 | cation-lab-0-bastion | ACTIVE | - | Running | cation-lab-0-net=192.168.10.18, 10.60.18.34 |
| e8091ceb-222f-4d91-b5bf-04943da01558 | cation-lab-0-cdh-cm | ACTIVE | - | Running | cation-lab-0-net=192.168.10.19 |
| 953c4e1e-6671-49ee-aced-838547f71514 | cation-lab-0-cdh-dn-0 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.31 |
| af64183c-e674-4824-8fb0-bcaf193e7ea7 | cation-lab-0-cdh-dn-1 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.35 |
| a802878e-32a9-49fe-9d6a-3b431d6f888c | cation-lab-0-cdh-dn-2 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.36 |
| a6d86587-04ca-4385-8871-faf3fd67061b | cation-lab-0-cdh-edge | ACTIVE | - | Running | cation-lab-0-net=192.168.10.24 |
| 22c6fcd0-ebfe-4bd9-ae48-401f6a83dcbb | cation-lab-0-cdh-jupyter | ACTIVE | - | Running | cation-lab-0-net=192.168.10.20 |
| 35987268-b218-4f46-9fa1-6a81ea7a982a | cation-lab-0-cdh-mgr1 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.17 |
| 7c9f25d8-ee58-4d43-9177-d0a40e19b6c6 | cation-lab-0-cdh-mgr2 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.16 |
| a7411e57-34b0-4d87-ad62-1d1b471cfe5e | cation-lab-0-cdh-mgr3 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.14 |
| eebf2ac7-d25e-49db-8b70-78c3b7c49774 | cation-lab-0-cdh-mgr4 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.15 |
| fcb087ab-789f-4a13-891a-71ac70fc2b3f | cation-lab-0-collector | ACTIVE | - | Running | cation-lab-0-net=192.168.10.38, 10.60.18.57 |
| e7941b24-dec3-405c-b61d-cbedd315b0c8 | cation-lab-0-kafka-0 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.25 |
| b3ba4c44-939d-4fc4-bc88-c2657ffafc52 | cation-lab-0-kafka-1 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.23 |
| 9854cc56-780f-49d8-bd11-1e2086ab886a | cation-lab-0-logserver | ACTIVE | - | Running | cation-lab-0-net=192.168.10.22 |
| 4aca9943-b5f1-4599-8fdb-0f9f4b4df3c4 | cation-lab-0-opentsdb-0 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.37 |
| 95a21ded-71ab-4576-9850-3ab0ac82938d | cation-lab-0-saltmaster | ACTIVE | - | Running | cation-lab-0-net=192.168.10.13 |
| aa4c214d-1d9a-423e-b8e4-43bcaec2fa5c | cation-lab-0-tools-0 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.28 |
| 49090d85-3d2b-4135-b1e7-f28c00b982fd | cation-lab-0-zookeeper-0 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.32 |
| bf1cbadb-5910-45ec-8aaf-918f2b7f4231 | cation-lab-0-zookeeper-1 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.29 |
| cae2fd4d-6d81-4c29-b75f-b15510329a7c | cation-lab-0-zookeeper-2 | ACTIVE | - | Running | cation-lab-0-net=192.168.10.26 |
The only instance reachable from outside the deployment is the bastion instance. It can be sshed:
$ ssh -i <your_private_key file> [email protected]
From the bastion instance you can then ssh to the other instances using the dynamically created private key whose file sits in the cloud-user home directory.
cloud-user@cation-bastion:~$ ls -l
total 4
-rw------- 1 cloud-user cloud-user 1675 Apr 11 12:51 cation-pnda_cluster-obz7kxxsnatx-bastion-ccdyikzg2gar.pem
ssh to the saltmaster instance:
cloud-user@cation-bastion:~$ ssh -i cation-pnda_cluster-obz7kxxsnatx-bastion-ccdyikzg2gar.pem salt
The authenticity of host 'salt (10.10.10.13)' can't be established.
ECDSA key fingerprint is 67:f4:3d:79:7e:a1:7f:94:59:6e:83:ba:2d:bd:23:1c.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'salt,10.10.10.13' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 3.13.0-83-generic x86_64)
[...]
cloud-user@cation-saltmaster:~$
Some interesting links:
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent