Ansible Playbook - Setup Storm Cluster.
This is a simple Storm Cluster Setup. We are using a dedicated Zookeeper Cluster/Node, instead of the standalone zkserver. Below is how we will deploy our cluster.
/ ---- supervisor01
Nimbus[nimbus and ui]-----
\ ---- supervisor02
Before we start.
Download
apache-storm-0.9.4.tar.gz
to file_archives
directory.
Download
zookeeper-3.4.5-cdh5.1.2.tar.gz
to file_archives
directory.
Download
jdk-7u75-linux-x64.tar.gz
to file_archives
directory.Get the script from Github.
Below is the command to clone.
ahmed@ahmed-server ~]$ git clone https://github.com/zubayr/ansible_storm_tarball
Step 1: Update Hosts File.
Update the host file to reflect your server IPs. Currently
hosts
file looks as below.[zookeepernodes]
10.10.18.11 zookeeper_id=1
10.10.18.12 zookeeper_id=2
10.10.18.13 zookeeper_id=3
#
# storm cluster
#
[stormnimbusnodes]
10.10.18.11
[stormsupervisornodes]
10.10.18.12
10.10.18.13
[stormcluster:children]
stormnimbusnodes
stormsupervisornodes
group_vars
information as required.
Step 2: Update
Update users/password and Directory information in
group_vars/all
file. Currently we have the below information.# --------------------------------------
# USERs
# --------------------------------------
zookeeper_user: zkadmin
zookeeper_group: zkadmin
zookeeper_password: $6$rounds=40000$1qjG/hovLZOkcerH$CK4Or3w8rR3KabccowciZZUeD.nIwR/VINUa2uPsmGK/2xnmOt80TjDwbof9rNvnYY6icCkdAR2qrFquirBtT1
storm_user: stormadmin
storm_group: stormadmin
storm_password: $6$rounds=40000$1qjG/hovLZOkcerH$CK4Or3w8rR3KabccowciZZUeD.nIwR/VINUa2uPsmGK/2xnmOt80TjDwbof9rNvnYY6icCkdAR2qrFquirBtT1
# --------------------------------------
# STORM Variables
# --------------------------------------
storm_local_dir: /data/ansible/storm
storm_log_dir: /data/ansible/storm_logging
# --------------------------------------
# COMMON FOR INSTALL PATH
# --------------------------------------
# Common Location information.
common:
install_base_path: /usr/local
soft_link_base_path: /opt
default
information in default/main.yml
.
Step 3: Update
Update the
default
values if required.Step 4: Executing.
Below is the command.
ahmed@ahmed-server ansible_kafka_tarball]$ ansible-playbook ansible_storm.yml -i hosts --ask-pass
Comments
Post a Comment