What I See

Python API for cloudera is really nice, apart from getting the cluster setup, we can also do configuration and automation. We use a lot of automation using Chef/Ansible, but cloudera API give more control over the cluster. One of the awesome features of cloudera API is to setup kerberos for the cluster, which otherwise done manually (command line) is very tricky task (loads of this to go wrong). For our kerberos setup we will need to complete below steps. Cloudera Manager Configuration. Stop Cluster. Stop Cloudera Manager service. Service configuration for all the services which needs updates like HDFS , HBASE , KAFKA , ZOOKEEPER , HUE . Creating KT_RENEWER for HUE service. Start Cloudera Manager Services. Start Cluster. Steps To kerberize Cloudera Cluster Step 1: Configure cloudera with LDAP information. # # Deploy LDAP configuration for CM # self.deploy_cm_ldap_configuration() Step 2: Import Admin credentials, using the username / password, which h...

Data Bags are a way to store information on the chef-server which all the cookbooks can access. Few more additional advantages are that we can encrypt the data-bags as well, this will help in keeping any sensitive information like user/password. What we are doing now is to store user information in a data-bag and use them to create users on the servers. We will be using users cookbook to create the users. users cookbook details. https://github.com/chef-cookbooks/users https://supermarket.chef.io/cookbooks/users Steps. Create a secret file. Create json user files. Create data-bag on the chef-server . Add the local user .json file to data-bag with the secret file created. Creating secret file. We will be using the openssl to create a random file. user secret. openssl rand -base64 512 > ~ /work/chef -repo/cookbooks/init-setup/secret-files/user_data_bags_encrypted_secret Here is how the file would look like. ┌─[ahmed][zubair-HP-ProBook][~] └─▪ o...