Skip to main content

Posts

Showing posts from February, 2015

Upgrade CPU/RAM in KVM.

Upgrade CPU/RAM in KVM. You can follow the following steps to increase memory size of your KVM virtual machine. Update the configuration using command sudo virsh edit reboot VM server. Listing virtual servers. [ahmed@ahmed-server ~]$ sudo virsh list Id Name State ---------------------------------------------------- 8 VM-1 running 12 VM-2 running 13 VM-3 running 15 VM-4 running Getting Information about VM . [ahmed@ahmed-server ~]$ sudo virsh dominfo VM-1 Id: 8 Name: VM-1 UUID: 588ff640-25be-9b18-5eb3-f93c471848e6 OS Type: hvm State: running CPU(s): 4 CPU time: 503.3s Max memory: 8388608 KiB Used memory: 8388608 KiB Persistent: yes Autostart: disable Managed save: no Security model: none Security DOI: 0 Edit Hardwar

KVM Installation on CentOS 6.x.

KVM Installation on CentOS 6.x. Table of Contents Preliminary Check - Check Hardware Virtualization Support. Disable SELinux. Install KVM, QEMU and RPMs/packages. Install KVM, QEMU and user-space tools. Start libvirtd daemon, and set it to auto-start. Check if KVM has successfully been installed. Also we can do a  group install  (Optional) Configure Linux Bridge for VM Networking. Install  bridge-utils . Disable Network Manager. Create  bridge . Install VirtManager. To install VirtManager. Launch VirtManager Remotely. Create  wrapper  for  virt-manager . Installing vnc-server. Initial Installation. Adding VNC user and setting  vncpasswd . Logging in from Remote machine. Screenshot. Troubleshooting KVM and VirtManager setup. Upgrade CPU/RAM in KVM. Listing  virtual  servers. Getting Information about  VM . Edit Hardware for each  VM . Checking  VM  information. Interface Changes. Useful Links. KVM  is a  kernel-based Virutal Machine  which

Integrating NODEJS and Kafka

Integrating NODEJS and Kafka Table of Contents Integrating NODEJS and Kafka Installing KAFKA Single Node - Quick Start. Download and Extract Now we are ready to start all the services required. Next we start server. Creating Topics Send some message Start a Consumer Installing NodeJS on Centos 6.6. Installing  nodejs  and  npm  on centos is very simple. Installing  gcc-c++  and  make . Later on we will need  kafka-node  lets install that as well. Lets do a test. Lets make some simple changes to exsisting script to handle JSON. NodeJS Kafka Producer - Using  kafka-node Step 1 - Copy the below script in a file called  producer_nodejs.js . Step 2 - Start the  kafka  cluster as we already did in  Installation of Kafka . Assuming topic as  test Step 3 - Start the consumer service as in the below command. Step 4 - Execute below command. This will send  This is the First Message I am sending  Message to the Kafka consumer. Step 5 - Check on the consumer you will se

Tuning HBase/Hadoop - Work In Progress.

Performance Tuning HBase / Hadoop. Table of Contents Server Hardware Details. Hadoop YARN Architecture. Step By Step - YARN Workflow. Diagram HBASE  JAVA_OPTS  configuration. Details of Options used in  hbase . The following are the recommended Java GC and HBase heap settings. How it works. Complete Configuration below Setting  yarn-site.xml  parameters. Hadoop  JAVA_OPTS  Configuration. Hadoop/Hbase  sysctl.conf  parameters. Completed Script below. Run it as  root . Extras - Monitoring JVM More Details on IPv4

HBASE / HADOOP Configuration - Ubuntu 12.04 LTS

Setting up Hadoop Cluster Table of Contents Hardware Configuration. Services Running on each Server. Prerequisites - Before we start. Update All servers with below  /etc/hosts  file. Passwordless Entry from  master  to all  slaves . Setting Up Hadoop Cluster (YARN). Extracting and creating required directories. Setting up HDFS. Setting up YARN. Copy all the configuration to  slaves . Starting Services HDFS. Starting Service YARN. Testing Our Hadoop Cluster. Setting up Zookeeper on  AHMD-HBASE-RS01 , AHMD-HBASE-RS02 , AHMD-HBASE-RS03 Initial setup on all  zookeeper  servers. Assigning  id s to  zookeeper  nodes. Starting up  zookeeper  server Testing  zookeeper Setting up HBase. Extract the archive on all the servers and updating configurations. Copy configuration to all the servers. Starting HBase services. Testing HBase Server.

Not enough physical memory is Available - VMware Workstation 10

VMware Workstation 10 Error: Not enough physical memory is available to power this virtual machine This issues starts after an update. Issue on Windows 8.1 You attempt to start a virtual machine running on Workstation 10 and you get a message that you have no memory available to run the vm. Message : Not enough physical memory is available to power this virtual machine with its configured settings. Solution Shut down all running virtual machines Close VMware Workstation. Open Command prompt in Admin mode. opening config.ini file using nodepad from command prompt . c:\ProgramData\VMware\VMware Workstation> notepad config.ini Open config.ini located at C:\ProgramData\VMware\VMware Workstation Insert this line: vmmon.disableHostParameters = TRUE Save and close file. Reboot Windows. Error Message Useful Links http://ctobob.com/2014/12/04/vmware-workstation-10-error-not-enough-physical-memory-available-power-virtual-machine/ ​

`zabbix-java-gateway` on Centos 6.5

Installing zabbix-java-gateway on Centos 6.5 How does zabbix-java-gateway work? First we configure system which needs to be monitored using the JAVA_OPTS . Next we add a JMX Interface in Zabbix server UI under hosts . zabbix-server will communicate with zabbix-java-gateway which intern communicates to the system/server where we need to get all the JMX data. JMX is set using the JAVA_OPTS . [Zabbix-Server] --(port:10053)--> [zabbix-java-gateway] --(port:12345)--> [JMX enabled server, Example:Tomcat/WebServer] Step 1 : Install zabbix-java-gateway on zabbix-server [ahmed@ahmed-server ~]$ sudo yum install zabbix-java-gateway Step 2 : Configure the host with JMX which needs to be monitored. Setting Tomcat/JMX Options. Add the below lines to setenv.sh and save it under apache-tomcat-7/bin/ So when the start.sh is started then these JMX options will be added to tomcat server. NOTE: To make the monitoring secure use ssl and authentication options.