Integrating NODEJS and Kafka

---

Table of Contents

1. Integrating NODEJS and Kafka
2. Installing KAFKA Single Node - Quick Start.
   • Download and Extract
   • Now we are ready to start all the services required.
   • Next we start server.
   • Creating Topics
   • Send some message
   • Start a Consumer
3. Installing NodeJS on Centos 6.6.
   • Installing nodejs and npm on centos is very simple.
   • Installing gcc-c++ and make.
   • Later on we will need kafka-node lets install that as well.
   • Lets do a test.
   • Lets make some simple changes to exsisting script to handle JSON.
   • NodeJS Kafka Producer - Using kafka-node
     • Step 1 - Copy the below script in a file called producer_nodejs.js.
     • Step 2 - Start the kafka cluster as we already did in Installation of Kafka. Assuming topic as test
     • Step 3 - Start the consumer service as in the below command.
     • Step 4 - Execute below command. This will send This is the First Message I am sending Message to the Kafka consumer.
     • Step 5 - Check on the consumer you will see the message sent from nodejs.
   • Sending JSON to NodeJS to Kafka.
     • Step 1 - Create a script called json_nodejs_kafka.js with below script.
     • Step 2 - Start above script on the nodejs server.
     • Step 3 - Execute curl command to send the JSON to nodejs.
     • Step 4 - Output on nodejs console
     • Step 5 - Output on the kafka consumer side.
     • Useful Links.

---

Complete information about integrating and Installing Kafka/NodeJS on Centos. This is just a combination of multiple post in the blog. 

http://whatizee.blogspot.com/2015/02/installing-kafka-single-node-quick-start.html
http://whatizee.blogspot.com/2015/02/installing-nodejs-on-centos-66.html
http://whatizee.blogspot.com/2015/02/nodejs-kafka-producer-using-kafka-node.html
http://whatizee.blogspot.com/2015/02/sending-json-nodejs-kafka.html
http://whatizee.blogspot.com/2015/02/sending-json-to-nodejs-to-multiple.html