Skip to main content

Posts

Showing posts from 2012

FTP Client Using Apache Common net library using Socks Proxy Server

As we have the FTP Server code in previous post, here is a FTP Client using Apache Commons library .  Below is a basic code which we can use to connect to our FTP server which we created over a S OCKS Proxy Server. (Assuming you have a SOCKS proxy server running already – if not then code can be used just as a FTP Client to connect directly to FTP Server). Below Image shows, libraries required and parameter passed from the build.xml (this can be done over the command line as well) Below Image shows changes required to Route all Packets to go through Proxy Server Libraries Required. <path id="FtpClientDemo.classpath">         <pathelement location="bin"/>         <pathelement location="lib/commons-net-3.1-ftp.jar"/>         <pathelement location="lib/commons-net-3.1.jar"/>     </path> Sample Arg in Build.xml File <target name="FtpClientDemo">     <java classname="com.ftp.client.

FTP Server using Apache FTPServer Library

Was working on getting a FTP Server. Creating a FTP server using Apache Library is very simple. As you can see in the image you will need some libs, and all the libraries can be found here : http://mina.apache.org/ftpserver/apache-ftpserver-106-release.html Below is the code to get started. You will also get all the properties file from the above link. Content for log4j.properties. log4j.rootLogger=DEBUG, C log4j.appender.C=org.apache.log4j.ConsoleAppender log4j.appender.C.layout=org.apache.log4j.PatternLayout log4j.appender.C.layout.ConversionPattern=[%5p] %d [%X{userName}] [%X{remoteIp}] %m%n Content for users.properties. # Password is "admin" ftpserver.user.admin.userpassword=21232F297A57A5A743894A0E4A801FC3 ftpserver.user.admin.homedirectory=f\:/ ftpserver.user.admin.enableflag=true ftpserver.user.admin.writepermission=true ftpserver.user.admin.maxloginnumber=0 ftpserver.user.admin.maxloginperip=0 ftpserver.user.admin.idletime=0 ftpserver.us

Getting Data from RestFB and Creating Sequence File > Hadoop

Here is a quick code to get data from Facebook using RestFB API and create Sequence file and dump you data into Hadoop Cluster. Requirement: Hadoop 1.0.3 Installed as Stand Alone or Multinode.  Eclipse IDE for development  Hadoop and Apache commons jars.  RestFB APIs  Steps to Create Eclipse Project. New Java Project.  Add the jar to the project. (Apache Commons and hadoop-core.1.0.3.jar) and add RestFB jar.  You will find all (commons and hadoop) jars under hadoop directory.  Sequence File Content Format. Key – <facebook_id, facebook_name, timestamp>  Value – <batch_me, batch_me_friends, batch_me_likes> Add the below code to get DATA from Facebook and generate Sequence File. Before you start you need to updated the AccessToken in the code with yours Access Token from Facebook. Take look here before you proceed.

Getting Batch Data from Facebook using restFB APIs

Here is quick sample code to get data from Facebook Batch API. Download the jar from here - http://code.google.com/p/restfb/downloads/detail?name=restfb-1.6.9.zip And put it in your library path and execute the below code. Go to this link and login to facebook to get your access token : https://developers.facebook.com/tools/explorer Change the code to pass your “AccessToken” directly to “ DefaultFacebookClient facebookClient = new DefaultFacebookClient("<<<ACCESSTOKEN HERE>>>"); “   import static java.lang.String.format; import static java.lang.System.currentTimeMillis; import static java.lang.System.out; import java.util.ArrayList; import java.util.Arrays; import java.util.Date; import java.util.HashMap; import java.util.List; import java.util.Map; import com.restfb.Connection; import com.restfb.DefaultFacebookClient; import com.restfb.DefaultJsonMapper; import com.restfb.Facebook; import com.restfb.FacebookClient; import com.restfb.JsonMapper; im

Installing Hadoop 1.0.3 on Ubuntu Single Node Cluster using shell script

I was working on setting up Hadoop on Ubuntu as a Single node cluster. I came across a very nice blog about it here . (Must read to setup your single node cluster). While I was at it, I was creating / Installing Hadoop multiple time in different system, then I though to create a script of my own, based on the blog above. Here is the link to my script which is on GITHUB anyone interested can check-out and enhance the script. https://github.com/zubayr/hadoopscript/blob/master/initScriptHadoop.sh README : https://github.com/zubayr/hadoopscript/blob/master/README.txt Requirement. 1. Hadoop 1.0.3 2. Ubuntu 10.04  or above (Tested on 11.04, 11.10 and 12.04 32bit platform) Here is the details on how to install Hadoop using the script Please Readme - hadoop script to setup Single Node Cluster - For Hadoop 1.0.3 Only. - Tested on Ubuntu 11.10, 12.04 - Fresh Install. - Scripts assumes nothing is installed for Hadoop and installs Required Components for Hadoop to run. - This Script was c

Configure Master / Slave Replication MySQL XAMPP

Mysql Master Server Configuration First Lets go to Replication panel on XAMPP.

Mobiles in INDIA - Google Trends and Google Public Data

I was looking into the Mobile Trends in INDIA.  There are as many as 650 million Mobile user in India.  We are adding 9 million(approx) new users every month.  Below is a look at how INDIA Mobile market fairs according to Google Trends and Google Public Data. First Lets start at looking in to Mobile Phones in India. Below are the details I got from my friend. GSM SUBSCRIBER FIGURES FEBRUARY-2012 Total number of GSM Subs  as of February 2012 - 656.86 million Total number of GSM Subs  additions in February 2012 -   8.77 million with 1.35% increase from previous month Maximum GSM Subs addition in the month of February by - Idea - 2.58 million Maximum GSM Subs addition in the month of February in - Maharashtra - 1,002,729 i.e 11.42% of the total Subscriber additions in February Maximum GSM Subs  - Airtel - 178.78 Million Lets Look into Google Public Data to see How INDIA has faired in the last few years against China. US has reached its Saturation Point now as m

NFCs and GeoFencing

Well I was looking into Potential NFC Benefits or use cases which we can use it for. Few of the first primary target is the Financial Sector. Most of the usecase are about Mobile Money. (like the Google Wallet). First I was very much interested/excited in the Mobile Money kind proposition, slowly came to realization that it has too many overheads. You need to sync up with a BANK, then Involve Retailers, etc etc too much of hassle if you take the INDIAN Market. Here are few things which I think can be used other than Financial Sector. - NFC card for getting into your hotel room.  - NFC enabled Phone as your car keys.  - your business card. - your public transportation. - concert, sports or other event tickets. - your boarding pass for getting on a plane.  - coupons and Many more. Then I came across an article, quite interesting. http://www.techcentral.co.za/sa-banks-nfc-trials-farcical/28336/ " Well-known entrepreneur and investor and former Google SA

Installing OpneNMS on CentOS - using RPM.

As from my previous post. This again is for the IT Team. Was helping them setup and network Monitoring tool. Here are the step to follow to install OpenNMS. Step 1: configure the OpenNMS Repository RPM ]# yum install yum-fastestmirror ]# rpm -Uvh http://yum.opennms.org/repofiles/opennms-repo-stable-rhel5.noarch.rpm Step 2: Install the Prerequisite Package: Java To install java you would download “ jdk-7u3-linux-x64.rpm “from http://www.oracle.com/technetwork/java/javase/downloads/jdk-7u3-download-1501626.html   and place it in your current working directory then run bellow command ]$ sudo rpm -ivh jdk-7u3-linux-x64.rpm Step 2: Install the Prerequisite Package: PostgreSQL To install PostgreSQL follow bellow commands ]$ sudo yum -y install postgresql-server (OR use the installer from http://www.enterprisedb.com/products-services-training/pgdownload ) ]# /etc/init.d/postgresql start ]# /sbin/chkconfig postgresql on Configure Po

Installation OTRS 3.1 on CentOS 6.2 Running PostGreSQL 9.1

I was working on getting and Ops tools for our IT Department, I had heard a lot about OTRS, so though to try it out. I have installed OTRS in CentOS 6.2 Running PostGreSQL 9.1 Below are the steps to get it up and running. Lets Start then. System Information: [ahmed@localhost ~]$ uname -a Linux localhost.localdomain 2.6.32-220.7.1.el6.x86_64 #1 SMP Wed Mar 7 00:52:02 GMT 2012 x86_64 x86_64 x86_64 GNU/Linux [ahmed@localhost ~]$ cat /etc/redhat-release CentOS release 6.2 (Final) Lets start by updating system (Optional) [ahmed@localhost Downloads]$ sudo yum update [ahmed@localhost Downloads]$ sudo yum update yum Installing httpd [ahmed@localhost Downloads]$ sudo yum install httpd (Below command Optional - if already exsists) [ahmed@localhost Downloads]$ sudo yum update httpd Now lets Install PostgreSQL - Downloaded this from the below link. http://www.enterprisedb.com/products-services-training/pgdownload [ahmed@localhost Downloads]$ ls OpenNMS-1.2.

SVN Incremental and Full Backup - with Email Notification

To start of with lets do a Incremental back up for every commit and then lets look in to taking a full back for all our repositories. (Files Attached Below) Incremental Backup. SVN Incremental for every commit can be done using post-commit hook this file is in REPOS_DIR/hooks/post-commit. tmpl you can copy it as post-commit and change permissions. $ cp post-commit.tmpl post-commit $ chmod 755 post-commit NOTE Important links: For rsync refer this link For mutt configuration refer this link. For Running Crontab. To Know about SVN backups you can go here. Here is the information which needs to be in post-commit hook in SVN. # # PreDefined Information # REPOS="$1" REV="$2" # # Change below parameters as Required. # LOCAL_BACKUP_PATH=/home/ahmed/ SVNREPOS_TEST/test_backup_ incremental REMOTE_BACKUP_PATH=/home/ ahmed/SVNREPOS_TEST/test_ backup_full LOCAL_MOUNT_BACKUP_PATH=/home/ ahmed/SVNREPOS_TEST/test_ backup_full REMOTE_USER="backup_t