What is HDInsight?
It is available in two mode:
In this article we will see how to use HDInsight on local machine.
Where to get it?
What does Windows installer brings to your machine:
After the installation is completed you will see the following applications are installed:
By default the Hadoop is installed at C:Hadoop as below:
Once installer is completed you will see the following shortcuts are setup in your machine:
Here is the list of shortcuts:
If you launch the “Hadoop command Line” you will see the list of commands as below:
|· namenode -format format the DFS filesystem
· secondarynamenode run the DFS secondary namenode
· namenode run the DFS namenode
· datanode run a DFS datanode
· dfsadmin run a DFS admin client
· mradmin run a Map-Reduce admin client
· fsck run a DFS filesystem checking utility
· fs run a generic filesystem user client
· balancer run a cluster balancing utility
· fetchdt fetch a delegation token from the NameNode
· jobtracker run the MapReduce job Tracker node
· pipes run a Pipes job
· tasktracker run a MapReduce task Tracker node
· historyserver run job history servers as a standalone daemon
· job manipulate MapReduce jobs
· queue get information regarding JobQueues
· version print the version
· jar <jar> run a jar file
· distcp <srcurl> <desturl> copy file or directories recursively
· archive -archiveName NAME <src>* <dest> create a hadoop archive
· daemonlog get/set the log level for each daemon
· CLASSNAME run the class named CLASSNAME
Most commands print help when invoked w/o parameters.
Try checking the Version as below:
Subversion on branch -r
Compiled by jenkins on Wed Oct 17 22:28:56 PDT 2012
From source with checksum 80f5614dfb0743b569344f051a07b37d
Now if you Launch “Microsoft HDInsight Dashboard” shortcut you will see the dashboard running locally as below:
Launching “Hadoop MapReduce Status” shortcut will give you the following info:
And Launching “Hadoop Name Node Status” shortcut you will see the following:
So as you can see above, you do have Hadoop Cluster running on your local machine.
Play with it a little more and my next article is coming with more info on this regard.
Have fun with Hadoop!!