Installing hadoop development cluster on Wind...

来源:百度文库 编辑:神马文学网 时间:2024/04/28 03:54:31
Hadoop on Windows with Eclipse

IntroductionPrerequistesSet Environment VariablesSetup SSH daemonDownload hadoop and place it in the home directory.Unpack hadoopConfigure HadoopFormat the namenodeSetup hadoop pluginStart the clusterSetup hadoop locationUpload dataCreate and run a test project.

Introduction
Hadoop is a powerful framework that allows for automatic parallelezation of computing task. Unfortunately programming for it poses certain challenges, namely it is really hard to understand and debug Hadoop programs. One way to easy things a little bit is to have a simplified version of the hadoop cluster that could run locally on the developer's machine. This tutorial describes how to set-up such cluster on the computer running Microsoft Windows, also it describes how to integrate this cluster with theEclipse development environment. Eclipse is a prime environment forJava development.
How this tutorial is organized.
Since hadoop is very complex environment I broke this tutorial down into several smaller steps. Each step involves setting up some aspect of the system and ways to verify that these actions were executed correctly. For the purposes of better understanding each tutorial is accompanied by the screenshots and a recorded video of the steps.
Questions, Suggestions Comments
You can leave questions, suggestions and commends about this tutorialhere
Continue

If you have questions comments suggestions regarding this tutorial youcan post them here or you can write me an email to tutorials AT v-lad.org.
2008 - Vlad Korolev