hadoop的eclipse插件编译图文教程

Hadoop的eclipse插件编译的图文教程一、下载hadoop的源码压缩包网上有很多源码的下载地址，随便找个下载。我学习时使用的版本为hadoop-1.2.1,我的下载地址为：下载后加压缩到本地目录，我的目录为：D:\学习资料\hadoop\hadoop-1.2.1\hadoop-1.2.1\二、eclipse文件准备我查看了网上的很多资料，有用ant直接编译的，我不太会用，直接用eclipse，我的eclipse版本为：Version:LunaServiceRelease2(4.4.2)1、打开eclipse，右键选择导入项目，如下图12、选择已存在的工程导入项目，如图23、选择解压的hadoop源码的目录build\contrib下面的eclipse-plugin，我的目录为：D:\学习资料\hadoop\hadoop-1.2.1\hadoop-1.2.1\build\contrib，如下图：4、导入后，项目名称默认为MapReduceTools，在项目根目录下新建lib目录，将hadoop源码的根目录下的hadoop-core.1.2.1.jar文件复制到lib包内，重名名为：hadoop-core.jar，完成后的项目结构如下图：5、将目录：src\contrib下面的build-contrib.xml拷贝到跟目录下面，我的目录为：D:\学习资料\hadoop\hadoop-1.2.1\hadoop-1.2.1\src\contrib，完整的项目结构为：三、eclipse文件修改1、首先在eclipse中修改build.xml，一步步来：1、修改build-contrib.xml的文件路径，改为：2、配置hadoop源码路径、eclipse安装路径、hadoop版本，即添加代码propertyname=hadoop.rootlocation=D:\学习资料\hadoop\hadoop-1.2.1\hadoop-1.2.1/propertyname=eclipse.homelocation=D:\安装文件\开发工具\eclipse-java-luna-SR2-win32-x86_64\eclipse/propertyname=versionvalue=1.2.1/3、定义hadoopjar的位置，添加代码pathid=hadoop-jarsfilesetdir=${hadoop.root}/includename=hadoop-*.jar//fileset/path4、修改pathid=”classpath”,增加pathid=”hadoop-jars”pathid=classpathpathelementlocation=${build.classes}/pathelementlocation=${hadoop.root}/build/classes/pathrefid=eclipse-sdk-jars/pathrefid=hadoop-jars//path5、修改targetname=”jar”，添加需要copy的jar包文件路径，删除或者注释原有两行的copy，添加必要的jar包文件路径，为的代码如下：!--Overridejartargettospecifymanifest--targetname=jardepends=compileunless=skip.contribmkdirdir=${build.dir}/lib/!--copyfile=${hadoop.root}/build/hadoop-core-${version}.jartofile=${build.dir}/lib/hadoop-core.jarverbose=true/copyfile=${hadoop.root}/build/ivy/lib/hadoop/common/commons-cli-${commons-cli.version}.jartodir=${build.dir}/libverbose=true/--copyfile=${hadoop.root}/hadoop-core-1.2.1.jartofile=${build.dir}/lib/hadoop-core.jarverbose=true/copyfile=${hadoop.root}/lib/commons-cli-1.2.jartodir=${build.dir}/libverbose=true/copyfile=${hadoop.root}/lib/commons-lang-2.4.jartodir=${build.dir}/libverbose=true/copyfile=${hadoop.root}/lib/commons-configuration-1.6.jartodir=${build.dir}/libverbose=true/copyfile=${hadoop.root}/lib/jackson-mapper-asl-1.8.8.jartodir=${build.dir}/libverbose=true/copyfile=${hadoop.root}/lib/jackson-core-asl-1.8.8.jartodir=${build.dir}/libverbose=true/copyfile=${hadoop.root}/lib/commons-httpclient-3.0.1.jartodir=${build.dir}/libverbose=true/jarjarfile=${build.dir}/hadoop-${name}-${version}.jarmanifest=${root}/META-INF/MANIFEST.MFfilesetdir=${build.dir}includes=classes/lib//filesetdir=${root}includes=resources/plugin.xml//jar/target6、为了防止编译时出现includeAntRuntime警告，在javac中添加如下代码：includeAntRuntime=false，我的代码如下：targetname=compiledepends=init,ivy-retrieve-commonunless=skip.contribechomessage=contrib:${name}/javacencoding=${build.encoding}srcdir=${src.dir}includes=**/*.javadestdir=${build.classes}debug=${javac.debug}includeAntRuntime=falsedeprecation=${javac.deprecation}classpathrefid=classpath//javac/target2、修改META-INF/MANIFEST.MF文件在Bundle-ClassPath:处添加必要的jar包，为的代码为：Bundle-ClassPath:classes/,lib/hadoop-core.jar,lib/jackson-core-asl-1.8.8.jar,lib/jackson-mapper-asl-1.8.8.jar,lib/commons-configuration-1.6.jar,lib/commons-lang-2.4.jar,lib/commons-,lib/commons-cli-1.2.jar三、eclipse编译插件选中build.xml文件，右键点击,选择”Runas”-”AntBuild”。在编译成功后，hadoop的eclipse插件存在路径hadoop的源码目录build\contrib\eclipse-plugin下面，我的路径为：D:\学习资料\hadoop\hadoop-1.2.1\hadoop-1.2.1\build\contrib\eclipse-plugin，如下图至此，hadoop的eclipse插件编译完成。