1、借助eclipse
在eclipse下面搭建hadoop开发环境的相关问题及其解决详见http://blog.csdn.net/bhq2010/article/details/7267747
有一个问题是：好像通过eclipse提交的程序并没有在集群上执行，而是在本机上执行了。
2、在命令下运行
首先需要将程序打成jar包，我用的eclipse写程序，也就用eclipse打包了，如果工程中包含第三方的jar包，可以用一个插件
将第三方的jar包一起打出来，下载地址：
http://sourceforge.net/projects/fjep/
手动打入第三方jar包参考：http://www.cnblogs.com/biGpython/archive/2011/11/09/2242396.html
用scp命令将打好的jar包以及输入文件上传到主节点。
用hadoop的dfs命令将输入文件上传到hdfs:
$ hadoop dfs -copyFromLocal localFilePath hdfsPath
用hadoop的jar命令运行任务：
$ hadoop jar ***.jar ***.***.***.MainClassName inputPath outputPath
其中指定主类时，需要把其包路径也指出来
分享到：
相关推荐
赠送jar包：hadoop-mapreduce-client-common-2.6.5.jar； 赠送原API文档：hadoop-mapreduce-client-common-2.6.5-javadoc.jar； 赠送源代码：hadoop-mapreduce-client-common-2.6.5-sources.jar； 赠送Maven依赖信息...
赠送jar包：hadoop-mapreduce-client-core-2.5.1.jar； 赠送原API文档：hadoop-mapreduce-client-core-2.5.1-javadoc.jar； 赠送源代码：hadoop-mapreduce-client-core-2.5.1-sources.jar； 赠送Maven依赖信息文件：...
hadoop-annotations-3.1.1.jar hadoop-common-3.1.1.jar hadoop-mapreduce-client-core-3.1.1.jar hadoop-yarn-api-3.1.1.jar hadoop-auth-3.1.1.jar hadoop-hdfs-3.1.1.jar hadoop-mapreduce-client-hs-3.1.1.jar ...
赠送jar包：hadoop-mapreduce-client-jobclient-2.6.5.jar； 赠送原API文档：hadoop-mapreduce-client-jobclient-2.6.5-javadoc.jar； 赠送源代码：hadoop-mapreduce-client-jobclient-2.6.5-sources.jar； 赠送...
Eclipse集成Hadoop2.10.0的插件,使用`ant`对hadoop的jar包进行打包并适应Eclipse加载,所以参数里有hadoop和eclipse的目录. 必须注意对于不同的hadoop版本,` HADDOP_INSTALL_PATH/share/hadoop/common/lib`下的jar包...
赠送jar包：hadoop-yarn-common-2.6.5.jar 赠送原API文档：hadoop-yarn-common-2.6.5-javadoc.jar 赠送源代码：hadoop-yarn-common-2.6.5-sources.jar 包含翻译后的API文档：hadoop-yarn-common-2.6.5-javadoc-...
hadoop-eclipse-plugin-2.7.0.jar ,用于在eclipse上进行hadopp程序调试
赠送jar包：hadoop-yarn-server-resourcemanager-2.6.0.jar； 赠送原API文档：hadoop-yarn-server-resourcemanager-2.6.0-javadoc.jar； 赠送源代码：hadoop-yarn-server-resourcemanager-2.6.0-sources.jar； 赠送...
Flink-1.11.2与Hadoop3集成JAR包，放到flink安装包的lib目录下，可以避免Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Hadoop is not in the classpath/dependencies.这个报错，实现...
# 解压命令 tar -zxvf flink-shaded-hadoop-2-uber-3.0.0-cdh6.2.0-7.0.jar.tar.gz # 介绍 用于CDH部署 Flink所依赖的jar包
包含hadoop平台Java开发的所有所需jar包，例如activation-1.1.jar apacheds-i18n-2.0.0-M15.jar apacheds-kerberos-codec-2.0.0-M15.jar api-asn1-api-1.0.0-M20.jar api-util-1.0.0-M20.jar asm-3.2.jar avro-1.7.7...
赠送jar包：hadoop-yarn-client-2.6.5.jar； 赠送原API文档：hadoop-yarn-client-2.6.5-javadoc.jar； 赠送源代码：hadoop-yarn-client-2.6.5-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-client-2.6.5.pom；...
赠送jar包：hadoop-hdfs-2.6.5.jar； 赠送原API文档：hadoop-hdfs-2.6.5-javadoc.jar； 赠送源代码：hadoop-hdfs-2.6.5-sources.jar； 赠送Maven依赖信息文件：hadoop-hdfs-2.6.5.pom； 包含翻译后的API文档：hadoop...
赠送jar包：hadoop-hdfs-client-2.9.1.jar 赠送原API文档：hadoop-hdfs-client-2.9.1-javadoc.jar 赠送源代码：hadoop-hdfs-client-2.9.1-sources.jar 包含翻译后的API文档：hadoop-hdfs-client-2.9.1-javadoc-...
export CLASSPATH="$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:${HADOOP_HOME}/lib/commons-logging-1.0.4.jar:${HADOOP_HOME}/lib/guava-r09-jarjar.jar:${HADOOP_HOME}/hadoop-core-0.20.2-cdh3u3.jar:/usr/...
hadoop-mapreduce-examples-2.7.1.jar
赠送jar包：hadoop-mapreduce-client-jobclient-2.6.5.jar； 赠送原API文档：hadoop-mapreduce-client-jobclient-2.6.5-javadoc.jar； 赠送源代码：hadoop-mapreduce-client-jobclient-2.6.5-sources.jar； 赠送...
赠送jar包：hadoop-auth-2.5.1.jar； 赠送原API文档：hadoop-auth-2.5.1-javadoc.jar； 赠送源代码：hadoop-auth-2.5.1-sources.jar； 赠送Maven依赖信息文件：hadoop-auth-2.5.1.pom； 包含翻译后的API文档：hadoop...
赠送jar包：hadoop-mapreduce-client-app-2.6.5.jar； 赠送原API文档：hadoop-mapreduce-client-app-2.6.5-javadoc.jar； 赠送源代码：hadoop-mapreduce-client-app-2.6.5-sources.jar； 赠送Maven依赖信息文件：...
赠送jar包：hadoop-yarn-api-2.5.1.jar； 赠送原API文档：hadoop-yarn-api-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-api-2.5.1-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-api-2.5.1.pom； 包含翻译后...