示例说明

最近更新时间: 2026-03-13 09:03:00

hadoop-MapReduce-examples

kerberos认证
/usr/bin/klist -kt /var/krb5kdc/emr.keytab
/usr/bin/kinit -kt /var/krb5kdc/emr.keytab hadoop/xxx@xxxxx

yarn提交任务
cd /usr/local/service/hadoop/bin
./yarn jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar pi -Dmapreduce.job.queuename=default 16 1000   
预期结果
Estimated value of Pi is 3.14250000000000000000

mr提交任务
cd /usr/local/service/hadoop/bin
./hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar wordcount  /test  /output
./hdfs dfs -ls /output/*

生产随机数
./hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar randomwriter random

排序
./hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar sort random sort

联邦示例说明

参考:RBF组件示例