hadoop-MapReduce-examples
kerberos认证
/usr/bin/klist -kt /var/krb5kdc/emr.keytab
/usr/bin/kinit -kt /var/krb5kdc/emr.keytab hadoop/xxx@xxxxx
yarn提交任务
cd /usr/local/service/hadoop/bin
./yarn jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar pi -Dmapreduce.job.queuename=default 16 1000
预期结果
Estimated value of Pi is 3.14250000000000000000
mr提交任务
cd /usr/local/service/hadoop/bin
./hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar wordcount /test /output
./hdfs dfs -ls /output/*
生产随机数
./hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar randomwriter random
排序
./hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar sort random sort
联邦示例说明
参考:RBF组件示例