0
推荐
1642
阅读
运行Pig java.io.IOException: java.net.ConnectException: Call From master/10.3.3.3 to master:10020 failed on connection
运行环境Hadoop 2.7.3 ,pig-0.16.0运行pig 报下面的错误,解决方案:启动jobhistorysbin/mr-jobhistory-daemon.sh --config $HADOOP_CONF_DIR start historyserver$HADOOP_CONF_DIR 是hadoop存放配置文件的目录,例如存放 hdfs-site.xml ,我的目录是/u01/hadoop/hadoop-2.7.3/etc/hadoopjava.io.IOException: ja...
0
推荐
1709
阅读
Pig 统计web日志ip 访问数量
pig脚本records = load 'access_log.txt' USING PigStorage(' ') as(ip :chararray, v2:chararray,v3:chararray,v4:chararray,v5:chararray,v6:chararray,v7:chararray,v8:chararray);
grouped_records = group records by ip;
describe grouped_records;
ipclicks = foreach grouped_records generate group,COUNT(r...