Pig

0
推荐
1642
阅读

运行Pig java.io.IOException: java.net.ConnectException: Call From master/10.3.3.3 to master:10020 failed on connection

运行环境Hadoop 2.7.3 ,pig-0.16.0运行pig 报下面的错误,解决方案:启动jobhistorysbin/mr-jobhistory-daemon.sh --config $HADOOP_CONF_DIR  start historyserver$HADOOP_CONF_DIR 是hadoop存放配置文件的目录,例如存放 hdfs-site.xml ,我的目录是/u01/hadoop/hadoop-2.7.3/etc/hadoopjava.io.IOException: ja...

发表了文章 • 2016-10-27 11:40 • 0 条评论

0
推荐
1709
阅读

Pig 统计web日志ip 访问数量

pig脚本records = load 'access_log.txt' USING PigStorage(' ') as(ip :chararray, v2:chararray,v3:chararray,v4:chararray,v5:chararray,v6:chararray,v7:chararray,v8:chararray); grouped_records = group records by ip; describe grouped_records; ipclicks = foreach grouped_records generate group,COUNT(r...

发表了文章 • 2016-10-27 11:34 • 0 条评论