spark 读取预分region的Hbase
0
在Hbase中建立一个空表 按日期预分region如下
20170101-~
20170102-~
20170103-~
20170104-~
20170105-~
然后提交spark 任务涉及的scan范围为
startRowKey..20161203- stopRowKey..20170101_
sparksubmit之后报：
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
一共6条warn，也就是说它会请求预分配的6个region，这是为什么呢，为什么不是一个 region呢？
20170101-~
20170102-~
20170103-~
20170104-~
20170105-~
然后提交spark 任务涉及的scan范围为
startRowKey..20161203- stopRowKey..20170101_
sparksubmit之后报：
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
17/01/12 17:25:36 WARN TableInputFormatBase: Cannot resolve the host name for 10-10-135-166/10.10.135.166 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '166.135.10.10.in-addr.arpa'
一共6条warn，也就是说它会请求预分配的6个region，这是为什么呢，为什么不是一个 region呢？
没有找到相关结果
重要提示：提问者不能发表回复，可以通过评论与回答者沟通，沟通后可以通过编辑功能完善问题描述，以便后续其他人能够更容易理解问题.
2 个回复
Bob - 同程旅游大数据+BI 架构师 2017-02-07 回答
赞同来自:
MarsJ - 大数据玩家~DS 2017-01-16 回答
赞同来自: