spark程序运行报错找不到sparksql的方法

0
报错信息：
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.sql.hive.HiveContext.sql(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;
    at com.zork.batch.CancelMinInterval$.main(CancelMinInterval.scala:49)
    at com.zork.batch.CancelMinInterval.main(CancelMinInterval.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:736)
    at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
 
spark版本是1.6
pom依赖如下：
<dependency>

    <groupId>org.apache.spark</groupId>

    <artifactId>spark-hive_2.10</artifactId>

    <version>1.6.1</version>

</dependency>

<dependency>

    <groupId>org.apache.spark</groupId>

    <artifactId>spark-sql_2.10</artifactId>

    <version>1.6.1</version>

</dependency>

<!-- https://mvnrepository.com/arti ... _2.10 -->

<dependency>

    <groupId>com.databricks</groupId>

    <artifactId>spark-avro_2.10</artifactId>

    <version>2.0.1</version>

</dependency>
 代码编译和打包是没有 报错的
2017-02-23 添加评论
分享

没有找到相关结果

    已邀请:
    0

    regan - run! run! run! happy runner! 我是奔跑的小米~ 2017-02-23 回答

    Spark_SQL是构建在SparkCore之上的，必须加上Spark-core的依赖~
    2017-02-23 0
    分享
    为什么被折叠? 0 个回复被折叠

    要回复问题请先登录或注册