Question

关注this question，this question，this question后我仍然收到此错误

org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create spark client.
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:266)
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:252)
at org.apache.hive.jdbc.HiveStatement.runAsyncOnServer(HiveStatement.java:309)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:250)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:434)
at HiveRead.<init>(HiveRead.java:37)
at HiveRead.main(HiveRead.java:24)

1）我已下载spark-assembly_2.10-1.6.0-cdh5.11.1 2）我在hite-site.xml

上设置了此属性

<property>
  <name>hive.spark.client.server.connect.timeout</name>
  <value>300000</value>
</property>

此hive-site.xml内的spark/config

中的此属性

<property>
  <name>spark.executor.memory</name>
  <value>512</value>
</property>

<property>
  <name>spark.yarn.executor.memoryOverhead</name>
  <value>200</value>
</property>

这是来自yarn gui的日志信息

  AM Container for appattempt_1499407420326_0010_000001 exited with 
     exitCode: 1
    Failing this attempt.Diagnostics: Exception from container-launch.
    Container id: container_1499407420326_0010_01_000001
    Exit code: 1
    Stack trace: ExitCodeException exitCode=1:
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:972)
    at org.apache.hadoop.util.Shell.run(Shell.java:869)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1170)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:236)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:305)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:84)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:748)
    Container exited with a non-zero exit code 1

我还缺少什么吗？

org.apache.hadoop.hive.ql.metadata.HiveException：无法创建spark客户端

0 个答案: