Question

当我在EC2上部署我的TwitterStreaming-0.0.1-SNAPSHOT时出错我用过这个：

spark/bin/spark-submit --class streaming.java.TwitterStreaming --master spark://xxxxxxxx.us-west-2.compute.amazonaws.com:6066 --deploy-mode cluster application-jar TwitterStreaming-0.0.1-SNAPSHOT.jar

答案是：

    {
  "action" : "CreateSubmissionResponse",
  "message" : "Driver successfully submitted as driver-20150402200153-0000",
  "serverSparkVersion" : "1.3.0",
  "submissionId" : "driver-20150402200153-0000",
  "success" : true
}

浏览器上的

我收到以下错误：

driver-20150402210100-0001  streaming.java.TwitterStreaming     ERROR   1   512.0 MB    stdout stderr   java.io.FileNotFoundException: File file:/root/application-jar does not exist.

Answer 1

提交命令中的application-jar似乎是额外的

spark/bin/spark-submit --class streaming.java.TwitterStreaming --master spark://xxxxxxxx.us-west-2.compute.amazonaws.com:6066 --deploy-mode cluster  TwitterStreaming-0.0.1-SNAPSHOT.jar

确保提供TwitterStreaming-0.0.1-SNAPSHOT.jar

的完整路径

在EC2上部署火花

1 个答案: