在hadoop集群上运行作业

时间:2013-06-13 18:15:15

标签: java hadoop

我想在hadoop集群上提交作业并收到此错误。你知道我该怎么办呢?或者至少一般来说有什么可能性?

java.lang.IllegalArgumentException: Can not create a Path from a null string
    at org.apache.hadoop.fs.Path.checkPathArg(Path.java:87)
    at org.apache.hadoop.fs.Path.<init>(Path.java:99)
Can not create a Path from a null string
null

这是提交作业的bash脚本。

 #!/bin/bash
 SUBMIT_SCRIPT=/usr/local/job_submit.sh
 JAR_LOC="$PWD/Models.jar"
 ORG_ID="2"
 INPUT_LOC=/starting/part*
 OUTPUT_LOC=/user/v/output

 hadoop fs -rm -r ${OUTPUT_LOC}
 LIB="$JAR_LOC" \
         $SUBMIT_SCRIPT \
         -j DataJob \
         -m PassThrough -r PassThrough \
         -DinputPath=${INPUT_LOC}\
         -DoutputPath=${OUTPUT_LOC}

 #hadoop fs -cat ${OUTPUT_LOC}/part* > out.txt

0 个答案:

没有答案