Question

我正在尝试在HDP群集上运行简单的oozie作业。执行oozie后，作业仍处于Running状态。

这是我的Workflow.xml

<workflow-app name="sqoop-to-hive" xmlns="uri:oozie:workflow:0.4">
  <start to="sqoop2hive"/>
     <action name="sqoop2hive">
     <sqoop xmlns="uri:oozie:sqoop-action:0.2">
      <job-tracker>${jobTracker}</job-tracker>
      <name-node>${nameNode}</name-node>
      <command>sqoop import --connect jdbc:mysql://localhost:3306/test --table testing --split-by err_dt --hive-import --hive-table testing  -m 1</command>
      <file>hive-site.xml</file>
        <archive>mysql-connector-java.jar</archive>
      </sqoop>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed</message>
</kill>
<end name="end"/>
</workflow-app>

以下是生成的日志..

2015-04-07 14:33:32,792  INFO ActionStartXCommand:543 - SERVER[hadoop-slave1.bigdatacoe.td.teradata.com] USER[hduser] GROUP[-] TOKEN[] APP[sqoop-to-hive] JOB[0000004-150407125731126-oozie-oozi-W] ACTION[0000004-150407125731126-oozie-oozi-W@:start:] Start action [0000004-150407125731126-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-04-07 14:33:32,792  INFO ActionStartXCommand:543 - SERVER[hadoop-slave1.bigdatacoe.td.teradata.com] USER[hduser] GROUP[-] TOKEN[] APP[sqoop-to-hive] JOB[0000004-150407125731126-oozie-oozi-W] ACTION[0000004-150407125731126-oozie-oozi-W@:start:] [***0000004-150407125731126-oozie-oozi-W@:start:***]Action status=DONE
2015-04-07 14:33:32,792  INFO ActionStartXCommand:543 - SERVER[hadoop-slave1.bigdatacoe.td.teradata.com] USER[hduser] GROUP[-] TOKEN[] APP[sqoop-to-hive] JOB[0000004-150407125731126-oozie-oozi-W] ACTION[0000004-150407125731126-oozie-oozi-W@:start:] [***0000004-150407125731126-oozie-oozi-W@:start:***]Action updated in DB!
2015-04-07 14:33:32,842  INFO ActionStartXCommand:543 - SERVER[hadoop-slave1.bigdatacoe.td.teradata.com] USER[hduser] GROUP[-] TOKEN[] APP[sqoop-to-hive] JOB[0000004-150407125731126-oozie-oozi-W] ACTION[0000004-150407125731126-oozie-oozi-W@sqoop2hive] Start action [0000004-150407125731126-oozie-oozi-W@sqoop2hive] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]

工作资产

nameNode=hdfs://masternode:8020
jobTracker=masternode:8021
oozie.wf.application.path=oozie-sqoop
queueName=default
oozie.use.system.libpath=true
oozie.libpath= /user/oozie/share/lib

不确定这里有什么问题。请让我知道我该怎么办？

Answer 1

我在hortonworks沙箱中遇到了类似的问题改变之后它对我有用。

名称节点= HDFS：//sandbox.hortonworks.com：8020

的JobTracker = sandbox.hortonworks.com：8050 尝试提供fQDN

Answer 2

检查您的hadoop版本，2.0及以上版本。

jobTracker=masternode:8021(remove)

jobTracker=masternode:8032

8032是ResourceManager的默认端口。 jobTracker可以根据正在使用的Hadoop版本引用JobTracker或ResourceManager

并将所有hadoop设置复制到 oozie / conf / hadoop-conf / 文件夹中。与core-site.xml一样，hadoop-policy.xml，hdfs-site.xml，yarn-site.xml。

Oozie Job仍处于RUNNING状态

2 个答案: