sqoop-无法从Teradata将数据加载到配置单元中

时间:2018-07-30 13:34:33

标签: hive sqoop

我们正在使用Teradata TDCH 1.5 jar从Teradata提取数据并使用Sqoop导入Hive。

第一步,手动创建Hive表,并使用sqoop希望将数据加载到该表中。

Sqoop脚本:

#sqoop list-tables  \
#--connection-manager org.apache.sqoop.teradata.TeradataConnManager \
#--connect $CONN --username $USER --password $PWD 


sqoop import \
--connection-manager org.apache.sqoop.teradata.TeradataConnManager \
--connect $CONN --username $USER --password $PWD \
--table TESTSQOOP \
--hive-import \
--hive-table TESTSQOOP

错误日志:

18/07/30 08:45:09 ERROR teradata.TeradataSqoopImportHelper: Exception running Teradata import job
java.lang.IllegalArgumentException: Can not create a Path from an empty string
    at org.apache.hadoop.fs.Path.checkPathArg(Path.java:163)
    at org.apache.hadoop.fs.Path.<init>(Path.java:175)
    at com.teradata.connector.hive.utils.HiveUtils.loadDataintoHiveTable(HiveUtils.java:303)
    at com.teradata.connector.hive.processor.HiveOutputProcessor.outputPostProcessor(HiveOutputProcessor.java:274)
    at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:172)
    at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:58)
    at org.apache.sqoop.teradata.TeradataSqoopImportHelper.runJob(TeradataSqoopImportHelper.java:374)
    at org.apache.sqoop.teradata.TeradataConnManager.importTable(TeradataConnManager.java:505)
    at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
18/07/30 08:45:09 INFO teradata.TeradataSqoopImportHelper: Teradata import job completed with exit code 1
18/07/30 08:45:09 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Exception running Teradata import job
    at org.apache.sqoop.teradata.TeradataSqoopImportHelper.runJob(TeradataSqoopImportHelper.java:377)
    at org.apache.sqoop.teradata.TeradataConnManager.importTable(TeradataConnManager.java:505)
    at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
Caused by: java.lang.IllegalArgumentException: Can not create a Path from an empty string
    at org.apache.hadoop.fs.Path.checkPathArg(Path.java:163)
    at org.apache.hadoop.fs.Path.<init>(Path.java:175)
    at com.teradata.connector.hive.utils.HiveUtils.loadDataintoHiveTable(HiveUtils.java:303)
    at com.teradata.connector.hive.processor.HiveOutputProcessor.outputPostProcessor(HiveOutputProcessor.java:274)
    at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:172)
    at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:58)
    at org.apache.sqoop.teradata.TeradataSqoopImportHelper.runJob(TeradataSqoopImportHelper.java:374)

0 个答案:

没有答案