sqoop-export-作业失败,任务失败?

时间:2019-02-13 16:29:03

标签: hive sqoop

  1. 我尝试将配置单元表导出到mysql表,下面是我运行的命令 sqoop export --verbose --connect jdbc:mysql://mycomputer:3306/ml --username root --password root --table labeled_set_stats --hcatalog-table tmp_mysql_20190210 -m 1
  2. 我也尝试了以下命令: sqoop export --verbose --connect jdbc:mysql://mycomputer:3306/ml --username root --password root --table labeled_set_stats --export-dir /user/hive/warehouse/export.db/tmp_mysql_20190210/000000_0 -fields-terminated-by ',' --lines-terminated-by '\n' -m 1

  3. 以上两个命令的运行错误消息大致相同:

19/02/14 00:19:04 INFO mapreduce.Job: Job job_1550050866474_0033 failed with state FAILED due to: Task failed task_1550050866474_0033_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

19/02/14 00:19:04 INFO mapreduce.Job: Counters: 8
        Job Counters 
                Failed map tasks=1
                Launched map tasks=1
                Data-local map tasks=1
                Total time spent by all maps in occupied slots (ms)=4297
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=4297
                Total vcore-seconds taken by all map tasks=68752
                Total megabyte-seconds taken by all map tasks=4400128
19/02/14 00:19:04 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
19/02/14 00:19:04 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 24.4535 seconds (0 bytes/sec)
19/02/14 00:19:04 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
19/02/14 00:19:04 INFO mapreduce.ExportJobBase: Exported 0 records.
19/02/14 00:19:04 DEBUG util.ClassLoaderStack: Restoring classloader: sun.misc.Launcher$AppClassLoader@5f150435
19/02/14 00:19:04 ERROR tool.ExportTool: Error during export: Export job failed!
19/02/14 00:19:04 INFO hive.metastore: Closed a connection to metastore, current connections: 0
  1. 令人讨厌的是,sqoop没有提供足够的信息说明命令失败的原因。

0 个答案:

没有答案