Sqoop导入作业失败--mapreduce.ImportJobBase:MapReduce作业已经淘汰。性能

时间:2018-09-14 13:32:44

标签: hadoop mapreduce sqoop

我正在尝试通过Sqoop导入作业从MySQL导入表,但是我的作业以mapreduce.ImportJobBase: The MapReduce job has already been retired. Performance失败

命令:

import
-Dmapreduce.job.user.classpath.first=true
-Dorg.apache.sqoop.splitter.allow_text_splitter=true
--connect
jdbc:mysql://host/db
--username
catawiki
--password-alias
password
--table
sales_management_overviews
-m
10
--delete-target-dir
--target-dir
gs://bucket/staging/mysql/data
--as-avrodatafile
--autoreset-to-one-mapper

日志:

18/09/14 09:28:06 INFO mapreduce.JobSubmitter: number of splits:10
18/09/14 09:28:07 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1536912116027_0464
18/09/14 09:28:07 INFO impl.YarnClientImpl: Submitted application application_1536912116027_0464
18/09/14 09:28:07 INFO mapreduce.Job: The url to track the job: http://sqoop-import-cluster-m:8088/proxy/application_1536912116027_0464/
18/09/14 09:28:07 INFO mapreduce.Job: Running job: job_1536912116027_0464
18/09/14 09:28:13 INFO mapreduce.Job: Job job_1536912116027_0464 running in uber mode : false
18/09/14 09:28:13 INFO mapreduce.Job:  map 0% reduce 0%
18/09/14 09:28:20 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=KILLED. Redirecting to job history server
18/09/14 09:28:20 INFO mapreduce.Job:  map 0% reduce 100%
18/09/14 09:28:20 INFO mapreduce.Job: Job job_1536912116027_0464 failed with state KILLED due to: 
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: The MapReduce job has already been retired. Performance
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: counters are unavailable. To get this information, 
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: you will need to enable the completed job store on 
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: the jobtracker with:
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: mapreduce.jobtracker.persist.jobstatus.active = true
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: mapreduce.jobtracker.persist.jobstatus.hours = 1
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: A jobtracker restart is required for these settings
18/09/14 09:28:20 INFO mapreduce.ImportJobBase: to take effect.
18/09/14 09:28:20 ERROR tool.ImportTool: Import failed: Import job failed!

我的工作可能出什么问题了?

0 个答案:

没有答案