错误“启动MRAppMaster”在emr上运行hadoop作业

时间:2015-11-26 13:51:04

标签: hadoop hadoop2 emr amazon-emr

当我尝试在emr集群上运行hadoop作业时,我得到了下面提到的错误,因为“AM Container”导致无法启动,并且在查看容器日志时,我发现它失败了在启动“MRAppMaster”时。在本地开发人员桌面上,我能够成功运行该作业。

我在网上搜索并找到了这个(Hadoop 2.6.0: Basic error "starting MRAppMaster" after installing),其中说这个问题可能是因为有多个版本的hadoop“hadoop.so”。根据堆栈中提到的建议,可以获取“java.library.path”和我的结果: :/ usr / lib中/ Hadoop的LZO / LIB /天然:/ usr / lib中/ hadoop的/ LIB /本地 路径:/ usr / lib / hadoop-lzo / lib / native,不包含任何hadoop.so文件。 路径:/ usr / lib / hadoop / lib / native,确实包含hadoop.so和hadoop.so.1.0。

我尝试从后面删除一个并运行我的工作,但它继续失败并出现同样的错误。

错误讯息:

我的emr工作的Stdlog:

2015-11-26 11:18:17,074 INFO org.apache.hadoop.mapreduce.Job(main):作业job_1448532525181_0004因状态失败而失败,原因是:应用程序application_1448532525181_0004由于AM容器而失败了2次appattempt_1448532525181_0004_000002退出,退出了exitCode :1 诊断:容器启动的例外情况。 容器ID:container_1448532525181_0004XXX001XXX 退出代码:1

Stack trace: ExitCodeException exitCode=1: 
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

容器以非零退出代码1退出 没有这个尝试。申请失败。 2015-11-26 11:18:17,095 INFO org.apache.hadoop.mapreduce.Job(main):专柜:0

容器日志:

2015-11-26 10:11:40,020 INFO [main] com.amazonaws.latency: ClientExecuteTime=[44.047], 2015-11-26 10:11:40,021 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster java.lang.NoSuchMethodError: com.amazonaws.AmazonWebServiceRequest.getDelegationToken()Ljava/lang/String;
at com.amazonaws.handlers.internal.S3SecurityTokenRequestHandler.beforeRequest(S3SecurityTokenRequestHandler.java:33)
at com.amazonaws.handlers.RequestHandler2Adaptor.beforeRequest(RequestHandler2Adaptor.java:37)
at com.amazonaws.http.AmazonHttpClient.requestHandler2s(AmazonHttpClient.java:434)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:292)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3595)
at com.amazonaws.services.s3.AmazonS3Client.headBucket(AmazonS3Client.java:1041)
at com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:1013)
at com.amazon.ws.emr.hadoop.fs.s3n.Jets3tNativeFileSystemStore.ensureBucketExists(Jets3tNativeFileSystemStore.java:105)
at com.amazon.ws.emr.hadoop.fs.s3n.Jets3tNativeFileSystemStore.initialize(Jets3tNativeFileSystemStore.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy27.initialize(Unknown Source)
at com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem.initialize(S3NativeFileSystem.java:466)
at com.amazon.ws.emr.hadoop.fs.EmrFileSystem.initialize(EmrFileSystem.java:116)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2644)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:90)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2678)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2660)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:374)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.<init>(FileOutputCommitter.java:91)
at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.<init>(FileOutputCommitter.java:74)
at org.apache.hadoop.mapreduce.lib.output.DirectFileOutputCommitter.<init>(DirectFileOutputCommitter.java:31)
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.getOutputCommitter(FileOutputFormat.java:310)
at org.apache.hadoop.mapreduce.lib.output.FilterOutputFormat.getOutputCommitter(FilterOutputFormat.java:67)
at org.apache.hadoop.mapreduce.lib.output.LazyOutputFormat.getOutputCommitter(LazyOutputFormat.java:92)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.call(MRAppMaster.java:471)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.call(MRAppMaster.java:453)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1542)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:453)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:371)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1500)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1497)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1430) 2015-11-26 10:11:40,026 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1

对此的任何帮助都会有很大的帮助,如果您需要我的更多信息,请告诉我。

谢谢, Anusha.K

0 个答案:

没有答案