槽上传到Hadoop HA集群的问题

时间:2019-01-30 02:06:49

标签: hadoop flume

Hadoop版本2.77
水槽版本1.8

java.io.IOException: Callable timed out after 20000 ms on file: hdfs://xx.xx.xx.xx:9000/data/hadoop/test//2019-01-28.1548669625680.txt.tmp
            at org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:715)
            at org.apache.flume.sink.hdfs.BucketWriter.doFlush(BucketWriter.java:486)
            at org.apache.flume.sink.hdfs.BucketWriter.flush(BucketWriter.java:448)
            at org.apache.flume.sink.hdfs.BucketWriter.close(BucketWriter.java:388)
            at org.apache.flume.sink.hdfs.BucketWriter$2.call(BucketWriter.java:295)
            at org.apache.flume.sink.hdfs.BucketWriter$2.call(BucketWriter.java:289)
            at java.util.concurrent.FutureTask.run(FutureTask.java:266)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    Caused by: java.util.concurrent.TimeoutException
            at java.util.concurrent.FutureTask.get(FutureTask.java:205)
            at org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:708)
            ... 11 more

0 个答案:

没有答案