什么" vcore-seconds"在hadoop工作日志意味着什么?

时间:2015-08-12 12:10:28

标签: hadoop hadoop2

Job Counters
    Launched map tasks=3
    Launched reduce tasks=45
    Data-local map tasks=1
    Rack-local map tasks=2
    Total time spent by all maps in occupied slots (ms)=29338
    Total time spent by all reduces in occupied slots (ms)=200225
    Total time spent by all map tasks (ms)=29338
    Total time spent by all reduce tasks (ms)=200225
    Total vcore-seconds taken by all map tasks=29338
    Total vcore-seconds taken by all reduce tasks=200225
    Total megabyte-seconds taken by all map tasks=30042112
    Total megabyte-seconds taken by all reduce tasks=205030400

" vcore-seconds"是什么意思和" vcore-seconds"和"花费的总时间"

1 个答案:

答案 0 :(得分:2)

没有关于此指标的官方文档,但如果我理解正常(see here),则vcore-seconds是Hadoop为某些任务分配vcore的秒数之和。

我认为此度量标准显示MapReduce应用程序在Map和Reduce阶段花费了多少时间,而不涉及其他任务(计划任务,随机播放和排序中间键等等)