问:安装失败。无法从代理接收心跳

时间:2016-02-04 23:11:44

标签: cloudera-cdh

我尝试在三个节点上安装cloudera发行版。首先,我在aws亚马逊上使用了弹性IP,我禁用了iptables,selinux,我也配置了ssh(机器之间的密钥)

我的主机文件似乎在以下行:

54.68.215.43 ec2-54-68-215-43.us-west-2.compute.amazonaws.com ip-172-31-4-224.us-west-2.compute.internal ip-172-3
1-4-224 aws.cdh5.controlnode

54.148.59.102 ec2-54-148-59-102.us-west-2.compute.amazonaws.com ip-172-31-4-225.us-west-2.compute.internal ip-172
-31-4-225 aws.cdh5.node01

52.34.61.234 ec2-52-34-61-234.us-west-2.compute.amazonaws.com ip-172-31-4-226.us-west-2.compute.internal ip-172-3
1-4-226 aws.cdh5.node02

(publicIP publicDNS privateDNS privateIP name : Structure)

After got CM i launched installation and i got below logs : (Installation failed. Failed to receive heartbeat from agent.). I canno't pursui installation. Please Help me to get solution. I look forward your reply. Thank you in advance.

[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     SCM Agent Version: 5.5.1
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Agent Protocol Version: 4
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Using Host ID: i-c2d9b918
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Using directory: /run/cloudera-scm-agent
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Using supervisor binary path: /usr/lib/cmf/ag
ent/src/cmf/../../build/env/bin/supervisord
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Neither verify_cert_file nor verify_cert_dir 
are configured. Not performing validation of server certificates in HTTPS communication. These options can be con
figured in this agent's config.ini file to enable certificate validation.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Agent Logging Level: INFO
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     No command line vars
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Missing database jar: /usr/share/java/mysql-c
onnector-java.jar (normal, if you're not using this database type)
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Missing database jar: /usr/share/java/oracle-
connector-java.jar (normal, if you're not using this database type)
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Found database jar: /usr/share/cmf/lib/postgr
esql-9.0-801.jdbc4.jar
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Agent starting as pid 11974 user root(0) grou
p root(0).
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        WARNING  Expected mode 0751 for /run/cloudera-scm-agen
t but was 0755
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Re-using pre-existing directory: /run/clouder
a-scm-agent
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Agent is running on a public cloud. Public ho
stname: ec2-54-68-215-43.us-west-2.compute.amazonaws.com
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Re-using pre-existing directory: /run/clouder
a-scm-agent/cgroups
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Found cgroups subsystem: cpu
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     cgroup pseudofile /tmp/tmpZ9aA60/cpu.rt_runti
me_us does not exist, skipping
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Found cgroups subsystem: cpuacct
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Found cgroups subsystem: memory
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Found cgroups subsystem: blkio
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Reusing /run/cloudera-scm-agent/cgroups/memor
y
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Reusing /run/cloudera-scm-agent/cgroups/cpu
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Reusing /run/cloudera-scm-agent/cgroups/cpuac
ct
[04/Feb/2016 22:48:58 +0000] 11974 MainThread cgroups      INFO     Reusing /run/cloudera-scm-agent/cgroups/blkio
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Found cgroups capabilities: {'has_memory': Tr
ue, 'default_memory_limit_in_bytes': -1, 'default_memory_soft_limit_in_bytes': -1, 'writable_cgroup_dot_procs': T
rue, 'default_cpu_rt_runtime_us': -1, 'has_cpu': True, 'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 
'has_cpuacct': True, 'has_blkio': True}
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Setting up supervisord event monitor.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread filesystem_map INFO     Monitored nodev filesystem types: ['nfs', '
nfs4', 'tmpfs']
[04/Feb/2016 22:48:58 +0000] 11974 MainThread filesystem_map INFO     Using timeout of 2.000000
[04/Feb/2016 22:48:58 +0000] 11974 MainThread filesystem_map INFO     Using join timeout of 0.100000
[04/Feb/2016 22:48:58 +0000] 11974 MainThread filesystem_map INFO     Using tolerance of 60.000000
[04/Feb/2016 22:48:58 +0000] 11974 MainThread filesystem_map INFO     Local filesystem types whitelist: ['ext2', 
'ext3', 'ext4']
[04/Feb/2016 22:48:58 +0000] 11974 MainThread kt_renewer   INFO     Agent wide credential cache set to /run/cloud
era-scm-agent/krb5cc_cm_agent_0
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Using metrics_url_timeout_seconds of 30.00000
0
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Using task_metrics_timeout_seconds of 5.00000
0
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Using max_collection_wait_seconds of 10.00000
0
[04/Feb/2016 22:48:58 +0000] 11974 MainThread metrics      INFO     Importing tasktracker metric schema from file
 /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[04/Feb/2016 22:48:58 +0000] 11974 MainThread ntp_monitor  INFO     Using timeout of 2.000000
[04/Feb/2016 22:48:58 +0000] 11974 MainThread dns_names    INFO     Using timeout of 30.000000
[04/Feb/2016 22:48:58 +0000] 11974 MainThread __init__     INFO     Created DNS monitor.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread stacks_collection_manager INFO     Using max_uncompressed_file_size
_bytes: 5242880
[04/Feb/2016 22:48:58 +0000] 11974 MainThread __init__     INFO     Importing metric schema from file /usr/lib/cm
f/agent/src/cmf/monitor/schema.json
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Supervised processes will add the following t
o their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': 
'/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGM
T_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HD
FS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/game
s:/usr/local/games', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT
_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_
KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector
-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR
2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTG
RESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_H
BASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.
dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_H
UE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_
INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/li
b/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunc
h', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/li
b/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/l
ib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/l
ib/flume-ng'}
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     To override these variables, use /etc/clouder
a-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Re-using pre-existing directory: /run/clouder
a-scm-agent/process
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Re-using pre-existing directory: /run/clouder
a-scm-agent/supervisor
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Re-using pre-existing directory: /run/clouder
a-scm-agent/supervisor/include
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Supervisor version: 3.0
[04/Feb/2016 22:48:58 +0000] 11974 MainThread agent        INFO     Connecting to previous supervisor: agent-1195
-1454591533.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread status_server INFO     Using maximum impala profile bundle size of 
1073741824 bytes.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread status_server INFO     Using maximum stacks log bundle size of 1073
741824 bytes.
[04/Feb/2016 22:48:58 +0000] 11974 MainThread _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Bus STARTING
[04/Feb/2016 22:48:58 +0000] 11974 MainThread _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Started monitor
 thread '_TimeoutMonitor'.
[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   ERROR    [04/Feb/2016:22:48:58] ENGINE Error 
in HTTP server: shutting down
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/CherryPy-3.2.2-py2.7.egg/cherrypy/process/server
s.py", line 187, in _start_http_thread
    self.httpserver.start()
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/CherryPy-3.2.2-py2.7.egg/cherrypy/wsgiserver/wsg
iserver2.py", line 1825, in start
    raise socket.error(msg)
error: No socket could be created on ('ec2-54-68-215-43.us-west-2.compute.amazonaws.com', 9000) -- [Errno 99] Can
not assign requested address

[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Bus ST
OPPING
[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE HTTP S
erver cherrypy._cpwsgi_server.CPWSGIServer(('ec2-54-68-215-43.us-west-2.compute.amazonaws.com', 9000)) already sh
ut down
[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Stoppe
d thread '_TimeoutMonitor'.
[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Bus ST
OPPED
[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Bus EX
ITING
[04/Feb/2016 22:48:58 +0000] 11974 HTTPServer Thread-2 _cplogging   INFO     [04/Feb/2016:22:48:58] ENGINE Bus EX
ITED

0 个答案:

没有答案