从一个AWS实例到另一个AWS实例使用Cassandra sstableloader失败

时间:2017-02-20 21:36:43

标签: amazon-web-services amazon-ec2 cassandra

一个AWS实例安装并运行了Cassandra(2.1.16)。另一个AWS实例没有安装Cassandra,但使用的是apache-cassandra-2.1.16二进制文件中的sstableloader程序。 sstableloader服务器上使用的cassandra.yaml具有以下设置:

cluster_name:'测试群集' listen_address: storage_port:7000 rpc_address:0.0.0.0 rpc_port:9160

两台服务器都使用相同的AWS安全组,该组具有以下端口:

7000,9160

当我像这样执行ssltableloader时:

./sstableloader -d <CassandraNode> -f ../../cassandra/cassandra.yaml -v ../../cassandra/<Keyspace>/<CFName>/

我收到此错误:

Established connection to initial hosts
Opening sstables and calculating sections to stream
Streaming relevant part of ../../cassandra/<Keyspace>/<CFName>/<Keyspace-CFName>-ka-6952-Data.db ../../cassandra/<Keyspace>/<CFName>/<Keyspace-CFName>-ka-6951-Data.db to [/public ip of Cassandra node]
ERROR 20:06:33 [Stream #c7915b50-f7a7-11e6-bd84-8dd23712cb6e] Streaming error occurred
java.net.ConnectException: Connection timed out
at sun.nio.ch.Net.connect0(Native Method) ~[na:1.8.0_111]
at sun.nio.ch.Net.connect(Net.java:454) ~[na:1.8.0_111]
at sun.nio.ch.Net.connect(Net.java:446) ~[na:1.8.0_111]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:648) ~[na:1.8.0_111]
at java.nio.channels.SocketChannel.open(SocketChannel.java:189) ~[na:1.8.0_111]
at org.apache.cassandra.tools.BulkLoadConnectionFactory.createConnection(BulkLoadConnectionFactory.java:62) ~[apache-cassandra-2.1.16.jar:2.1.16]
at org.apache.cassandra.streaming.StreamSession.createConnection(StreamSession.java:240) ~[apache-cassandra-2.1.16.jar:2.1.16]
at org.apache.cassandra.streaming.ConnectionHandler.initiate(ConnectionHandler.java:80) ~[apache-cassandra-2.1.16.jar:2.1.16]
at org.apache.cassandra.streaming.StreamSession.start(StreamSession.java:227) ~[apache-cassandra-2.1.16.jar:2.1.16]
at org.apache.cassandra.streaming.StreamCoordinator$StreamSessionConnector.run(StreamCoordinator.java:208) [apache-cassandra-2.1.16.jar:2.1.16]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_111]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_111]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_111]
progress: total: 100% 0  MB/s(avg: 0 MB/s)WARN  20:06:33 [Stream #c7915b50-f7a7-11e6-bd84-8dd23712cb6e] Stream failed
Streaming to the following hosts failed:
[/<public ip of Cassandra node>]
java.util.concurrent.ExecutionException: org.apache.cassandra.streaming.StreamException: Stream failed
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:125)
Caused by: org.apache.cassandra.streaming.StreamException: Stream failed
at org.apache.cassandra.streaming.management.StreamEventJMXNotifier.onFailure(StreamEventJMXNotifier.java:85)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202)
at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:209)
at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:185)
at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:413)
at org.apache.cassandra.streaming.StreamSession.onError(StreamSession.java:518)
at org.apache.cassandra.streaming.StreamSession.start(StreamSession.java:233)
at org.apache.cassandra.streaming.StreamCoordinator$StreamSessionConnector.run(StreamCoordinator.java:208)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

我已成功使用本地PC上的sstableloader将数据加载到AWS上的Cassandra节点。我失败的地方是当我尝试从一个ASW实例到另一个ASW实例的sstableloader时。

对于完整的披露,我也尝试过在2个实例之间打开的所有端口,这会导致同样的失败。

在尝试执行sstableloading的实例上是否缺少配置步骤?

1 个答案:

答案 0 :(得分:0)

Cassandra节点使用其公共IP作为其broadcast_address。当我在我的盒子里使用sstableloader时,这个工作正常。尝试从另一个AWS实例使用sstableloader时失败,因为该服务器无法通过其公共IP找到Cassandra节点。我能够通过使用Cassandra节点的私有IP作为broadcast_address来使其工作。

相关问题