一个节点关闭时Spark-Cassandra连接器错误

时间:2016-12-01 15:25:13

标签: scala apache-spark cassandra spark-cassandra-connector

我正在运行带有2个节点和replication_factor:2的测试Cassandra集群。我知道一致性不是重点,但我现在正在尝试测试别的东西。

虽然我尝试使用Spark(1.6.0v)连接Cassandra集群,但当一个节点关闭时,我在日志中收到此错误 - >

enter image description here

[编辑] 这是像@massg一样的整个错误集。

16/12/01 16:16:23 INFO CassandraConnector: Connected to Cassandra cluster: Test Cluster
16/12/01 16:16:23 INFO Cluster: New Cassandra host   192.168.56.102/192.168.56.102:9042 added
16/12/01 16:16:23 INFO Cluster: New Cassandra host    192.168.56.101/192.168.56.101:9042 added
16/12/01 16:16:23 INFO CassandraConnector: Connected to Cassandra cluster: Test Cluster
16/12/01 16:16:28 WARN Session: Error creating pool to 192.168.56.102/192.168.56.102:9042
com.datastax.driver.core.exceptions.ConnectionException:    [192.168.56.102/192.168.56.102] Pool was closed during initialization
at    com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:149)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:135)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1181)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:185)
at com.google.common.util.concurrent.Futures$CombinedFuture.setOneValue(Futures.java:1626)
at com.google.common.util.concurrent.Futures$CombinedFuture.access$400(Futures.java:1470)
at com.google.common.util.concurrent.Futures$CombinedFuture$2.run(Futures.java:1548)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:185)
at com.google.common.util.concurrent.Futures$FallbackFuture$1$1.onSuccess(Futures.java:475)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1181)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.Futures$ImmediateFuture.addListener(Futures.java:102)
at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1184)
at com.google.common.util.concurrent.Futures$FallbackFuture$1.onFailure(Futures.java:472)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202)
at com.google.common.util.concurrent.Futures$FallbackFuture$1$1.onFailure(Futures.java:483)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.add(ExecutionList.java:101)
at com.google.common.util.concurrent.AbstractFuture.addListener(AbstractFuture.java:170)
at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1184)
at com.google.common.util.concurrent.Futures$FallbackFuture$1.onFailure(Futures.java:472)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202)
at com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:857)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202)
at com.google.common.util.concurrent.SettableFuture.setException(SettableFuture.java:68)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:157)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:140)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680)
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:222)
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38)
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
at java.lang.Thread.run(Thread.java:745)

有没有在spark / scala中做一些异常,看看其中一个节点是不是accessbile而忽略它并查找它的副本,就像Cassandra正在做但没有日志中的任何错误?

谢谢!

0 个答案:

没有答案
相关问题