流利的Kafka输出插件配置

时间:2019-02-21 11:18:38

标签: apache-kafka fluentd fluentdata

我正在尝试在Fluentd(版本0.7.9)中使用Kafka Producer插件,首先,我想知道以下配置是否不错:

<match log>

 @type kafka_buffered

 brokers mykafka:9093

 topic_key  my_queue

 #how to configure the SASL PLAIN authentication?

 ssl_ca_cert /opt/td-agent/embedded/ssl/cert.pem
 username myuser_here
 password mypass_here

</match>

问题是我在主题中没有得到这些消息:

 2019-02-21 10:28:10 +0100 [warn]: #0 Send exception occurred: Connection reset by peer
 2019-02-21 10:28:10 +0100 [warn]: #0 Exception Backtrace : /opt/td-agent/embedded/lib/ruby/2.4.0/openssl/buffering.rb:181:in `sysread_nonblock'

 2019-02-21 10:28:10 +0100 [info]: #0 initialized kafka producer: kafka
 2019-02-21 10:28:10 +0100 [warn]: #0 failed to flush the buffer. retry_time=0 next_retry_seconds=2019-02-21 10:28:11 +0100 chunk="58264142c3dc4a2c86869aae9a9a033d" error_class=Errno::ECONNRESET error="Connection reset by peer"

非常感谢您

0 个答案:

没有答案