如何使用Logstash重命名AWS S3中的文件

Question

我想使用Logstash重命名传入的文件。

示例：

• 传入文件另存为/customer1/file.txt
• Logstash将文件重命名为/customer1/date/file.txt
• 传入文件另存为/customer2/file.txt
• Logstash将文件重命名为/customer2/date/file.txt

我对我不需要弹性搜索的假设是正确的吗？

当前iam在docker本地运行Logstash并具有以下配置：

    input {
  s3 {
    access_key_id => "something"
    secret_access_key => "something_else"
    region => "some_region"
    bucket => "mybucket"
    interval => "10"
    backup_add_prefix =>'s3://mybucket/customer1/date'
    additional_settings => {
      force_path_style => true
      follow_redirects => false
                }
  }
}

我从这里去哪里？

Answer 1

回答我自己的问题：

input {
  s3 {
    access_key_id => "something"
    secret_access_key => "something_else"
    region => "some_region"
    bucket => "mybucket"
    interval => "10"
    sincedb_path => "/tmp/sincedb_something"
    backup_add_prefix =>'date-'
    backup_to_bucket => "mybucket"
    additional_settings => {
      force_path_style => true
      follow_redirects => false
                }
  }
}

在没有backup_to_bucket的情况下，不能使用backup_add_prefix，尽管他们的文档建议这样做。希望对您有所帮助。