如何使logtash与io.confluent.kafka.serializers.KafkaAvroSerializer一起使用

问题描述

   kafka{
     topic_id => "myTopic"
     bootstrap_servers => "127.0.0.1:9092"
     value_serializer => "io.confluent.kafka.serializers.KafkaAvroSerializer"
   }
}

[[main]-pipeline-manager] kafka - Unable to create Kafka producer from given configuration {:kafka_error_message=>org.apache.kafka.common.config.ConfigException: Invalid value io.confluent.kafka.serializers.KafkaAvroSerializer for configuration value.serializer: Class io.confluent.kafka.serializers.KafkaAvroSerializer Could not be found.,:cause=>nil}

是否有人通过io.confluent.kafka.serializers.KafkaAvroSerializer使logtash工作？

解决方法

您需要使用ByteArraySerializer并安装此编解码器

https://github.com/revpoint/logstash-codec-avro_schema_registry