Avro Encoder

codec

Encodes events to Apache Avro binary format.

Avro Encoder

Encodes Arrow RecordBatches to Apache Avro binary format.

Configuration

FieldTypeRequiredDefaultDescription
codecstringyes—Must be "avro"

Example

sinks:
  my_kafka:
    type: kafka
    bootstrap_servers: localhost:9092
    topic: events
    encoding:
      codec: avro

When to Use

  • Schema evolution - Supports forward/backward compatibility
  • Compact binary format - Smaller than JSON
  • Hadoop ecosystem - Native support in Hive, Spark