Decodes Protocol Buffers binary format into events.

Protobuf Decoder

Decodes Protocol Buffers binary format into Arrow RecordBatches.

Configuration

Field	Type	Required	Default	Description
`codec`	`string`	yes	—	Must be `"protobuf"`
`descriptor_path`	`string`	yes	—	Path to protobuf descriptor file
`message_name`	`string`	yes	—	Fully qualified protobuf message name
`max_size`	`integer`	no	`10485760`	Maximum message size in bytes (10MB default)

Example

sources:
  my_kafka:
    type: kafka
    bootstrap_servers: localhost:9092
    group_id: my-group
    topics: [proto-events]
    decoding:
      codec: protobuf
      descriptor_path: /etc/kinetic/proto/descriptors.bin
      message_name: "myapp.Event"

When to Use

gRPC services - Decode protobuf payloads
High-performance ingestion - Compact binary format
Strongly typed sources - Schema-enforced data