Encodes events to Protocol Buffers binary format.

Protobuf Encoder

Encodes Arrow RecordBatches to Protocol Buffers binary format.

Configuration

FieldTypeRequiredDefaultDescription
codecstringyesMust be "protobuf"
descriptor_pathstringyesPath to protobuf descriptor file
message_namestringyesFully qualified protobuf message name

Example

sinks:
  my_grpc:
    type: grpc
    endpoint: http://api.example.com
    encoding:
      codec: protobuf
      descriptor_path: /etc/kinetic/proto/descriptors.bin
      message_name: "myapp.Event"

When to Use

  • gRPC services - Native protobuf support
  • High-performance APIs - Compact binary format
  • Cross-language systems - Strongly typed schemas