Produces events to an Apache Kafka topic.

Kafka🔗

Produces events to an Apache Kafka topic.

Configuration🔗

Field	Type	Required	Default	Description
`inputs`	`[string]`	yes	—	Upstream component names that feed events into this sink.
`error_policy`	`ErrorPolicy`	no	`drop_on_error`	Policy for handling errors during event processing.
`encoding`	`EncoderConfigEnum (optional)`	no	—	Optional encoder configuration for output events.
`buffer`	`BufferConfig`	no	—	Buffer configuration for event batching.
`client`	`KafkaClientConfig`	no	—	Shared Kafka client connection settings.
`bootstrap_servers`	`string`	yes	—	Comma-separated list of Kafka broker addresses.
`client_id`	`string (optional)`	no	—	Optional Kafka client identifier.
`properties`	`std::collections::HashMap<String,String>`	no	—	Additional librdkafka configuration properties.
`topic`	`string`	yes	—	The Kafka topic to produce events to.

Telemetry🔗

This component emits the following standard telemetry metrics and events.

Metrics🔗

Name	Type	Description
`component_sent_events_total`	Counter	Total number of Kinetic events successfully sent by this sink.
`component_sent_event_bytes_total`	Counter	Total estimated byte size of events sent.
`component_sent_network_bytes_total`	Counter	Total number of raw network bytes sent.
`component_errors_total`	Counter	Total number of errors encountered during processing.

Events🔗

Name	Description
`ComponentError`	Emitted when an error occurs during component execution.
`ComponentEventsDropped`	Emitted when events are intentionally or unintentionally dropped.

Example🔗

sinks:
  my_kafka:
    type: kafka
    inputs: ["my_transform"]
    client:
      bootstrap_servers: localhost:9092
      client_id: kinetic-worker-1
      properties: {"compression.type": "lz4"}
    topic: events-ingest

Kafka Stable

Kafka🔗

Configuration🔗

Telemetry🔗

Metrics🔗

Events🔗

Example🔗