Writes events to Delta Lake tables.

Delta🔗

Writes events to Delta Lake tables.

Configuration🔗

FieldTypeRequiredDefaultDescription
inputs[string]noUpstream component names that feed events into this sink.
error_policyErrorPolicynoPolicy for handling errors during event processing.
encodingEncoderConfigEnum (optional)noOptional encoder configuration for output events.
bufferBufferConfignoBuffer configuration for event batching.
warehousestringnoBase URI for the Delta table warehouse storage.
tablestringnoTable name or path within the warehouse.
max_rowsunsigned integernoMaximum number of rows per batch before flushing.
max_bytesunsigned integernoMaximum byte size of a batch before flushing.
max_age_msunsigned integernoMaximum age of a batch in milliseconds before flushing.

Telemetry🔗

This component emits the following standard telemetry metrics and events.

Metrics🔗

NameTypeDescription
component_sent_events_totalCounterTotal number of Kinetic events successfully sent by this sink.
component_sent_event_bytes_totalCounterTotal estimated byte size of events sent.
component_sent_network_bytes_totalCounterTotal number of raw network bytes sent.
component_errors_totalCounterTotal number of errors encountered during processing.

Events🔗

NameDescription
ComponentErrorEmitted when an error occurs during component execution.
ComponentEventsDroppedEmitted when events are intentionally or unintentionally dropped.

Example🔗

sinks:
  my_delta:
    type: delta