Writes events to Delta Lake tables.

Delta🔗

Writes events to Delta Lake tables.

Configuration🔗

FieldTypeRequiredDefaultDescription
inputs[string]no—Upstream component names that feed events into this sink.
error_policyErrorPolicyno—Policy for handling errors during event processing.
encodingEncoderConfigEnum (optional)no—Optional encoder configuration for output events.
bufferBufferConfigno—Buffer configuration for event batching.
warehousestringno—Base URI for the Delta table warehouse storage.
tablestringno—Table name or path within the warehouse.
max_rowsunsigned integerno—Maximum number of rows per batch before flushing.
max_bytesunsigned integerno—Maximum byte size of a batch before flushing.
max_age_msunsigned integerno—Maximum age of a batch in milliseconds before flushing.

Telemetry🔗

This component emits the following standard telemetry metrics and events.

Metrics🔗

NameTypeDescription
component_sent_events_totalCounterTotal number of Kinetic events successfully sent by this sink.
component_sent_event_bytes_totalCounterTotal estimated byte size of events sent.
component_sent_network_bytes_totalCounterTotal number of raw network bytes sent.
component_errors_totalCounterTotal number of errors encountered during processing.

Events🔗

NameDescription
ComponentErrorEmitted when an error occurs during component execution.
ComponentEventsDroppedEmitted when events are intentionally or unintentionally dropped.

Example🔗

sinks:
  my_delta:
    type: delta