Writes events to Delta Lake tables.
Delta🔗
Writes events to Delta Lake tables.
Configuration🔗
| Field | Type | Required | Default | Description |
inputs | [string] | no | — | Upstream component names that feed events into this sink. |
error_policy | ErrorPolicy | no | — | Policy for handling errors during event processing. |
encoding | EncoderConfigEnum (optional) | no | — | Optional encoder configuration for output events. |
buffer | BufferConfig | no | — | Buffer configuration for event batching. |
warehouse | string | no | — | Base URI for the Delta table warehouse storage. |
table | string | no | — | Table name or path within the warehouse. |
max_rows | unsigned integer | no | — | Maximum number of rows per batch before flushing. |
max_bytes | unsigned integer | no | — | Maximum byte size of a batch before flushing. |
max_age_ms | unsigned integer | no | — | Maximum age of a batch in milliseconds before flushing. |
Telemetry🔗
This component emits the following standard telemetry metrics and events.
Metrics🔗
| Name | Type | Description |
component_sent_events_total | Counter | Total number of Kinetic events successfully sent by this sink. |
component_sent_event_bytes_total | Counter | Total estimated byte size of events sent. |
component_sent_network_bytes_total | Counter | Total number of raw network bytes sent. |
component_errors_total | Counter | Total number of errors encountered during processing. |
Events🔗
| Name | Description |
ComponentError | Emitted when an error occurs during component execution. |
ComponentEventsDropped | Emitted when events are intentionally or unintentionally dropped. |
Example🔗
sinks:
my_delta:
type: delta