Produces events to an Apache Arrow Flight SQL server.

Flight Sql🔗

Produces events to an Apache Arrow Flight SQL server.

Configuration🔗

FieldTypeRequiredDefaultDescription
inputs[string]yesUpstream component names that feed events into this sink.
error_policyErrorPolicynodrop_on_errorPolicy for handling errors during event processing.
encodingEncoderConfigEnum (optional)noOptional encoder configuration for output events.
bufferBufferConfignoBuffer configuration for event batching.
endpointstringyesTarget Flight SQL endpoint URL (e.g., "http://localhost:32010").
table_namestring (optional)noDestination table name for insertions.
setup_commands[string] (optional)noSQL commands to execute upon connecting (e.g., SET proxy = 'my-proxy').

Telemetry🔗

This component emits the following standard telemetry metrics and events.

Metrics🔗

NameTypeDescription
component_sent_events_totalCounterTotal number of Kinetic events successfully sent by this sink.
component_sent_event_bytes_totalCounterTotal estimated byte size of events sent.
component_sent_network_bytes_totalCounterTotal number of raw network bytes sent.
component_errors_totalCounterTotal number of errors encountered during processing.

Events🔗

NameDescription
ComponentErrorEmitted when an error occurs during component execution.
ComponentEventsDroppedEmitted when events are intentionally or unintentionally dropped.

Example🔗

sinks:
  my_flight_sql:
    type: flight_sql
    inputs: ["my_transform"]
    endpoint: http://localhost:32010
    table_name: events
    setup_commands: ["SET proxy = 'my-proxy'"]