Wrapper for OTel-aware aggregate transform with common pipeline fields.

Otel Aggregate🔗

Wrapper for OTel-aware aggregate transform with common pipeline fields.

Configuration🔗

FieldTypeRequiredDefaultDescription
inputs[string]yesList of upstream component names to receive events from.
error_policyErrorPolicynodrop_on_errorPolicy for handling events that cause errors during aggregation.
aggregationOtelAggregationyesType of aggregation (metrics or traces).
window_durationstringyesWindow duration (e.g., "15s", "60s", "5m").
naming_conventionNamingConvention (optional)noNaming convention for output metrics.
otel_schema_versionstring (optional)no1.0OTel schema version to use.
memory_limitstring (optional)no1GBDuckDB memory limit (e.g., "8GB").
temp_directoryfile path (optional)noDirectory for DuckDB temporary files (spill-to-disk).
outputs{string: string}noNamed output labels for forking the transform output.

Telemetry🔗

This component emits the following standard telemetry metrics and events.

Metrics🔗

NameTypeDescription
component_received_events_totalCounterTotal number of events received from upstream.
component_sent_events_totalCounterTotal number of events sent downstream.
component_errors_totalCounterTotal number of errors encountered during processing.

Events🔗

NameDescription
ComponentErrorEmitted when an error occurs during component execution.
ComponentEventsDroppedEmitted when events are intentionally or unintentionally dropped.

Example🔗

transforms:
  my_otel_aggregate:
    type: otel_aggregate
    inputs: # required
    aggregation: metrics
    window_duration: 60s
    naming_convention: prometheus
    otel_schema_version: 1.0
    memory_limit: 8GB
    temp_directory: /var/tmp/kinetic
    outputs: {"errors": "error_branch"}