Reads events from a Google Cloud Pub/Sub subscription.

Gcp Pubsub🔗

Reads events from a Google Cloud Pub/Sub subscription.

Configuration🔗

FieldTypeRequiredDefaultDescription
decodingDecoderConfigEnum (optional)noOptional decoder configuration for input events.
authGcpConfig (optional)noGCP authentication and project settings.
  project_idstring (optional)yesGCP Project ID.
  credentials_filestring (optional)noPath to a Service Account JSON key file. If not provided, Application Default Credentials (ADC) will be used.
  credentials_jsonstring (optional)noRaw Service Account JSON key content. If not provided, credentials_file or ADC will be used. (sensitive)
topicstringyesPub/Sub topic name.
subscriptionstring (optional)noPub/Sub subscription name (required for sources).
dead_letter_topicstring (optional)noDead Letter Topic name.
enable_message_orderingbooleannoWhether to enable message ordering.
ordering_key_fieldstring (optional)noField name to use as the ordering key.

Telemetry🔗

This component emits the following standard telemetry metrics and events.

Metrics🔗

NameTypeDescription
component_received_events_totalCounterTotal number of Kinetic events created by this source.
component_received_event_bytes_totalCounterTotal estimated byte size of events created.
component_received_network_bytes_totalCounterTotal number of raw network bytes received.
component_errors_totalCounterTotal number of errors encountered during processing.

Events🔗

NameDescription
ComponentErrorEmitted when an error occurs during component execution.
ComponentEventsDroppedEmitted when events are intentionally or unintentionally dropped.

Example🔗

sources:
  my_gcp_pubsub:
    type: gcp_pubsub
    auth:
      project_id: my-gcp-project
      credentials_file: /secrets/gcp-sa.json
    topic: my-topic
    subscription: my-subscription
    dead_letter_topic: my-dead-letter-topic
    ordering_key_field: trace_id