Skip to main content

EventMetadata

Struct EventMetadata 

Source
pub struct EventMetadata {
    pub batch_id: Uuid,
    pub pipeline_id: String,
    pub source_time: Option<SystemTime>,
    pub ingestion_time: SystemTime,
    pub source_id: ComponentId,
    pub upstream_id: Option<OutputId>,
    pub tenant_profile: Option<String>,
}
Expand description

Core metadata attached to every batch of events flowing through the pipeline.

This is wrapped in an Arc when attached to an EventBatch to ensure cheap cloning during fanout operations.

Fields§

§batch_id: Uuid

A globally unique identifier for this specific batch. Used for end-to-end tracing of data flow.

§pipeline_id: String

The ID of the pipeline this batch belongs to.

§source_time: Option<SystemTime>

The time the data was originally generated at the source (if known). For example, the S3 object last-modified time, or Kafka message timestamp.

§ingestion_time: SystemTime

The time the data was ingested by Kinetic’s source component.

§source_id: ComponentId

The component that originally produced this batch.

§upstream_id: Option<OutputId>

The specific output of the component that produced this batch. This is None until the batch actually leaves a source or transform.

§tenant_profile: Option<String>

Optional tenant profile name. Used primarily by multi-tenant sources like the OTLP source to tag which tenant generated the data.

Implementations§

Source§

impl EventMetadata

Source

pub fn new(pipeline_id: impl Into<String>, source_id: ComponentId) -> Self

Creates a new EventMetadata with a random UUID and current ingestion time.

Source

pub fn with_source_time(self, time: SystemTime) -> Self

Sets the source time (e.g., from external metadata).

Source

pub fn with_tenant_profile(self, profile: impl Into<String>) -> Self

Sets the tenant profile.

Source

pub fn with_upstream_id(self, upstream_id: OutputId) -> Self

Sets the upstream output ID. This is typically called by a component just before sending the batch to the next component.

Trait Implementations§

Source§

impl Clone for EventMetadata

Source§

fn clone(&self) -> EventMetadata

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for EventMetadata

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<'de> Deserialize<'de> for EventMetadata

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl PartialEq for EventMetadata

Source§

fn eq(&self, other: &EventMetadata) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl Serialize for EventMetadata

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for EventMetadata

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

impl<T> Allocation for T
where T: RefUnwindSafe + Send + Sync,

Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,