Skip to main content

Event model

Imply Lumi is an observability platform to store and query event data, such as log messages, HTTP request data, and system errors.

Before an event arrives in Imply Lumi, forwarding agents or other data processing mechanisms typically transform the data from its raw state. For example, a forwarder may add metadata to the event or extract field values like the timestamp. Before storing an event, Imply Lumi also performs similar event data processing tasks. See Event lifecycle for details.

This topic describes event data as stored in Imply Lumi after all data processing is complete.

Event components

Each event consists of a timestamp, a message, system attributes, and user attributes.

The event timestamp records the exact time an event occurred. For example: Mar 21, 11:54:53.120 AM.

The message consists of the event text. For example, the text of the following HTTP server access log:

11.44.142.49 - - [25/Mar/2025:19:23:38 ] "GET /logout HTTP/1.1" 200 2326 "https://www.forbes.com/" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)"

System attributes

Imply Lumi defines and sets the semantics of system attributes. System attributes apply universally across all events and can only be accessed within Imply Lumi. Usually, Imply Lumi extracts system attributes from a system component such as the event collector, a receiver, or an IAM key.

System attributes contain a subset of global attributes, env and team, which you can specify when configuring an IAM key. Global attributes are associated with the IAM key used to report the event. You can set global attributes to any string value that is fewer than 32 characters.

The following table lists the system attributes that Imply Lumi may assign to an event:

AttributeTypeDescriptionNullableExample
collectorstringVersion of the Imply Lumi event collector that accepted the event. Used for troubleshooting.Noec 20250504.1234.0
envstringEnvironment associated with the event. Defaults to Unknown.Yesstaging
eventIdstringUnique identifier for the event.Noa_bcNdW7-0000-10111
filestringName of the file from which the event was ingested, if applicable.Yeslumina_visitors.csv
iamKeyIdstringIAM key or user ID used to ingest the event.No9da461cb-xxxx-xxxx-xxxx-158eb31bf048
observedAttimestampTimestamp when the Imply event collector observed the event. This may differ from the event's original timestamp due to buffering or when events have been backfilled.NoMar 21, 10:09:03.772 AM
receiverstringType of receiver that collected the event.Noevent-collector
statusenumStatus or severity of the event, as detected or set at ingestion time. Imply Lumi evaluates incoming events for specific attributes, including status, severity, level, syslog.severity, and response. If detected, Imply Lumi maps the value to an event status using HTTP status code categories and syslog severity levels. Supported enum values: debug, info, notice, warning, error, critical, alert, emergency, ok.Yesinfo
teamstringTeam associated with the event. Defaults to Unassigned.Yesbackend

User attributes

User attributes provide context to an event, such as its source and source type. User attributes can also come from information parsed from raw events or added by pipelines. You can view and search user attributes in Imply Lumi and other integrated systems.

User attribute values can be defined at various stages in the event lifecycle:

  1. On a raw event—for example, using HTTP POST requests as shown in Send events with HEC.
  2. On an upstream agent, such as the Splunk® distribution of the OpenTelemetry (OTel) collector.
  3. On an IAM key in Imply Lumi, where integration attributes are assigned as user attributes.
  4. On a pipeline in Imply Lumi, where you can map, add, or remove attributes.

Imply Lumi prioritizes the values for user attributes as follows:

  1. values set by pipelines
  2. values set on a raw event or by an upstream agent
  3. values set by an IAM key.

The following attributes are set based upon the IAM key or user configuration for file upload. Note that you can also use a pipeline to set the value for these attributes.

AttributeTypeDescriptionIntegrationExamples
sourcestringOrigin of the events sent to Imply Lumi.HEC, file uploadotel, lumina_visitors.csv
sourcetypestringType of event data.HEC, file uploadaccess_combined, httpevent
indexstringRepository for incoming events.HECmain
indexAllowListstringComma-separated list of allowed values for the index field.HECmain, demo

For default values, see the documentation for the corresponding application.

Filter by attributes

You can use system and user attributes to filter search results or view resource usage. For details about searching events, see Search for events with Imply Lumi.

Search system attributes

To filter events by a system attribute, add a search condition and preface the attribute name with #. You can include multiple system attributes in the search. For example, search for all events whose status is info:

#status=info

Search user attributes

To filter events by a user attribute, add a search condition with the attribute name. For example, search for events where the index is main and the source type is not otel:

index=main sourcetype!=otel

View resource usage

You can view resource usage grouped by the environment, team, or index attributes. View the resource usage for these attributes in the Usage sub-page of the Billing section. For more information about billing and usage, see Monitor account usage.

Learn more

See the following topics for more information: