Skip to main content

Live Data

Live Data captures pipeline messages at configurable processing stages, enabling real-time observation of data as it flows through the telemetry pipeline. Use it to verify data transformations, diagnose routing issues, and inspect message content at specific points in the processing chain.

Availability

Live Data is available from the detail pages of the following components:

ComponentNavigation Path
DirectorFleet Management > Directors > Director detail > Live Data tab
ClusterFleet Management > Directors > Cluster detail > Live Data tab
DeviceFleet Management > Devices > Device detail > Live Data tab
TargetFleet Management > Targets > Target detail > Live Data tab
Advanced RouteRoutes > Advanced > Route detail > Live Data step

The Pipeline Debugger also supports Live Data as a dataset provider, allowing you to capture live pipeline messages for use as debug input.

Using Live Data

The Live Data panel follows the same control pattern as Console Logs:

  1. Configure capture parameters using the Filter button — select a capture location and set time/count limits
  2. Click Capture to begin streaming
  3. Messages appear in the output area as they are captured
  4. Use the query input field to filter captured data
  5. Click Stop to end capture, or wait for the capture time to elapse
  6. Click the Copy button to copy captured output to the clipboard
  7. Click Clean to clear the output and reset to idle state

Capture stops automatically when either the capture time or the capture count limit is reached, whichever occurs first.

Filter Options

Click the Filter button to configure capture parameters:

OptionTypeRangeDefaultDescription
Capture locationDropdownContext-dependentSee belowPipeline stage at which to capture data
Capture timeNumber5–60 seconds10Maximum duration of the capture session
Capture countNumber100–5,000 events1,000Maximum number of messages to capture

Click Apply to save filter settings, or Cancel to discard changes.

Capture Locations

The capture location determines at which pipeline stage messages are intercepted. Available locations depend on the component context.

Director, Cluster, Device, and Target

LocationDescription
Before pre-processingRaw data as received, before any pre-processing pipeline executes
After pre-processingData after pre-processing pipeline execution
Before post-processingData before post-processing pipeline executes (default)
After post-processingFinal data after all post-processing, as delivered to the target

Advanced Route

LocationDescription
Before routeData as it enters the route, before route processing (default)
After routeData after route processing completes

Source Filtering

The component context determines which data is visible during capture:

  • Director — Captures all data flowing through the Director instance across all devices, targets, and routes
  • Cluster — Captures all data flowing through the Cluster
  • Device — Captures only data originating from that specific device
  • Target — Captures only data destined for that specific target
  • Advanced Route — Captures only data flowing through that specific route

Prerequisites

Live Data requires the component to be enabled and have an active data path. When conditions are not met, the panel displays a context-specific alert:

ComponentEnabled ConditionConnected Condition
DirectorDirector must be enabledDirector must be connected
ClusterCluster must be enabledCluster must be connected
DeviceDevice must be enabledAt least one associated Director must be connected
TargetTarget must be enabledAt least one route must be sending data to the target
Advanced RouteRoute must be enabledAt least one associated Director must be connected