Data pull is a data capture method where IMSURGE reaches out to a source system and collects data from it.

For data pull integrations, pipelines usually run on a polling frequency. At each scheduled execution, IMSURGE contacts the source system, requests new data, processes the response, and sends the standardized data through the pipeline.

Polling Frequency

A polling frequency controls how often IMSURGE checks the source system for new data.

The right polling frequency depends on the source system, how often the sensor or service updates, and any limits enforced by the vendor. Polling more often than the source data updates can create repeated empty runs or duplicate live readings.

Always check the integration’s documentation for the recommended polling rate.

Historical Data

Many data pull integrations can collect recent historical data when they run manually or when a pipeline is first created.

The available history depends on the source integration. Current source integration documentation lists the supported backtrack window where manual execution is available.