Creating a Pipeline

Use this page as a quick reference for creating a new pipeline. For a more detailed, step-by-step tutorial, please see the Quickstart guide.

Workflow Diagram link

flowchart TD
    SelectSource([1. Select Source Integration])
    SelectTarget([2. Select Target Integration])
    Schedule([3. Set Schedule, Name & Health])
    Save([4. Save & Run])
    SelectSource --> SelectTarget --> Schedule --> Save
        

Quick Steps link

1. Choose a Source: Navigate to the Pipelines page and click + Pipeline. Select the source integration (e.g., Aeroqual, NOAA) that will provide the data.

2. Choose a Target: Select the target integration (e.g., iTwn, Sensemetrics) that will receive the data.

3. Set the Schedule, Name & Health:

   • Polling Rate: Define how often the pipeline runs (e.g., every 15 minutes, every hour).
   • Backtrack: Set the initial backtrack window (up to seven days) to fetch historical data on the first run.
   • Name: Give the pipeline a descriptive name for easy identification (e.g., Aeroqual Site A → iTwin IoT Project B).
   • Flag Errored: Choose how many consecutive failed executions mark the pipeline Errored, or disable this condition.
   • Flag Stale: Choose how long the pipeline can go without a successful execution before it is marked Stale, or disable this condition.
   • Pause Stale Timer on Weekends: Optionally exclude weekend time based on the organization’s configured timezone.

4. Save and Run: Save the pipeline. The first execution will be queued to run immediately to pull your initial historical data. Subsequent runs will follow the schedule you defined.

Reference link

Related Guides link

• Quickstart
• What is a Pipeline?
• Polling Rates
• Pipeline Health