After a pipeline has run, you can inspect the details of each execution to verify its status and download the associated data files. This allows a direct way to confirm what data was fetched from the source and what data was sent to the target.

How to View Execution Data

  1. Navigate to Pipelines: From the main sidebar, go to the Pipelines page.
  2. Select a Pipeline: Find the pipeline you wish to inspect in the list. Click the three vertical dots on the far right of its row and select View Executions.
  3. Choose an Execution: You will see a list of all the times that pipeline has run. Click on any execution in the log to view its specific details. Optionally: Download Event Files: On the execution detail page, you will see the Event Files section. From here, you can download the raw and translated data files.

Understanding the Event Files

For each successful run, two key files are available for download. Understanding the difference is essential for validating and troubleshooting your data flow.

This file contains the unaltered, raw data exactly as it was received from the source integration.

  • Purpose: Use this file to confirm what data the source system provided at the time of the execution. It is your ground truth for what IMSURGE received before any processing.
  • Use Case: If you suspect an issue with the source device or API, start by examining this file to see the original payload.

This file contains the parsed and transformed data that was sent to the target integration.

  • Purpose: This file shows you the final, clean data after IMSURGE has applied its logic. This can include dropping columns with empty values or formatting data to meet the requirements of the target system.
  • Use Case: Use this file to verify that the data arriving in your target platform is correctly formatted and matches what you expect. If data is missing in your target system, check this file to see if it was filtered out during the translation step.