3725952 - Differences in record counts between System Monitor and Data Integration Monitor in SAP Datasphere

In SAP Datasphere, users may notice that the record count displayed for Task Chains in the System Monitor differs from the record count shown in the Data Integration Monitor.

The discrepancy causes questions regarding which operations are included in each monitor.

It is unclear whether the System Monitor count includes read operations, since the Data Integration Monitor only shows written/affected records.

SAP Datasphere

The difference in record counts between the two monitors is expected behavior due to how each tool calculates processed records:

System Monitor (Task Chains):

• Displays the total number of processed records during task execution.
• This includes read, write, update, and delete operations performed by the tasks.
• Therefore, the count can appear higher than in the Data Integration Monitor.

Data Integration Monitor:

• Primarily displays the number of records written or affected in the target objects.
• Read counts are not displayed in the UI, so it shows only a subset of the total operations.

The discrepancy is not a product issue; it reflects the different purposes of the two monitors.

The difference in record counts between the System Monitor and the Data Integration Monitor in Datasphere is expected.

In the System Monitor (Task Chains), the displayed record count represents the total number of processed records during execution, which can include read, write, update, and delete operations performed during the task execution.

In contrast, the Data Integration Monitor mainly displays the number of records written to or affected in the target object and does not expose read counts in the UI. Because the System Monitor includes additional processing statistics such as read operations, its record count can therefore appear higher than the one shown in the Data Integration Monitor.

To verify the actual processing statistics in more detail, you can query the task execution logs directly in the underlying HANA database. For example, using the SQL Console in the space where the task chain runs, you can query system log tables that store task execution metrics (such as task run logs and operator statistics) to retrieve counts for records read, written, updated, or deleted for a specific task execution.

These SQL level statistics provide the most accurate breakdown of the real processed record counts and can be used to reconcile the numbers shown in both monitoring tools.

DWC, Datasphere, System Monitor, Data Integration Monitor, Record, Count, Processed, Records , KBA , DS-DI-SCH , Scheduling and Task Chains , Problem