SAP Knowledge Base Article - Public

3409789 - Missing records when replicating real-time data from SAC to SAP Datasphere

Symptom

In a real-time replication using CloudDataIntegrationAdapter (CDIAdapter), missing records are identified in SAP Datasphere.

This is relevant for SAC (SAP Analytics Cloud) which uses Data Provisioning Agent (DPAgent) CDI adapter.

Environment

SAP Datasphere 

Reproducing the Issue

Real-time replication which uses DPAgent's CloudDataIntegrationAdapter to load delta loads from source into SAP Datasphere.

Cause

DPAgent bug in CDI Adapter.

When there is a delete record and a insert record of the same entity occur in a short time, both will exist in the same delta link provided by CDI source side.
DPAgent CDI Adapter has limitation/issue to handle such scenarios, it will always send insert records before deleted records, so the missing records actually are been deleted. 

Resolution

Issue fixed in Data Provisioning Agent Version 2.7.3.

Workaround: snapshot replication or avoid delete and insert in short time.

See Also

Community Blog Post SAP Datasphere – SAP Data Provisioning Agent Upgrade

Keywords

synchronization, SAC, reporting, planning, DP Agent, CDI, Cloud Data Integration,  , KBA , DS-DI-RT , Remote Tables , DS-DI , Data Integration/Data Builder , DS-DI-CON , Connections , HAN-DP-SDI-DS , SAP Datasphere specific SDI issues , Known Error

Product

SAP Analytics Cloud all versions ; SAP Datasphere all versions