Symptom
In Datasphere, you are using an cloud storage provider source as the source of a Replication Flow.
This could be an SFTP source, ADLS source, etc.
Suppose that your folder structure in the cloud storage provider is as follows:
- folder 1
--> subfolder 2
--> --> file 1
--> --> file 2
That is, the files are located inside subfolder 2.
In the Replication Flow, you add the cloud storage provider source, and you navigate to subfolder 2, and you don't see the files.
You find that, if you use a Data Flow, you see the files.
Environment
- SAP Datasphere
Reproducing the Issue
- Create new Replication Flow
- Add a cloud storage provider as source
Cause
Replication Flows work differently than Data Flows.
See this help page which is specific to Replication Flows: Add the Source for a Replication Flow | SAP Help Portal
It mentions: "For cloud storage providers, the container is the folder that contains the relevant dataset folders."
That means that the Container is the folder, that contains the subfolder, that contains the files.
Resolution
Therefore, with the folder structure that we mentioned before:
- folder 1
--> subfolder 2
--> --> file 1
--> --> file 2
If you want to access those files as sources, you need to select:
- 'folder 1' as Container
- 'subfolder 2' as Source Object
When done this way, you will be able to find the files within that Source Object.
See Also
Keywords
KBA , DS-DI-RF , Replication Flow Runtime , How To
SAP Knowledge Base Article - Public