SAP Knowledge Base Article - Public

3715212 - Datasphere: in Replication Flow, cloud storage provider sources shows only folders and not files

Symptom

In Datasphere, you are using an cloud storage provider source as the source of a Replication Flow.

This could be an SFTP source, ADLS source, etc.

Suppose that your folder structure in the cloud storage provider is as follows:

- folder 1

--> subfolder 2

--> --> file 1

--> --> file 2

That is, the files are located inside subfolder 2.

In the Replication Flow, you add the cloud storage provider source, and you navigate to subfolder 2, and you don't see the files.

You find that, if you use a Data Flow, you see the files.

Environment

  • SAP Datasphere

Reproducing the Issue

  • Create new Replication Flow
  • Add a cloud storage provider as source

Cause

Replication Flows work differently than Data Flows.

See this help page which is specific to Replication Flows:  Add the Source for a Replication Flow | SAP Help Portal 

It mentions: "For cloud storage providers, the container is the folder that contains the relevant dataset folders."

That means that the Container is the folder, that contains the subfolder, that contains the files.

Resolution

Therefore, with the folder structure that we mentioned before:

- folder 1

--> subfolder 2

--> --> file 1

--> --> file 2

If you want to access those files as sources, you need to select:

- 'folder 1' as Container

- 'subfolder 2' as Source Object

When done this way, you will be able to find the files within that Source Object.

See Also

Add the Source for a Replication Flow | SAP Help Portal 

Keywords

KBA , DS-DI-RF , Replication Flow Runtime , How To

Product

SAP Datasphere all versions