SAP Knowledge Base Article - Public

2732744 - Data Limit for Cloud Data Source Upload with Web Services

Symptom

You are looking to upload Cloud Data Sources into the system via Web Service (e.g. OData or SOAP). However you are unable to upload high amount of data, like 1 million records or more.

Environment

  • SAP Cloud for Customer
  • SAP Business ByDesign

Reproducing the Issue

  1. Include the created Cloud Data Source into your UI service (e.g. SOAP ui).
  2. Generate the Web Service request to upload the data.
  3. Execute the request in UI level (e.g. SOAP ui).
  4. The data source is not uploaded.

Cause

You have exceeded the limit of 100,000 records and/or 150 columns in your data source.

Resolution

The data upload process must respect the restriction of 100,000 records and 150 columns per upload, but the upload can be called several times. Please note that if you send multiple requests, you will need to wait until the first request is completed before you send the next. You can check the status of the request here:

  1. Go to the work center Business Analytics, and the view Design Data Sources.
  2. Search for your cloud data source and select it.
  3. Click View Logs.

Here you should see a successful delivery or an error, before you send the next request.

Please note: A cloud data source can only hold up to 5 million records in total.

To store more data than the allowed limit should be resolved by creating PDI BOs by the customers. Storing data in PDI BOs & then creating basic data sources in PDI is a lot more performant than storing data in cloud data sources.

Furthermore, it is strongly recommended to apply business relevant restrictions to limit the data in the report presented, so that the report does not result in time-out issues due to too much data processed in a single run.

See Also

Related KBA: 2539996 - Error in Cloud Data Source - Restriction on Number of Fields

You should ensure the protocol defined in the Communication System of Cloud for Customer is selected as Web Services. Also, make sure end point URL to which you are sending request from SOAPui or via any middleware into C4C inbound service then it should have MessageID generated.

Further info can be found in the following blogs:

- Upload Using a Web Service

- Common Issues with Integration

Keywords

Web Service Upload; Upload Issues; CDS Upload; Data Limit; Cloud Data Source; Data Source Upload; Upload Restrictions; Web Service Limit; Cannot Upload Data Source , KBA , AP-RC-ANA , C4C, ByD, Travel: Analytics Tools & Frameworks , How To

Product

SAP Business ByDesign all versions ; SAP Cloud for Customer add-ins all versions ; SAP Cloud for Customer core applications all versions