SAP Knowledge Base Article - Public

2850313 - Unable to generate more than four million rows from SAP Analytics Cloud with multiple CSV files

Symptom

  • Create a model based on just two parts, each part has only 1.1GB and four million rows each
  • The first load is working fine.  It will bring all the four million rows but after uploading the second one with another 1.1GB 4 million, in Data management, click the file in the Draft Sources, After mapping, in Import method choose Append and Existing version, Click Finish mapping and proceed to finish the procedure than it will only bring 2000 rows

Environment

  • SAP Analytics Cloud
  • CSV

Reproducing the Issue

  1. Divide a big file into several ~1GB 4 million rows parts in the CSV format.
  2. Go to Create -> Model -> Import a file from your computer
  3. After uploading the first part, finish creating the model by clicking in Create (you will see the 4 million in the Data Timeline)
  4. Go to Data Management of the recently created model
  5. Go to Import Data -> File -> choose the next part with 4 million rows (1 GB)
  6. After uploading, in Data management, click the file in the Draft Sources
  7. After mapping, in Import method choose Append and Existing version
  8. Click Finish mapping and proceed to finish the procedure.
  9. On the Data management, in the Status and under Import jobs, it is going to show that the file has been uploaded two times, with different amount of lines than the expected (We only see 2000 rows instead of the next 4 million).    

Cause

  • The number of rows in the uploaded csv file is too large.

Resolution

Workaround 1:

  1. Upload the first csv file (part1) to a file server.
  2. Create the model using the first file from the file server: upon creation this will give you an import job which you can manually trigger later.
  3. Change the Import Settings of the import job to append.
  4. Replace the file on the file server with the file containing the next part of data (part2).
  5. Manually refresh the import job on the model: this will append the data from the next file to the original model.
  6. Repeat steps 3 to 4 until you're done with all the files (part3, part4, etc).

Workaround 2:

  1. Upload the first csv file (part1) to google drive.
  2. Create the model using the first file.
  3. Change the Import Settings of the import job to append.
  4. Rename the second file to part1 on your local system and then upload it to google drive.
  5. Manually refresh the import job on the model.
  6. Repeat steps 4 to 5 until you're done with all the files (part3, part4, etc).

Workaround 3:

  • Break down the original file to even smaller files (1 million rows each) and then do the import. In other words import 1 million rows at a time.

See Also

Your feedback is important to help us improve our knowledge base.

Keywords

SAP Cloud for Planning, sc4p, c4p, cforp, cloudforplanning, Cloud for Analytics, Cloud4Analytics, CloudforAnalytics, Cloud 4 Planning, BOC, SAPBusinessObjectsCloud, BusinessObjectsCloud, BOBJcloud, BOCloud., SAC, SAP AC, Cloud-Analytics, CloudAnalytics, SAPCloudAnalytics,Error, Issue, System, Data, User, Unable, Access, Connection, Sac, Connector, Live, Acquisition, Up, Set, setup, Model, BW, Connect, Story, Tenant, Import, Failed, Using, Working, SAML, SSO , KBA , LOD-ANA-AQU , Import Data Connections (Acquiring Data) , Problem

Product

SAP Analytics Cloud 1.0