3086860 - Best Practices when using SFTP as the Source type for Scheduled Integration (Scheduled Inbound Integration)

Best Practices when using SFTP as the Source type for Scheduled Integration (Scheduled Inbound Integration).

• SAP SuccessFactors HXM Suite
  • Integration Centre

Do not exceed 50K- 80K records in each input file placed on SFTP.

Number of input fields should not exceed 10-20 fields.

We also have more details in our Integration Center Frequent Ask Questions KBA:

Q1. What are the recommendations on Integration Center size for file loads? 

Answer: Find below the guidelines shared by SF engineering and product management colleagues:

• We always recommend going with lower records size. Please always prefer delta load over full load wherever possible. 
• Always consider splitting jobs with very high number of records to be processed ( which are typically long running) into  multiple smaller jobs.
• If higher number of records is inevitable  ( see points mentioned earlier ), then for higher number of records, our recommendation is not to exceed 50k-80k records with 10-20 fields. If the number of fields increases, the number of records may need to be reduced.
• The above figures depends on a number of parameters for e.g. number of jobs getting executed at that time on the server, the complexity of the DB query, the memory consumption of the servers, hence this should be taken as a general guideline, recommendation is  to split the jobs wherever possible.

Q2. What is the maximum time one Integration center job will run?

Answer: Prior to 2H 2023, if any job ran for more than 23 hours it would be automatically interrupted.
Post 2H 2023, we reduced the threshold limit of jobs running in Integration Center to 10 hours. After reaching the threshold limit, the integration jobs are auto terminated and you can view the logs in Execution Manager. This guardrail has been added to improve the performance of the system.

This is an expected behavior of Integration center.

Q3. Why are my jobs failing to post to the relevant SFTP folder?

Answer. If you have multiple jobs simultaneously attempting to access the same SFTP server/folder this can result in job failures due to connection issues.
You may receive a similar error to: 'This session would exceed your concurrent session limit. Please disconnect one or more of your existing sessions and try again.'
You will need to reschedule jobs for different times to avoid conflicts.

Inbound Integration, ODATA Upsert, SFTP, CSV import, Integration Center, IC, 10 hours, 23 hours, guardrails, guardrail, 2h 2023, release, 2311, KEA, production, preview, INT-15502, This session would exceed your concurrent session limit , KBA , LOD-SF-INT-INC-FWK , Integration Center UI Framework , Problem