2922501 - Out of Memory issues in the PI system due to large processing of SFTP files

You are using the SFTP Adapter Sender channel in your Process Integration system to poll files from a SFTP server, and you notice that intermittently your system goes down.

Checking the dev_server files in the workfolder, you can see that the system stopped due to an OOM. While analyzing the OOM.hprof file created, you can see that most of the heap size was being occupied by the SFTP Adapter, and some thread similar to this:

Server process shutting down with exit code [666]; memory allocation error [OutOfMemoryError]java.lang.OutOfMemoryError
at java.io.ByteArrayOutputStream.hugeCapacity(ByteArrayOutputStream.java:123)
at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:117)
at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:153)
at com.sap.aii.adapter.sftp.ra.rar.integration.sftp.SSHConnection.get(SSHConnection.java:281)
at com.sap.aii.adapter.sftp.ra.rar.jca.SFTP2XI.sftpConnection(SFTP2XI.java:700)
at com.sap.aii.adapter.sftp.ra.rar.jca.SFTP2XI.invoke(SFTP2XI.java:234)
at com.sap.aii.af.lib.scheduler.JobBroker$Worker.run(JobBroker.java:529)

• SAP Process Integration
• SAP Process Integration, security connectivity add-on

SFTP, OOM, Memory, Heap, Dump, CSV, XML, File, Large, Message, 666, Conversion, Handling, Process Integration 7.0, PI 7.0, PI 7.01, PI 7.02, Process Integration 7.10, PI 7.10, Process Integration 7.11, PI 7.11, Process Integration 7.30, PI 7.30, Process Integration 7.31, PI 7.31, Process Orchestration 7.4, PI 7.4, PO 7.4, Process Orchestration 7.5, PI 7.5, PO 7.5 , KBA , BC-XI-CON-SFT , Secure File Transfer Protocol Adapter , Problem