2616383 - RFC client connections - Message delivery delay from SAP PI to SAP ECC

There is a delay in message delivery from SAP PI to SAP ECC between specific time duration. Messages have been in 'Delivering' status for a while. Triggered thread dumps (according to SAP Note: 1095473) shows hanging threads with the following stack trace:

[...]
"output" cpu=86659.89 [reset 22045.35] ms elapsed=71467.95 [reset 42396.96] s allocated=4597509888 B (4.28 GB) [reset 1762576 B (1.68 MB)] defined_classes=21 io= file i/o: 55342/52736 B, net i/o: 1897281/12420786 B, files opened:92, socks opened:-90 [reset file i/o: 32/0 B, net i/o: 1711/8765 B, files opened:7, socks opened:0 ] user="<XXXX>" application="sap.com/com.sap.aii.adapter.idoc.app" isapplicationthread="true" prio=6 tid=0x000000013e5dc000 nid=0x2060257 /33948247 pthread-id=93354 runnable [_thread_blocked (_at_safepoint), stack(0x000000014a50a888,0x000000014a70a888)] [0x000000014a704000]
 java.lang.Thread.State: RUNNABLE
at com.sap.conn.rfc.driver.CpicDriver.nativeCpic_coxread([BI[B[I)I(Native Method)
at com.sap.conn.rfc.driver.CpicDriver.cpic_coxread(I[B[I)I(CpicDriver.java:601)
at com.sap.conn.rfc.driver.CpicDriver.coxread([BI[II)I(CpicDriver.java:174)
at com.sap.conn.rfc.driver.RfcTypeDirectCpic.read([BI[I)I(RfcTypeDirectCpic.java:56)
- locked <0x00000003982e7500> (a com.sap.conn.rfc.driver.RfcTypeDirectCpic)
at com.sap.conn.rfc.engine.RfcIoOpenCntl.ab_rfcread([BII)I(RfcIoOpenCntl.java:663)
at com.sap.conn.rfc.engine.RfcGet.rfcget_gethead(Lcom/sap/conn/rfc/engine/RfcIoOpenCntl;[B)V(RfcGet.java:455)
at com.sap.conn.rfc.engine.RfcGet.ab_rfcget(Lcom/sap/conn/rfc/engine/RfcIoOpenCntl;Lcom/sap/conn/rfc/engine/RfcGet$RfcGetState;Lcom/sa p /conn/rfc/engine/RfcGetInfo;)I(RfcGet.java:35)
at com.sap.conn.rfc.engine.RfcRcv.ab_rfcreceive(Lcom/sap/conn/rfc/engine/RfcIoOpenCntl;[Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sap/ c onn/rfc/api/IRfcParameter;[Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sap/conn/rfc/api/IRfcTable;Lcom/sap/conn/jco/JCoRepository;)V( R fcRcv.java:33)
at com.sap.conn.rfc.engine.RfcIoOpenCntl.RfcReceive([Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sa p /conn/rfc/api/IRfcTable;Lcom/sap/conn/jco/JCoRepository;)V(RfcIoOpenCntl.java:1982)
at com.sap.conn.rfc.engine.RfcIoOpenCntl.RfcCallReceive(Ljava/lang/String;[Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sap/conn/rfc/api/ I RfcParameter;[Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sap/conn/rfc/api/IRfcTable;Lcom/sap/conn/jco/AbapClassException$Mode;Lcom/s a p/conn/jco/JCoRepository;)V(RfcIoOpenCntl.java:2120)
at com.sap.conn.rfc.engine.TRfc.rfcQueueInsert(Lcom/sap/conn/rfc/engine/RfcIoOpenCntl;Ljava/lang/String;[Lcom/sap/conn/rfc/api/IRfcPar a meter;[Lcom/sap/conn/rfc/api/IRfcTable;Ljava/lang/String;Ljava/lang/String;ZLcom/sap/conn/jco/AbapClassException$Mode;)V(TRfc.java: 9 2)
at com.sap.conn.rfc.engine.RfcIoOpenCntl.RfcQueueInsert(Ljava/lang/String;[Lcom/sap/conn/rfc/api/IRfcParameter;[Lcom/sap/conn/rfc/api/ I RfcTable;Ljava/lang/String;Ljava/lang/String;ZLcom/sap/conn/jco/AbapClassException$Mode;)V(RfcIoOpenCntl.java:2193)
at com.sap.conn.jco.rt.MiddlewareJavaRfc$JavaRfcClient.execute(Lcom/sap/conn/jco/rt/ClientConnection;Ljava/lang/String;Lcom/sap/conn/j c o/rt/DefaultParameterList;Lcom/sap/conn/jco/rt/DefaultParameterList;Lcom/sap/conn/jco/rt/DefaultParameterList;Lcom/sap/conn/jco/rt/ D efaultParameterList;ZLcom/sap/conn/jco/AbapClassException$Mode;)V(MiddlewareJavaRfc.java:1730)
at com.sap.conn.jco.rt.ClientConnection.execute(Ljava/lang/String;Lcom/sap/conn/jco/rt/DefaultParameterList;Lcom/sap/conn/jco/rt/Defau l tParameterList;Lcom/sap/conn/jco/rt/DefaultParameterList;Lcom/sap/conn/jco/rt/DefaultParameterList;ZLcom/sap/conn/jco/AbapClassExce p tion$Mode;)V(ClientConnection.java:1102)
at com.sap.conn.jco.rt.ClientConnection.execute(Lcom/sap/conn/jco/JCoFunction;Ljava/lang/String;Ljava/lang/String;Lcom/sap/conn/jco/JC o Repository;)V(ClientConnection.java:935)
at com.sap.mw.jco.jra.JRA$ClientProxy.execute(Lcom/sap/conn/jco/JCoFunction;Ljava/lang/String;Ljava/lang/String;)V(JRA.java:12573)
at com.sap.mw.jco.jra.JRA$MessageHandler.executeFunction(Lcom/sap/mw/jco/jra/JRA$ClientProxy;Lcom/sap/conn/jco/JCoFunction;Ljava/lang/ S tring;Ljava/lang/String;)V(JRA.java:13005)
at com.sap.mw.jco.jra.idoc.JRAIDocExtension$IDocMessageHandler.execute(Lcom/sap/mw/jco/jra/JRA$ClientProxy;Ljavax/resource/cci/Record; L java/lang/String;Ljava/lang/String;)V(JRAIDocExtension.java:71)
at com.sap.mw.jco.jra.JRA$InteractionImpl.execute(Ljavax/resource/cci/InteractionSpec;Ljavax/resource/cci/Record;)Ljavax/resource/cci/ R ecord;(JRA.java:6585)
 - locked <0x0000000399abad78> (a java.util.Vector)
at com.sap.aii.af.idoc.outbound.IDocOutboundProcessor.processXIMessage(Lcom/sap/engine/interfaces/messaging/api/Message;Ljava/lang/Str i ng;ZLcom/sap/aii/af/idoc/util/IDocBulk;)Ljava/util/List;(IDocOutboundProcessor.java:659)
at com.sap.aii.af.idoc.outbound.IDocOutboundModuleBean.process(Lcom/sap/aii/af/lib/mp/module/ModuleContext;Lcom/sap/aii/af/lib/mp/modu l e/ModuleData;)Lcom/sap/aii/af/lib/mp/module/ModuleData;(IDocOutboundModuleBean.java:154)
[...]

• SAP Netweaver all versions
• IDOC based interface with ICO configuration using IDOC_AAE adapter

RFC client, RFC server, JCo client, JCo server, IDOC hanging, IDOC_AAE adapter, IDOC_AAE, message delivery delay , KBA , BC-MID-CON-JCO , Java-Connector , BC-MID-RFC , RFC , BC-MID-ALE , Integration Technology ALE , BC-CST-GW , Gateway/CPIC , BC-XI-CON-IDO , Idoc Adapter J2EE , Problem