3381308 - Connection errors or transient errors when platform (i.e.ccv2 applicaton pod) interacts with database

Platform could receive error messages when fails to connect to database maybe due to below situations:

• database outage
• slowness of pods in connection networking
• not automatically recovered from transient fault caused by database reconfiguration events within timeout value.

Generally, the following can be found in dynatrace or kibana logs.

• Failed database connects event and Failure Rate Increase alerts in dynatrace
• Kibana logs like

  • {"instant":{"epochSecond":1695339959,"nanoOfSecond":457987611},"thread":"jgroups--ID,hybris-broadcast,hybrisnode-9","level":"ERROR","loggerName":"org.jgroups.protocols.JDBC_PING","message":"JGRP000115: Could not open connection to database","thrown":{"commonElementCount":0,"localizedMessage":"Database 'xxxx-xxxx-xx-db' on server '' is not currently available. Please retry the connection later. If the problem persists, contact customer support, and provide them the session tracing ID of '{***}'. ClientConnectionId:***","message":"Database 'xxxx-xxxx-xx-db' on server '' is not currently available. Please retry the connection later. If the problem persists, contact customer support, and provide them the session tracing ID of '{***}'. ClientConnectionId:***","name":"com.microsoft.sqlserver.jdbc.SQLServerException"}

  • {"instant":{"epochSecond":1695339957,"nanoOfSecond":224870050},"thread":"jgroups-ID,hybris-broadcast,hybrisnode-29","level":"ERROR","loggerName":"org.jgroups.protocols.JDBC_PING","message":"JGRP000115: Could not open connection to database","thrown":{"commonElementCount":0,"localizedMessage":"The TCP/IP connection to the host xxxx.xxxx.eastus1-a.worker.database.windows.net (redirected from xxxx-xxxx-xx-server.database.windows.net), port 11040 has failed. Error: \"Connect timed out: xxxx.xxxx.eastus1-a.worker.database.windows.net:11040. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.\".","message":"The TCP/IP connection to the host xxxx.xxxx.eastus1-a.worker.database.windows.net (redirected from xxxx-xxxx-xx-server.database.windows.net), port 11040 has failed. Error: \"Connect timed out: xxxx.xxxx.eastus1-a.worker.database.windows.net:11040. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.\".","name":"com.microsoft.sqlserver.jdbc.SQLServerException"}

  • {"instant":{"epochSecond":1695338918,"nanoOfSecond":467420333},"thread":"StatDaemonThread-master","level":"WARN","loggerName":"de.hybris.platform.jdbcwrapper.ConnectionErrorCheckingJDBCConnectionPool","message":"Failed to establish JDBC connection. 1 retries left...","thrown":{"commonElementCount":0,"localizedMessage":"Recovery in progress. Please try again later.","message":"Recovery in progress. Please try again later.","name":"de.hybris.platform.jdbcwrapper.interceptor.recover.RecoveryInProgressException",

• Transient fault error codes like "40197" received by application

• SAP Commerce Cloud
• SAP Commerce

retry, recover, db unavailble, connection down, connection lost , KBA , CEC-SCC-PLA-PL , Platform , CEC-SCC-CLA-ENV-EMG , Environment Management , Problem