SAP Knowledge Base Article - Preview

3227544 - XSA - xsuaaserver does not start - tomcat hanging while binding HTTPS connector port

Symptom

  • XSA enable hangs indefinitely and will not give back the prompt
  • xsuaaserver remains in 'STARTING' state
  • No errors are reported in xsuaaserver.out nor xsuaaserver_0.log
  • Linux system log /var/log/messages is also not showing any operating system related problems for the UAA server
  • Command 'cat /dev/random' only returns a few characters and not a continuous stream
  • Command 'cat /sbin/sysctl kernel.random.entropy_avail' gives back a number less than 1000
  • strace of the catalina process shows the following errors

4431 12:20:51 futex(0x7faa5c28d628, FUTEX_WAKE_PRIVATE, 1) = 0
4431 12:20:51 futex(0x7faa5c28d67c, FUTEX_WAIT_BITSET_PRIVATE, 0, {tv_sec=6836353, tv_nsec=781955128}, FUTEX_BITSET_MATCH_ANY) = -1 ETIMEDOUT (Connection timed out)
4431 12:20:51 futex(0x7faa5c28d628, FUTEX_WAKE_PRIVATE, 1) = 0
4431 12:20:51 futex(0x7faa5c28d67c, FUTEX_WAIT_BITSET_PRIVATE, 0, {tv_sec=6836353, tv_nsec=832180749}, FUTEX_BITSET_MATCH_ANY) = -1 ETIMEDOUT (Connection timed out)
4431 12:20:51 futex(0x7faa5c28d628, FUTEX_WAKE_PRIVATE, 1) = 0
4431 12:20:51 futex(0x7faa5c28d67c, FUTEX_WAIT_BITSET_PRIVATE, 0, {tv_sec=6836353, tv_nsec=882398991}, FUTEX_BITSET_MATCH_ANY) = -1 ETIMEDOUT (Connection timed out)
4431 12:20:51 futex(0x7faa5c28d628, FUTEX_WAKE_PRIVATE, 1) = 0
4431 12:20:51 futex(0x7faa5c28d67c, FUTEX_WAIT_BITSET_PRIVATE, 0, {tv_sec=6836353, tv_nsec=932614603}, FUTEX_BITSET_MATCH_ANY) = -1 ETIMEDOUT (Connection timed out)
4431 12:20:51 futex(0x7faa5c28d628, FUTEX_WAKE_PRIVATE, 1) = 0
4431 12:20:51 futex(0x7faa5c28d67c, FUTEX_WAIT_BITSET_PRIVATE, 0, {tv_sec=6836353, tv_nsec=982821446}, FUTEX_BITSET_MATCH_ANY) = -1 ETIMEDOUT (Connection timed out)
4431 12:20:51 futex(0x7faa5c28d628, FUTEX_WAKE_PRIVATE, 1) = 0
4431 12:20:51 futex(0x7faa5c28d67c, FUTEX_WAIT_BITSET_PRIVATE, 0, {tv_sec=6836354, tv_nsec=33019787}, FUTEX_BITSET_MATCH_ANY <unfinished ...>
4408 12:20:51 <... futex resumed>) = -1 ETIMEDOUT (Connection timed out)
  • Full thread dump of tomcat with jstack shows the following

"main" #1 prio=5 os_prio=0 cpu=1293.24ms elapsed=1850.15s allocated=70273K defined_classes=3644 tid=0x00007faa5c03b800 nid=0x1132 runnable [0x00007faa6260f000]
java.lang.Thread.State: RUNNABLE
at java.lang.ClassLoader$NativeLibrary.load0(java.base@11.0.13/Native Method)
at java.lang.ClassLoader$NativeLibrary.load(java.base@11.0.13/ClassLoader.java:2442)
at java.lang.ClassLoader$NativeLibrary.loadLibrary(java.base@11.0.13/ClassLoader.java:2498)
- locked <0x00000000c03a5188> (a java.util.HashSet)
at java.lang.ClassLoader.loadLibrary0(java.base@11.0.13/ClassLoader.java:2694)
at java.lang.ClassLoader.loadLibrary(java.base@11.0.13/ClassLoader.java:2648)
at java.lang.Runtime.loadLibrary0(java.base@11.0.13/Runtime.java:830)
at java.lang.System.loadLibrary(java.base@11.0.13/System.java:1873)
at jdk.net.LinuxSocketOptions.lambda$static$0(jdk.net@11.0.13/LinuxSocketOptions.java:99)
at jdk.net.LinuxSocketOptions$$Lambda$119/0x000000010020a840.run(jdk.net@11.0.13/Unknown Source)
at java.security.AccessController.doPrivileged(java.base@11.0.13/Native Method)
at jdk.net.LinuxSocketOptions.<clinit>(jdk.net@11.0.13/LinuxSocketOptions.java:98)
at java.lang.Class.forName0(java.base@11.0.13/Native Method)
at java.lang.Class.forName(java.base@11.0.13/Class.java:315)
at jdk.net.ExtendedSocketOptions$PlatformSocketOptions.newInstance(jdk.net@11.0.13/ExtendedSocketOptions.java:328)
at jdk.net.ExtendedSocketOptions$PlatformSocketOptions.create(jdk.net@11.0.13/ExtendedSocketOptions.java:345)
at jdk.net.ExtendedSocketOptions$PlatformSocketOptions.<clinit>(jdk.net@11.0.13/ExtendedSocketOptions.java:353)
at jdk.net.ExtendedSocketOptions.<clinit>(jdk.net@11.0.13/ExtendedSocketOptions.java:165)
at java.lang.Class.forName0(java.base@11.0.13/Native Method)
at java.lang.Class.forName(java.base@11.0.13/Class.java:315)
at sun.net.ext.ExtendedSocketOptions.<clinit>(java.base@11.0.13/ExtendedSocketOptions.java:109)
at sun.nio.ch.Net.<clinit>(java.base@11.0.13/Net.java:311)
at sun.nio.ch.ServerSocketChannelImpl.<init>(java.base@11.0.13/ServerSocketChannelImpl.java:103)
at sun.nio.ch.SelectorProviderImpl.openServerSocketChannel(java.base@11.0.13/SelectorProviderImpl.java:56)
at java.nio.channels.ServerSocketChannel.open(java.base@11.0.13/ServerSocketChannel.java:113)
at org.apache.tomcat.util.net.NioEndpoint.bind(NioEndpoint.java:218)
at org.apache.tomcat.util.net.AbstractEndpoint.init(AbstractEndpoint.java:1147)
at org.apache.tomcat.util.net.AbstractJsseEndpoint.init(AbstractJsseEndpoint.java:222)
at org.apache.coyote.AbstractProtocol.init(AbstractProtocol.java:599)
at org.apache.coyote.http11.AbstractHttp11Protocol.init(AbstractHttp11Protocol.java:80)
at org.apache.catalina.connector.Connector.initInternal(Connector.java:1074)
at org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:136)
- locked <0x00000000c1d33860> (a org.apache.catalina.connector.Connector)
at org.apache.catalina.core.StandardService.initInternal(StandardService.java:552)
- locked <0x00000000c1d34b00> (a java.lang.Object)
at org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:136)
- locked <0x00000000c1d33798> (a org.apache.catalina.core.StandardService)
at org.apache.catalina.core.StandardServer.initInternal(StandardServer.java:843)
at org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:136)
- locked <0x00000000c01a30e0> (a org.apache.catalina.core.StandardServer)
at org.apache.catalina.startup.Catalina.load(Catalina.java:639)
at org.apache.catalina.startup.Catalina.load(Catalina.java:662)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.13/Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.13/NativeMethodAccessorImpl.java:62)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.13/DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(java.base@11.0.13/Method.java:566)
at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:305)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:475)

  • xsuaaserver_0.log contains only these lines after XSA enable was issued and xsuaaserver stays in 'STARTING'

08-Mar-2022 15:39:05.372 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat 8.5.x-dev
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: unknown
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 8.5.x
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.3.18-150300.59.49-default
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /hana/shared/DFD/xs/sapmachine-11
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.13+8-LTS-sapmachine
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: SAP SE
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /hana/shared/DFD/xs/uaaserver/tomcat
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /hana/shared/DFD/xs/uaaserver/tomcat
08-Mar-2022 15:39:05.374 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The Apache Tomcat Native library which allows using OpenSSL was not found on the java.library.path: [/usr/sap/DFD/HDB00/exe/krb5/lib/krb5/plugins/preauth:/usr/sap/DFD/HDB00/exe/krb5/lib:/usr/sap/DFD/HDB00/exe:/usr/sap/DFD/HDB00/exe/Python3/lib]
08-Mar-2022 15:39:07.221 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["https-jsse-nio-127.0.0.1-30031"]


Read more...

Environment

  • SuSE Linux Enterprise Server 15 SP3
  • Linux kernel 5.3.18-150300.59.49-default
  • XSA Runtime Patch 124
  • Apache Tomcat 8.5
  • SAP HANA 2.0 

Product

SAP HANA, platform edition 2.0 ; TOMCAT BY APACHE 8.5

Keywords

XSA, xsauaaserverpityko, tomcat, hanging, https, /dev/random, /dev/urandom, SLES15, ETIMEDOUT (Connection timed out), LinuxSocketOptions.java:98, https-jsse-nio-127.0.0.1-30031, FUTEX_WAIT_BITSET_PRIVATE , KBA , BC-XS-RT , XS Advanced Runtime / XS Controller , BC-XS-SEC , UAA and Security for HANA XSA engine , Problem

About this page

This is a preview of a SAP Knowledge Base Article. Click more to access the full version on SAP for Me (Login required).

Search for additional results

Visit SAP Support Portal's SAP Notes and KBA Search.