2998531 - HANA Server not starting and in Initializing status.

HANA database is not coming up.

1) Status of process list shows as below :

GetProcessList
OK
name, description, dispstatus, textstatus, starttime, elapsedtime, pid
hdbdaemon, HDB Daemon, YELLOW, Initializing, 2020 11 23 13:23:19, 0:40:58, 12177
hdbcompileserver, HDB Compileserver, YELLOW, Scheduled, , , -1
hdbindexserver, HDB Indexserver-PQH, YELLOW, Scheduled, , , -1
hdbnameserver, HDB Nameserver, YELLOW, Initializing, 2020 11 23 13:23:20, 0:40:57, 12195
hdbpreprocessor, HDB Preprocessor, YELLOW, Scheduled, , , -1
hdbwebdispatcher, HDB Web Dispatcher, YELLOW, Scheduled, , , -1
hdbxsengine, HDB XSEngine-PQH, YELLOW, Scheduled, , , -1

2) daemon trace file shows the below messages :

....

[23263]{-1}[-1/-1] 2020-11-26 10:23:05.825050 i Daemon           Program.cpp(00249) : Instance 0 of program 'nameserver' will be started in 0 ms

[23263]{-1}[-1/-1] 2020-11-26 10:23:05.825052 i Daemon           Program.cpp(00038) : Starting instance right now
[23263]{-1}[-1/-1] 2020-11-26 10:23:05.825085 i Daemon           DaemonChild.cpp(00499) : Starting program 'hdbnameserver' with args ''
[23263]{-1}[-1/-1] 2020-11-26 10:23:05.840178 w Environment      Environment.cpp(00263) : Changing environment set PYTHONDONTWRITEBYTECODE=1
[23263]{-1}[-1/-1] 2020-11-26 10:23:05.850879 i Daemon           RunningInstance.cpp(00260) : Start 'hdbnameserver' as process 23284, process group 23284, instance 0 of <HDB Nameserver>

3) Nameserver trace file not updated and does NOT show any new messages.

4) gstack for the nameserver process id shows the below :

Thread 2 (Thread 0x7f49ac774700 (LWP 23290)):
#0  0x00007f4a2e334b38 in crashOnCrashThread () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Diagnose/impl/CrashDump.cpp:2381
#1  0x00007f4a2e301390 in selfInCrash () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/ContextFunctions.cpp:1051
#2  handleCrashSignal () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Diagnose/impl/FaultProtectionImpl.cpp:3228
#3  <signal handler called>
#4  0x00007f49ac8ddc2b in stacklookup_check(void*) () from /opt/cylance/desktop/cymemdeflinux_x64.so
#5  0x00007f49ac8ddddb in ?? () from /opt/cylance/desktop/cymemdeflinux_x64.so
#6  0x00007f4a2dfe5963 in mprotectOverride () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:2251
#7  mprotect () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:1532
#8  0x00007f4a2dfe9a9f in mprotect () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/System/impl/SystemCallsUNIX.cpp:394
#9  _ZN13MemoryManager18JumpTableAllocator17activateJumpTableERNS_13AllocatorInfoE.isra.37 () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:147
#10 buildJumpTable () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:329
#11 updateMallocAllocatorMapByModuleInfosIncrementally () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:649
#12 0x00007f4a2dfec158 in getAllocatorSynchronized () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:581
#13 0x00007f4a2dfec3fc in malloc_hook () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmMallocProxy.cpp:994
#14 0x00007f49ac8dda37 in stacklookup_add(void*) () from /opt/cylance/desktop/cymemdeflinux_x64.so
#15 0x00007f49ac8de246 in ?? () from /opt/cylance/desktop/cymemdeflinux_x64.so
#16 0x00007f4a2d8ee70a in start_thread () from /lib64/noelision/libpthread.so.0
#17 0x00007f4a2c178f6d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f4a181d2cc0 (LWP 23284)):
#0  0x00007f4a2c161c87 in sched_yield () from /lib64/libc.so.6
#1  0x00007f4a2e169c45 in yield () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/Yield.cpp:18
#2  yield () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/Thread.hpp:409
#3  start () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/Thread.cpp:842
#4  0x00007f4a2e2f17dd in start () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/Thread.hpp:238
#5  start () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/Thread.hpp:310
#6  0x00007f4a2e160e47 in pthread_create () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/ThreadInterposition.cpp:769
#7  0x00007f4a2e162c83 in initialize_libgcc_s_handle () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/ThreadExitInitializer.cpp:54
#8  0x00007f4a2e160c02 in pthread_create () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/ThreadInterposition.cpp:740
#9  0x00007f4a2e16a0bd in start () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/impl/Thread.cpp:798
#10 0x00007f4a2e33e0c9 in start () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/Thread.hpp:238
#11 startOrRestart () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/Execution/Thread.hpp:325
#12 0x00007f4a2e02134f in startCompactionThread () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmCompactionTrigger.cpp:820
#13 getInstance () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmCompactionTrigger.cpp:1814
#14 0x00007f4a2df07fb0 in inMainHook () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/MemoryManager/impl/mmInMainHook.cpp:29
#15 mainInitialPhase () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/System/impl/IsInMain.cpp:134
#16 0x00007f4a2df08da0 in mainWrapper () at /data/jenkins_prod/workspace/efgdet97rp/s/Basis/System/impl/IsInMain.cpp:332
#17 0x00007f4a2c0ac765 in __libc_start_main () from /lib64/libc.so.6
#18 0x00005599c46387bd in _start () at ../sysdeps/x86_64/start.S:112

• Hana server version 2.0

Start , Hana , Antivirus, cylance, stacklookup_add, hdbnameserver, Initializing , KBA , HAN-DB , SAP HANA Database , Problem