2712577 - HANA database fails to start

• HANA server hangs on startup
• HDB start shows:
  

  hanadm@pHanaDev:/usr/sap/HAN/HDB70> HDB start

  StartService
  Impromptu CCC initialization by 'rscpCInit'.
  See SAP note 1266393.
  OK
  OK
  Starting instance using: /usr/sap/HAN/SYS/exe/hdb/sapcontrol -prot NI_HTTP -nr 70 -function StartWait 2700 2

  26.10.2018 00:22:18
  Start
  OK

  26.10.2018 01:07:19
  StartWait
  FAIL: Timeout

• nameserver or daemon trace flooded with following messages:
  

  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682198 i Memory Memory.cpp(02225) : ======= NUMA Configuration =======
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682201 i Memory Memory.cpp(02226) : Is valid NUMA Topology? (0|1) = 1
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682203 i Memory Memory.cpp(02227) : Is NUMA-awareness enabled? (0|1) = 1
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682204 i Memory Memory.cpp(02228) : Number of NUMA Nodes = 2
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682206 i Memory Memory.cpp(02229) : Number of NUMA Nodes with logical cpus = 1
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682207 i Memory Memory.cpp(02230) : Number of NUMA Nodes with attached memory = 1
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682209 i Memory Memory.cpp(02231) : Number of NUMA Nodes with both cpus and memory = 0
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682210 i Memory Memory.cpp(02232) : Number of Logical cpus = 24
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682212 i Memory Memory.cpp(02239) : Target NODE Id requested for allocation = 0
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682213 w Memory Memory.cpp(02247) : Target NODE Id 0 is CPU-only!!
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682215 i Memory Memory.cpp(02261) : 
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682217 i Memory Memory.cpp(02267) : NODE ID 0:
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682219 i Memory Memory.cpp(02270) : [MEMORY]
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682221 i Memory Memory.cpp(02278) : [CPU]
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682222 i Memory Memory.cpp(02281) : Number of logical cpus = 24
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682224 w Memory Memory.cpp(02288) : 
  ***** CPU-only node!! *****
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682226 i Memory Memory.cpp(02267) : NODE ID 3:
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682227 i Memory Memory.cpp(02270) : [MEMORY]
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682228 i Memory Memory.cpp(02273) : Local memory is attached. mem = 267310656 KB
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682230 i Memory Memory.cpp(02278) : [CPU]
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682232 w Memory Memory.cpp(02292) : 
  ***** MEMORY-only node!! *****
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682233 i Memory Memory.cpp(02302) : ==================================
  [13788]{-1}[-1/-1] 2018-10-26 14:21:27.682235 i Memory Memory.cpp(01393) : NUMA policy fallbacks will be used for memory address = 0x00003ffe88f50000, size = 33554432, target node = 0

NUMA configuration check 'numactl --hardware' returns:

• pHanaDev:~ # numactl --hardware
  available: 2 nodes (0,3)
  node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
  node 0 size: 0 MB
  node 0 free: 0 MB
  node 3 cpus:
  node 3 size: 261045 MB
  node 3 free: 238680 MB
  node distances:
  node 0 3
  0: 10 40
  3: 40 10
  pHanaDev:~ # numactl --show
  policy: default
  preferred node: current
  physcpubind: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
  cpubind:
  nodebind:
  membind: 3
  
  
  Image/data in this KBA is from SAP internal systems, sample data, or demo systems. Any resemblance to real data is purely coincidental. 

HANA Revision Revision 2.00.024+

hangs, timeout, upgrade, NUMA , KBA , HAN-DB , SAP HANA Database , Problem