3362842 - HANA Service(s) crashes with exception  1: no.3020041  (DataAccess/PageAccess/impl/ConverterImpl.cpp:) TID: <> Wrong page type: Expected ConverterIndexPage or ConverterLeafPage but found UndoContainerDirectoryPage

• HANA Database hung, subsequently crashed and becomes inaccessible afterward. The system cannot be started after multiple attempts.
• The following error appears while attempting to restart the Database services "FAIL: process hdbdaemon HDB Daemon not running".
  

  Nameserver is crashing since :

  [CRASH_CONTEXT]  Context info: (2023-08-01 03:35:51 694 Local)
  ----> Crashing context information <----
    ContextStack at (0x00007f8fe0d34180)
    stack:  7f8fe0c3a000-7f8fe0d39fff, size 1048576
    guard:  7f8fe0c1a000-7f8fe0c39fff, size 131072
    ctx addr: 0x00007f90818dd000, ctx link: 0x00007f90818dd000, ctx owner: 0x00007f90818dd000
    ctx name: FileCompletionThread-DATA-0, ctx type: thread, ctx id: 24819
    ctx command text: 
    ctx update transactionID: -1
    ctx transactionID       : -1
    ctx connectionID        : -1
    ctx logical connectionID: 0
    ctx statementID         : 0
    ctx statement hash      : 
    ctx statementExecutionID: 0
    ctx sqlusername         : 
    ctx appusername         : 
  [OK]
  --
  
  [CRASH_STACK]  Stacktrace of crash: (2023-08-01 03:35:51 694 Local)
  ----> Pending exceptions (possible root cause) <----
  --- Pending assertion:
  exception  1: no.3020041  (DataAccess/PageAccess/impl/ConverterImpl.cpp:2076) TID: 11739
      Wrong page type: Expected ConverterIndexPage or ConverterLeafPage but found UndoContainerDirectoryPage.; $spv$=235897; $ppno$=0x90000007a880P [0x7a880000,256k,0]
  exception throw location:
   1: 0x00007f91424f9e28 in PageAccess::ConverterReadSnapshotCallback::pageRead(PageAccess::PageIOCallback::Status const&)+0xce4 at ConverterImpl.cpp:2076 (libhdbdataaccess.so)
   2: 0x00007f914247808d in PageAccess::PageIOCallback::dataRead(FileAccess::FileCallback::Status const&)+0x169 at PageIOImpl.cpp:172 (libhdbdataaccess.so)
   3: 0x00007f9140042e50 in FileAccess::LocalFileCompletionThread::run(void*&)+0x2e0 at Timer.hpp:112 (libhdbbasis.so)
   4: 0x00007f91400909a5 in Execution::Thread::staticMainImp(Execution::Thread*)+0x531 at Thread.cpp:523 (libhdbbasis.so)
   5: 0x00007f91400811d8 in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x1e4 at ThreadInterposition.cpp:649 (libhdbbasis.so)
   6: 0x00007f913f68a6ea in start_thread+0xd8 (libpthread.so.0)
   7: 0x00007f913dcbda6f in __GI___clone+0x3b (libc.so.6)
  
  exception type information:
   - 0: public ltt::exception@0x7f913f5eeba8
  --- Pending caught exception(s):
  --- 1
  pending assertion, already printed: exception  1: no.3020041  (DataAccess/PageAccess/impl/ConverterImpl.cpp:2076) TID: 11739
      Wrong page type: Expected ConverterIndexPage or ConverterLeafPage but found UndoContainerDirectoryPage.; $spv$=235897; $ppno$=0x90000007a880P [0x7a880000,256k,0]
  
  ----> Symbolic stack backtrace <----
    0: gsignal + 0x10d
           SFrame: IP: 0x00007f913f69671b (0x00007f913f69660e+0x10d) FP: 0x00007f8fe0d32f10 SP: 0x00007f8fe0d32df0 RP: 0x00007f914030823a
           Params: 0x2, 0x7f8fe0d32df0, 0x0, 0x7f913f69671b, 0x0, 0x7f8fe0d32df0
           Regs: rax=0x0, rdx=0x0, rcx=0x7f913f69671b, rbx=0x6, rsi=0x7f8fe0d32df0, rdi=0x2, rbp=0x7f913df905e0, r8=0x0, r9=0x7f8fe0d32df0, r10=0x8, r11=0x246, r12=0x7f91429faf18, r13=0x22d, r14=0x0, r15=0x7f8fe0d32f40
           Module: /lib64/libpthread.so.0
       -----------------------------------------
    1: _crashImpl(char const*, int, char const*, rte::const_exception_ptr) + 0x18a
           Symbol: _Z10_crashImplPKciS0_N3rte19const_exception_ptrE
           SFrame: IP: 0x00007f914030823a (0x00007f91403080b0+0x18a) FP: 0x00007f8fe0d334b0 SP: 0x00007f8fe0d32f10 RP: 0x00007f9140308520
           Regs: rbx=0x7f907ac848c0, rbp=0x7f913df905e0, r12=0x7f91429faf18, r13=0x22d, r14=0x0, r15=0x7f8fe0d32f40
           Source: Crash.cpp:729
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
    2: Basis::crashImpl(char const*, int, ltt::bad_alloc const&) + 0x10
           Symbol: _ZN5Basis9crashImplEPKciRKN3ltt9bad_allocE
           SFrame: IP: 0x00007f9140308520 (0x00007f9140308510+0x10) FP: 0x00007f8fe0d334c0 SP: 0x00007f8fe0d334b0 RP: 0x00007f914030853e
           Regs: rbx=0x7f8fe79353d0, rbp=0x7f8fe0b0ac00, r12=0x7f907ac848c0, r13=0x7f9142c75060, r14=0x7f8fe0d334f0, r15=0x7f8fe0d338c0
           Source: Crash.cpp:845
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
    3: Basis::crashImpl(char const*, int, ltt::exception const&) + 0xe
           Symbol: _ZN5Basis9crashImplEPKciRKN3ltt9exceptionE
           SFrame: IP: 0x00007f914030853e (0x00007f9140308530+0xe) FP: 0x00007f8fe0d334d0 SP: 0x00007f8fe0d334c0 RP: 0x00007f9140308549
           Regs: rbx=0x7f8fe79353d0, rbp=0x7f8fe0b0ac00, r12=0x7f907ac848c0, r13=0x7f9142c75060, r14=0x7f8fe0d334f0, r15=0x7f8fe0d338c0
           Source: Crash.cpp:831
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
    4: Basis::asyncCrashImpl(char const*, int, ltt::exception const&) + 0x9
           Symbol: _ZN5Basis14asyncCrashImplEPKciRKN3ltt9exceptionE
           SFrame: IP: 0x00007f9140308549 (0x00007f9140308540+0x9) FP: 0x00007f8fe0d334e0 SP: 0x00007f8fe0d334d0 RP: 0x00007f91424fdabd
           Regs: rbx=0x7f8fe79353d0, rbp=0x7f8fe0b0ac00, r12=0x7f907ac848c0, r13=0x7f9142c75060, r14=0x7f8fe0d334f0, r15=0x7f8fe0d338c0
           Source: Crash.cpp:919
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
    5: PageAccess::ConverterReadCallback::transferError(PageAccess::PageIOCallback::Status const&, ltt::exception const&) + 0x4d
           Symbol: _ZN10PageAccess21ConverterReadCallback13transferErrorERKNS_14PageIOCallback6StatusERKN3ltt9exceptionE
           SFrame: IP: 0x00007f91424fdabd (0x00007f91424fda70+0x4d) FP: 0x00007f8fe0d33840 SP: 0x00007f8fe0d334e0 RP: 0x00007f9142bd25b8
           Regs: rbx=0x7f8fe79353d0, rbp=0x7f8fe0b0ac00, r12=0x7f907ac848c0, r13=0x7f9142c75060, r14=0x7f8fe0d334f0, r15=0x7f8fe0d338c0
           Source: ConverterImpl.cpp:557
           Module: /usr/sap/HDB/HDB00/exe/libhdbdataaccess.so
       -----------------------------------------
    6: PageAccess::ConverterReadSnapshotCallback::pageRead(PageAccess::PageIOCallback::Status const&) [clone .cold] + 0x96
           Symbol: _ZN10PageAccess29ConverterReadSnapshotCallback8pageReadERKNS_14PageIOCallback6StatusE.cold
           SFrame: IP: 0x00007f9142bd25b8 (0x00007f9142bd2522+0x96) FP: 0x00007f8fe0d33c40 SP: 0x00007f8fe0d33840 RP: 0x00007f914247808d
           Regs: rbx=0x7f8fe0b0aca0, rbp=0x7f8fe79353d0, r12=0x7f907ac848c0, r13=0x7f8fe79353d0, r14=0x7f8fe0d338e0, r15=0x7f8fe0d338c0
           Source: ConverterImpl.cpp:2085
           Module: /usr/sap/HDB/HDB00/exe/libhdbdataaccess.so
       -----------------------------------------
    7: PageAccess::PageIOCallback::dataRead(FileAccess::FileCallback::Status const&) + 0x16d
           Symbol: _ZN10PageAccess14PageIOCallback8dataReadERKN10FileAccess12FileCallback6StatusE
           SFrame: IP: 0x00007f914247808d (0x00007f9142477f20+0x16d) FP: 0x00007f8fe0d33d50 SP: 0x00007f8fe0d33c40 RP: 0x00007f9140042e50
           Regs: rbx=0x0, rbp=0x7f8fe0b0aca0, r12=0x7f8fe0b0ad10, r13=0x7f8fe79353d0, r14=0x40000, r15=0x7f8fe0d33cc0
           Source: PageIOImpl.cpp:172
           Module: /usr/sap/HDB/HDB00/exe/libhdbdataaccess.so
       -----------------------------------------
    8: FileAccess::LocalFileCompletionThread::run(void*&) + 0x2e0
           Symbol: _ZN10FileAccess25LocalFileCompletionThread3runERPv
           SFrame: IP: 0x00007f9140042e50 (0x00007f9140042b70+0x2e0) FP: 0x00007f8fe0d34180 SP: 0x00007f8fe0d33d50 RP: 0x00007f91400909a5
           Regs: rbx=0x7f9081b74438, rbp=0x7f914063d4f8, r12=0x7f8fe0d33df0, r13=0x7f9081901e00, r14=0x7f90818dd000, r15=0x7f8fe0b0ace0
           Source: Timer.hpp:112
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
    9: Execution::Thread::staticMainImp(Execution::Thread*) + 0x535
           Symbol: _ZN9Execution6Thread13staticMainImpEPS0_
           SFrame: IP: 0x00007f91400909a5 (0x00007f9140090470+0x535) FP: 0x00007f8fe0d34640 SP: 0x00007f8fe0d34180 RP: 0x00007f91400811d8
           Regs: rbx=0x7f90818dd000, rbp=0x7f8fe0d34630, r12=0x7f8fe0d342d0, r13=0x7f90818dd000, r14=0x7f90818cd6b0, r15=0x7f90818cd668
           Source: Thread.cpp:523
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
   10: Execution::pthreadFunctionWrapper(Execution::Thread*) + 0x1e8
           Symbol: _ZN9Execution22pthreadFunctionWrapperEPNS_6ThreadE
           SFrame: IP: 0x00007f91400811d8 (0x00007f9140080ff0+0x1e8) FP: 0x00007f8fe0d34a40 SP: 0x00007f8fe0d34640 RP: 0x00007f913f68a6ea
           Regs: rbx=0x1fef0, rbp=0x7f90818dd000, r12=0x7f8fe0d3a000, r13=0x7f8fe0d34670, r14=0x7f8fe0c3a000, r15=0x100000
           Source: ThreadInterposition.cpp:649
           Module: /usr/sap/HDB/HDB00/exe/libhdbbasis.so
       -----------------------------------------
   11: start_thread + 0xdc
           SFrame: IP: 0x00007f913f68a6ea (0x00007f913f68a60e+0xdc) FP: 0x00007f8fe0d34b00 SP: 0x00007f8fe0d34a40 RP: 0x00007f913dcbda6f
           Regs: rbx=0x0, rbp=0x0, r12=0x7f8fe7933d8e, r13=0x7f8fe7933d8f, r14=0x7f8fe7934260, r15=0x0
           Module: /lib64/libpthread.so.0
       -----------------------------------------
   12: __GI___clone + 0x3b
           SFrame: IP: 0x00007f913dcbda6f (0x00007f913dcbda34+0x3b) FP: 0x00007f8fe0d34b08 SP: 0x00007f8fe0d34b00 RP: 0x00007f913dcbda6f
           Regs: rbx=0x7f8fe0d39700, rbp=0x0, r12=0x7f8fe7933d8e, r13=0x7f8fe7933d8f, r14=0x7f8fe7934260, r15=0x0
           Module: /lib64/libc.so.6
  [OK]
  --
  
  
  

  nameserver_alert_Hostname.trc
  //

  Error first appeared @ 

  [11739]{-1}[-1/-1] 2023-08-01 03:35:51.675505 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [13637]{-1}[-1/-1] 2023-08-01 03:39:10.638368 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [14217]{-1}[-1/-1] 2023-08-01 03:40:15.345766 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007af00P [0x7af00000,256k,0] to markSnapshotFBM(id=235906)
  [14675]{-1}[-1/-1] 2023-08-01 03:40:55.933468 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [23106]{-1}[-1/-1] 2023-08-01 03:42:38.221122 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007af00P [0x7af00000,256k,0] to markSnapshotFBM(id=235906)
  [26417]{-1}[-1/-1] 2023-08-01 03:44:41.325233 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [26858]{-1}[-1/-1] 2023-08-01 03:45:36.026063 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [27175]{-1}[-1/-1] 2023-08-01 03:47:09.681123 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [29160]{-1}[-1/-1] 2023-08-01 03:50:48.576509 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [29712]{-1}[-1/-1] 2023-08-01 03:52:38.704608 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [31476]{-1}[-1/-1] 2023-08-01 03:54:15.515006 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [31896]{-1}[-1/-1] 2023-08-01 03:56:42.216182 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [33804]{-1}[-1/-1] 2023-08-01 04:01:01.942644 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [34121]{-1}[-1/-1] 2023-08-01 04:01:46.827458 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [34476]{-1}[-1/-1] 2023-08-01 04:02:45.782731 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [36663]{-1}[-1/-1] 2023-08-01 04:06:55.082279 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [38762]{-1}[-1/-1] 2023-08-01 04:10:35.464703 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [40944]{-1}[-1/-1] 2023-08-01 04:17:53.218800 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [42691]{-1}[-1/-1] 2023-08-01 04:19:55.514052 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [43224]{-1}[-1/-1] 2023-08-01 04:22:34.478078 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [46646]{-1}[-1/-1] 2023-08-01 04:28:22.926687 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [46840]{-1}[-1/-1] 2023-08-01 04:28:50.197783 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [8034]{-1}[-1/-1] 2023-08-01 05:16:49.941288 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)
  [8062]{-1}[-1/-1] 2023-08-01 06:14:33.487821 e Converter        ConverterImpl.cpp(00552) : Failed to load page 0x90000007a880P [0x7a880000,256k,0] to markSnapshotFBM(id=235906)

   

• Prior to this, there were issues with accessing the HANA data and log volumes on the filesystem level on OS. Maintenance was carried out on the OS to resolve the IO filesystem access problems, for example like an OS firmware upgrade.
  
  

  var/log/messages from the local DB server OS show filesystem access problems and a hanging server :
  //

  
  2023-08-01T00:36:15.961759-04:00 Hostname kernel: [14160307.501558] XFS (dm-22): writeback error on sector 955553248
  2023-08-01T00:36:15.961761-04:00 Hostname kernel: [14160307.501601] XFS (dm-22): writeback error on sector 534838600
  2023-08-01T00:36:15.961764-04:00 Hostname kernel: [14160307.501606] XFS (dm-22): writeback error on sector 534838608
  2023-08-01T00:36:15.961765-04:00 Hostname kernel: [14160307.501613] XFS (dm-15): metadata I/O error in "xfs_buf_iodone_callback_error" at daddr 0x54ffe00 len 32 error 5
  2023-08-01T00:36:15.961767-04:00 Hostname kernel: [14160307.501615] XFS (dm-22): writeback error on sector 1066177312
  2023-08-01T00:36:15.961768-04:00 Hostname kernel: [14160307.501619] XFS (dm-22): writeback error on sector 1066177320
  2023-08-01T00:36:15.961769-04:00 Hostname kernel: [14160307.501625] XFS (dm-15): log I/O error -5
  2023-08-01T00:36:15.961778-04:00 Hostname kernel: [14160307.501646] XFS (dm-15): xfs_do_force_shutdown(0x2) called from line 1210 of file ../fs/xfs/xfs_log.c. Return address = 0000000000d96857
  2023-08-01T00:36:15.961780-04:00 Hostname kernel: [14160307.501647] XFS (dm-15): Log I/O Error Detected. Shutting down filesystem
  2023-08-01T00:36:15.961782-04:00 Hostname kernel: [14160307.501649] XFS (dm-15): Please unmount the filesystem and rectify the problem(s)
  2023-08-01T00:36:15.961783-04:00 Hostname kernel: [14160307.501670] XFS (dm-13): log I/O error -5
  2023-08-01T00:36:15.961785-04:00 Hostname kernel: [14160307.501678] XFS (dm-22): writeback error on sector 534821664
  2023-08-01T00:36:15.961786-04:00 Hostname kernel: [14160307.501689] XFS (dm-18): metadata I/O error in "xfs_buf_iodone_callback_error" at daddr 0x7f7fc00 len 32 error 5
  2023-08-01T00:36:15.961796-04:00 Hostname kernel: [14160307.501698] XFS (dm-11): log I/O error -5
  2023-08-01T00:36:15.961797-04:00 Hostname kernel: [14160307.501712] XFS (dm-13): writeback error on sector 576
  2023-08-01T00:36:15.961799-04:00 Hostname kernel: [14160307.501716] XFS (dm-18): log I/O error -5
  2023-08-01T00:36:15.961800-04:00 Hostname kernel: [14160307.501724] XFS (dm-11): xfs_do_force_shutdown(0x2) called from line 1210 of file ../fs/xfs/xfs_log.c. Return address = 0000000000d96857
  2023-08-01T00:36:15.961801-04:00 Hostname kernel: [14160307.501731] XFS (dm-22): log I/O error -5
  2023-08-01T00:36:15.961803-04:00 Hostname kernel: [14160307.501735] XFS (dm-22): writeback error on sector 133722088
  2023-08-01T00:36:15.961808-04:00 Hostname kernel: [14160307.501756] XFS (dm-13): xfs_do_force_shutdown(0x2) called from line 1210 of file ../fs/xfs/xfs_log.c. Return address = 0000000000d96857
  2023-08-01T00:36:15.961810-04:00 Hostname kernel: [14160307.501763] XFS (dm-12): writeback error on sector 2647024
  2023-08-01T00:36:15.961817-04:00 Hostname kernel: [14160307.501770] XFS (dm-12): metadata I/O error in "xfs_buf_iodone_callback_error" at daddr 0x280020 len 32 error 5
  2023-08-01T00:36:15.961818-04:00 Hostname kernel: [14160307.501773] XFS (dm-12): log I/O error -5
  2023-08-01T00:36:15.961819-04:00 Hostname kernel: [14160307.501774] XFS (dm-13): Log I/O Error Detected. Shutting down filesystem
  2023-08-01T00:36:15.961821-04:00 Hostname kernel: [14160307.501778] XFS (dm-18): xfs_do_force_shutdown(0x2) called from line 1210 of file ../fs/xfs/xfs_log.c. Return address = 0000000000d96857
  2023-08-01T00:36:15.961822-04:00 Hostname kernel: [14160307.501784] XFS (dm-18): Log I/O Error Detected. Shutting down filesystem
  2023-08-01T00:36:15.961823-04:00 Hostname kernel: [14160307.501786] XFS (dm-11): Log I/O Error Detected. Shutting down filesystem
  2023-08-01T00:36:15.961824-04:00 Hostname kernel: [14160307.501788] XFS (dm-13): Please unmount the filesystem and rectify the problem(s)
  2023-08-01T00:36:15.961826-04:00 Hostname kernel: [14160307.501793] XFS (dm-11): Please unmount the filesystem and rectify the problem(s)
  2023-08-01T00:36:15.961828-04:00 Hostname kernel: [14160307.501795] XFS (dm-13): log I/O error -5
  2023-08-01T00:36:15.961829-04:00 Hostname kernel: [14160307.501801] XFS (dm-12): xfs_do_force_shutdown(0x2) called from line 1210 of file ../fs/xfs/xfs_log.c. Return address = 0000000000d96857
  2023-08-01T00:36:15.961839-04:00 Hostname kernel: [14160307.501807] XFS (dm-13): log I/O error -5
  2023-08-01T00:36:15.961841-04:00 Hostname kernel: [14160307.501809] XFS (dm-18): Please unmount the filesystem and rectify the problem(s)
  2023-08-01T00:36:15.961842-04:00 Hostname kernel: [14160307.501811] XFS (dm-12): Log I/O Error Detected. Shutting down filesystem
  2023-08-01T00:36:15.961843-04:00 Hostname kernel: [14160307.501814] XFS (dm-12): Please unmount the filesystem and rectify the problem(s)
  2023-08-01T00:36:15.961848-04:00 Hostname kernel: [14160307.501816] XFS (dm-18): log I/O error -5
  2023-08-01T00:36:15.961849-04:00 Hostname kernel: [14160307.501819] XFS (dm-11): log I/O error -5
  2023-08-01T00:36:15.961851-04:00 Hostname kernel: [14160307.501841] XFS (dm-22): writeback error on sector 534771024
  2023-08-01T00:36:15.961852-04:00 Hostname kernel: [14160307.501940] XFS (dm-22): xfs_do_force_shutdown(0x2) called from line 1210 of file ../fs/xfs/xfs_log.c. Return address = 0000000000d96857
  2023-08-01T00:36:15.961853-04:00 Hostname kernel: [14160307.501944] XFS (dm-12): log I/O error -5
  2023-08-01T00:36:15.961855-04:00 Hostname kernel: [14160307.501948] XFS (dm-22): Log I/O Error Detected. Shutting down filesystem
  2023-08-01T00:36:15.961856-04:00 Hostname kernel: [14160307.501950] XFS (dm-22): Please unmount the filesystem and rectify the problem(s)
  2023-08-01T00:36:15.961857-04:00 Hostname kernel: [14160307.501955] XFS (dm-22): log I/O error -5
  2023-08-01T00:36:15.961859-04:00 Hostname kernel: [14160307.501960] XFS (dm-22): log I/O error -5
  
  ...
  
  2023-08-01T03:35:20.416510-04:00 Hostname systemd[1]: Starting Daemon for generating UUIDs...
  2023-08-01T03:35:20.430964-04:00 Hostname systemd[1]: Started Daemon for generating UUIDs.
  2023-08-01T03:35:21.307998-04:00 Hostname SAPHDB_00[11517]: SAP Service SAPHDB_00 successfully started.
  2023-08-01T03:35:44.437766-04:00 Hostname SAPHDB_00[11577]: Unable to lockf() the lock file /tmp/.sapstartsrv00_sapstartsrv.log, some other process already has a lock. (Error 11 Resource temporarily unavailable) [/bas/753_REL/src/proj/ntserv/ntservsserver.cpp 3381]
  2023-08-01T03:35:44.437931-04:00 Hostname SAPHDB_00[11577]: Unable to open trace file sapstartsrv.log. (Error 11 Resource temporarily unavailable) [/bas/753_REL/src/proj/ntserv/ntservsserver.cpp 4607]
  2023-08-01T03:35:51.842451-04:00 Hostname systemd[1]: Created slice Slice /system/systemd-coredump.
  2023-08-01T03:35:51.845746-04:00 Hostname systemd[1]: Started Process Core Dump (PID 11742/UID 0).
  2023-08-01T03:35:51.915505-04:00 Hostname systemd-coredump[11743]: Resource limits disable core dumping for process 11663 (hdbnameserver).
  2023-08-01T03:35:51.916248-04:00 Hostname systemd-coredump[11743]: Process 11663 (hdbnameserver) of user 4529 dumped core.

SAP HANA Platform Edition 2.0

KBA , HAN-DB , SAP HANA Database , BC-OP-LNX , Linux , HAN-DB-BAC , SAP HANA Backup & Recovery , Problem