3090411 - Error delta log replay failed [1527] in SAP HANA system

• You observe application failing with the following error:

  SQL message: delta log replay failed: search table error:  [1527] Exception during load of CS table <DATABASE NAME>::<SCHEMA NAME>:<TABLE NAME>: code = 3020043, message = Wrong checksum: Calculated 1932816988 with checksum algorithm 3 (CRC32), stored 4155404680.;

• You notice several corrupt.dmp files in the traces directory
• You notice entries similar to the following in the indexserver trace file:
  

  [101297]{-1}[36/409389369] 2021-08-10 04:02:38.737558 e LogicalPageAcces LogicalPageAccessImpl.cpp(02258) : retryPageLoadAfterFailedChecksumCheck: Retry #7 retrieved invalid page again: exception  1: no.3020043  (DataAccess/PageAccess/impl/PageImpl.cpp:442) TID: 101297
      Wrong checksum: Calculated 2523271904 with checksum algorithm 3 (CRC32), stored 201150640.; $verifiedForInternalReorganization$=false; $pno$=0x43b46L; $ppno$=0x800000c0d180P [0xc0d180000,64k,0]
  exception throw location:
   1: 0x00007f1cf96dce80 in PageAccess::Page::verifyChecksum(PageAccess::SizeClass) const+0x70 at PageImpl.cpp:442 (libhdbdataaccess.so)
   2: 0x00007f1cf96d3417 in PageAccess::PageControlBlock::onLoad(DataAccess::PageFlushStatistics&, unsigned int, PageAccess::PageNo const&, PageAccess::PageNo const&, PageAccess::SizeClass&, bool, bool)+0x343 at Page.hpp:322 (libhdbdataaccess.so)
   3: 0x00007f1cf96e8d61 in PageAccess::LogicalPageControlBlock::onLoad(DataAccess::PageFlushStatistics&, unsigned int, PageAccess::SizeClass&, bool, bool)+0x170 at LogicalPageImpl.cpp:566 (libhdbdataaccess.so)
   4: 0x00007f1cf9dfeee9 in PageAccess::LogicalPageAccessImpl::handleFailedPageCheck(PageAccess::LogicalPageHandle&, DataAccess::PageFlushStatistics&, ltt::exception const&, PageAccess::Converter::Type, PageAccess::SizeClass&, bool) const+0x69b at LogicalPageHandle.hpp:568 (libhdbdataaccess.so)
   5: 0x00007f1cf9df0af7 in PageAccess::LogicalPageAccessImpl::loadPageInternal(PageAccess::PageNo const&, PageAccess::SizeClass&, DataContainer::ContainerID const&, ResourceManager::ResourceHint const&, ResourceManager::Disposition, bool, bool&, ResourceManager::HandleMissingResourceMode, bool const&, PageAccess::LogicalPageResourceProvider&) [clone .constprop.0] [clone .cold]+0x7d5 at LogicalPageAccessImpl.cpp:2048 (libhdbdataaccess.so)
   6: 0x00007f1cf96fd2b3 in PageAccess::LogicalPageAccess::loadPage(PageAccess::PageNo const&, DataContainer::ContainerID const&, ResourceManager::Disposition, ResourceManager::HandleMissingResourceMode, bool&)+0x70 at LogicalPageAccessImpl.hpp:163 (libhdbdataaccess.so)
   7: 0x00007f1d005126ef in UnifiedTable::PageChainBase<UnifiedTable::PageDirectoryElement>::loadPageInternal(UnifiedTable::PageDirectoryElement const&, ResourceManager::Disposition, bool&)+0xeb at PageChain.cpp:1294 (libhdbunifiedtable.so)
   8: 0x00007f1d0051756d in UnifiedTable::PageChainBase<UnifiedTable::PageDirectoryElement>::loadTemp(unsigned long, ResourceManager::Disposition, bool&)+0x99 at PageChain.cpp:1265 (libhdbunifiedtable.so)
   9: 0x00007f1d00807f61 in UnifiedTable::SerialDataStorage::readNextBufferImpl(UnifiedTable::SerialDataIOState&, char const*&, unsigned long&)+0x210 at PageChain.hpp:367 (libhdbunifiedtable.so)
  10: 0x00007f1d008013be in UnifiedTable::UnbufferedColumnSerialDataReader::readNextBuffer(char const*&, unsigned long&)+0xaa at SerialDataStorageSPI.cpp:35 (libhdbunifiedtable.so)
  11: 0x00007f1d129f3636 in AttributeEngine::FileReadBuffer::readBlock(char*, unsigned long)+0x1b2 at AttributeStoreFile.cpp:830 (libhdbcs.so)
  12: 0x00007f1d16db26ef in AttributeEngine::SingleAttribute<TrexTypes::LongdateAttributeValue, AttributeEngine::ValueDict<TrexTypes::LongdateAttributeValue> >::load(AttributeEngine::SingleValues<TrexTypes::LongdateAttributeValue, AttributeEngine::ValueDict<TrexTypes::LongdateAttributeValue> >&, AttributeEngine::AttributeDeserializer&, AttributeEngine::SecondaryStructureStateWrapper&, bool)+0xeb at AttributeStoreFile.h:322 (libhdbcs.so)
  13: 0x00007f1d129c9dad in AttributeEngine::MemoryAvc2::load_internal(AttributeEngine::AttributeDeserializer&, AttributeEngine::MemoryAvc2::TpcVersion)+0x59 at AttributeValueContainer.cpp:2704 (libhdbcs.so)
  14: 0x00007f1d129cf0fe in AttributeEngine::MemoryAvc2::load(AttributeEngine::MemoryAvc2::TpcVersion)+0x26a at AttributeValueContainer.cpp:2842 (libhdbcs.so)
  15: 0x00007f1d129d6107 in AttributeEngine::MemoryAvc2::prepareDeltaMerge(AttributeEngine::AttributeValueContainer*, AttributeEngine::AttributeMergeData const&, bool)+0x4c3 at AttributeValueContainer.cpp:3010 (libhdbcs.so)
  16: 0x00007f1d12a6a416 in AttributeEngine::AttributeApi::prepareDeltaMerge(TrexBase::IndexName const&, AttributeEngine::AttributeMergeData const&, bool)+0x572 at AttributeApi.cpp:1421 (libhdbcs.so)
  17: 0x00007f1d0928e7cf in TRexAPI::MergeAttributeJob::doMerge(TRexAPI::MergeAttributeInfo&, TRexAPI::DeltaMergeState&, bool)+0x4b at MergeAttributeJob.cpp:152 (libhdbcsapi.so)
  18: 0x00007f1d0928f401 in TRexAPI::MergeAttributeJob::run(Execution::Context&, Execution::JobObject&)+0x1a0 at MergeAttributeJob.cpp:260 (libhdbcsapi.so)
  19: 0x00007f1cf644dcbf in Execution::JobObjectImpl::run(Execution::JobWorker*)+0x218b at JobExecutorImpl.cpp:1194 (libhdbbasis.so)
  20: 0x00007f1cf64371ea in Execution::JobWorker::runJob(ltt::smartptr_handle<Execution::JobObjectForHandle>&)+0x336 at JobExecutorThreads.cpp:382 (libhdbbasis.so)
  21: 0x00007f1cf6431678 in Execution::JobWorker::run(void*&)+0x764 at JobExecutorThreads.cpp:1282 (libhdbbasis.so)
  22: 0x00007f1cf63efd8d in Execution::Thread::staticMainImp(Execution::Thread*)+0x529 at Thread.cpp:522 (libhdbbasis.so)
  23: 0x00007f1cf63dfdc9 in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x165 at ThreadInterposition.cpp:639 (libhdbbasis.so)
  24: 0x00007f1cf5a5cdd5 in start_thread+0xc1 (libpthread.so.0)
  25: 0x00007f1cf413e02d in __clone+0x69 (libc.so.6)
  exception type information:
   - 0: public ltt::exception@0x7f1cf59c3c70
   vf={doublelink={logical={page={savepoint=384889,version=1,page_type=VirtualFileLOBPage,checksum_algo=CRC32,delete_mark=bytes(1)[
  0x00000000:                   23                                   #         
  ],converter_type=Default,size=4k,checksum=201150640,flush_counter=0,reserved=0},owner=0xfe00ae94d3,pageno=0x820618L,nextpageno=0x820617L},prevpageno=[invalid]},first_entry_pos=72,undo_count=0,current_write_pos=4096,page_index=1,link_count=1,entry_count=3}
  [101297]{-1}[36/409389369] 2021-08-10 04:02:38.777590 e LogicalPageAcces LogicalPageAccessImpl.cpp(02259) : Please refer to SAP note 2116157 for further information

SAP HANA, platform edition 2.0

KBA , HAN-DB-PER , SAP HANA Database Persistence , Problem