/support/notes/service/sap_logo.png){kind=logo}
SAP Knowledge Base Article - PreviewSymptom
- After a refresh of a SAP Netweaver client's HANA DB system with the data backup from another HANA System, the Client copy export fails when attempting to export the client system to target.
SCC export and transport logs show the following :
ERROR: No entry for SBPKT00009 in E070 or error during access.
ERROR: RFC function TRINT_PROGRESS_INDICATOR error: Error DBSQL_SQL_ERROR occured. P1=RFCCBWHITELIST P2=SQL code: 4 P3=SQL message: cannot allocate enough memory: Out of memory on query open P4=SQL dbsl rc: 99
ERROR SBPKT00009 SBP E 0012 20230405090334 BASISSUPPORT BASISSUPPORT sbx
ERROR: RFC function TRINT_PROGRESS_INDICATOR returned RFC_ILLEGAL_STATE
1 ETP199 ######################################
1 ETP199X######################################
1 ETP150 MAIN EXPORT
1 ETP101 transport order : "SBPKT00009"
1 ETP102 system : "SID"
1 ETP108 tp path : "tp"
1 ETP109 version and release : "381.24.14" "753"
1 ETP198
4 ETW000 R3trans version 6.26 (release 753 - 20.09.22 - 12:12:00 with rjh730).
4 ETW000 unicode enabled version
4 ETW000 ===============================================
4 ETW000
4 ETW000 date&time : 05.04.2023 - 09:01:42
4 ETW000 control file: /usr/sap/trans/tmp/SBPKKT00009.SID
4 ETW000 > #pid 38865 on sbx (sbpadm)
4 ETW000 > export
4 ETW000 > file='/usr/sap/trans/data/RT00009.SID'
4 ETW000 > client=400
4 ETW000 > buffersync=yes
4 ETW000 >
4 ETW000 > use comm 'SBPKT00009'
4 ETW000 R3trans was called as follows: R3trans -u 18 -w /usr/sap/trans/tmp/SBPET00009.SID /usr/sap/trans/tmp/SBPKKT00009.SBP
4 ETW000 active unconditional modes: 18
4 ETW000 Connected to DBMS = HDB --- SERVER = '' PORT = '' --- SYSTEM = 'SID'.
4 ETW690 COMMIT "0" "0"
4 ETW000 trace at level 1 opened for a given file pointer
4 ETW000
4 ETW000 ================== STEP 1 =====================
4 ETW000 date&time : 05.04.2023 - 09:01:42
4 ETW000 function : EXPORT
4 ETW000 data file : /usr/sap/trans/data/RT00009.SID
..........
Memory allocation issues encountered :
3 ETW678Xstart export of "R3TRTABU/DSD/SL_TGTYP" ...
4 ETW000 [dbsdbsql.cpp,00000] *** ERROR => prepare() of C_0128, rc=1, rcSQL=4
4 ETW000 [dbslsdb.cpp ,00000] *** ERROR => PREPARE C_0128 on connection 0, rc=4
4 ETW000 [ dev trc,00000] SQLCODE : 4
4 ETW000 [ dev trc,00000] SQLERRTEXT : cannot allocate enough memory: Out of memory on query compilation
4 ETW000 [ dev trc,00000] sc_p=7fc823483c20,no=128,idc_p=7fc823438760,con=0,act=1,slen=80,smax=256,#vars=1,stmt=55afb21cd810,table=/DSD/SL_TGTYP
4 ETW000 [ dev trc,00000] prepared=0,lastPrepareTime=,nativeSQL=0,ignoreStmtId=0
4 ETW000 [ dev trc,00000] stmtid = <3//DSD/SL_TGTYP /1619001408/20141020140645>
4 ETW000 [ dev trc,00000] SELECT * FROM "/DSD/SL_TGTYP" WHERE "CLIENT" = ? ORDER BY "CLIENT" , "TOLTYP_ID";
4 ETW000 [ dbtrtab ,00000] ***LOG BY4=>sql error 4 performing PRE on table /DSD/SL_TGTYP
4 ETW000 [ dbtrtab ,00000] ***LOG BY0=>cannot allocate enough memory: Out of memory on query compilation
4 ETW000 [ dev trc,00000] db_con_test_and_open: bad cursor delta, reset open cursors to 0
4 ETW000 [ dbcrtab ,00000] ***LOG BY7=>invalid cursor 65535 specified for database operation
2EETW125 SQL error "4" during "/DSD/SL_TGTYP" access: "cannot allocate enough memory: Out of memory on query compilation"
4 ETW000 0 entries from /DSD/SL_TGTYP exported (400).
4 ETW000 [dbsdbsql.cpp,00000] *** ERROR => execute() of C_0026, #rec=0, rc=1, rcSQL=129
4 ETW000 [dbslsdb.cpp ,00000] *** ERROR => EXECUTE C_0026 on connection 0, rc=129
4 ETW000 [ dev trc,00000] SQLCODE : 129
4 ETW000 [ dev trc,00000] SQLERRTEXT : transaction rolled back by an internal error: exception: no. 6946 ( \
4 ETW000 [ dev trc,00000] AttributeEngine/AttributeStoreFile.h: 395) TID: 7140. No further info because of\
4 ETW000 [ dev trc,00000] bad allocation in exception object.
4 ETW000 exception: no. 6946 ( Attribu\
4 ETW000 [ dev trc,00000] teEngine/AttributeStoreFile.h: 395) TID: 7140. No further info because of bad allo\
4 ETW000 [ dev trc,00000] cation in exception object.
4 ETW000 [ dev trc,00000] sc_p=7fc82347ff90,no=26,idc_p=7fc823434c00,con=0,act=1,slen=104,smax=256,#vars=2,stmt=55afb04a0f40,table=DD02L
4 ETW000 [ dev trc,00000] prepared=0,lastPrepareTime=20230405090143,nativeSQL=0,ignoreStmtId=0
4 ETW000 [ dev trc,00000] stmtid = <3/DD02L /1627390048/20160515192653>
4 ETW000 [ dev trc,00000] SELECT * FROM "DD02L" WHERE "TABNAME" = ? AND "AS4LOCAL" = ? ORDER BY "TABNAME" , "AS4LOCAL" , "AS4V\
4 ETW000 [ dev trc,00000] ERS";
4 ETW000 [ dbtrtab ,00000] ***LOG BY4=>sql error 129 performing SEL on table DD02L
4 ETW000 [ dbtrtab ,00000] ***LOG BY0=>transaction rolled back by an internal error: exception: no. 6946 ( AttributeEngine/AttributeStoreFile.h: 395) TID: 7140. No further info because of bad allocation in exception object.
4 ETW000 exception: no. 6946 ( AttributeEngine/AttributeStoreFile.h: 395) TID: 7140. No further info because of bad allocation in exception object.
2EETW000 sap_dext called with msgnr "1":
2EETW000 ---- db call info ----
2EETW000 function: db_setget
2EETW000 fcode: RT_SETB (65535)
2EETW000 tabname: DD02L
2EETW000 len (char): 31
2EETW000 key: /DSD/SL_TGTYP A
2EETW000 retcode: 1
2EETW000 sql error: 129 transaction rolled back by an internal error: exception: no. 6946 ( AttributeEngine/AttributeStoreFile.h: 395) TID: 7140. No further info becau
4 ETW000 last stringcontext was reset by twexport.c :1527
2EETW125 SQL error "129" during "" access: "transaction rolled back by an internal error: exception: no. 6946 ( AttributeEngine/AttributeStoreFile.h: 395) TID: 7140. No further info because of bad allocation in exception object."
4 ETW690 ROLLBACK "0" "0"
2EETP200 Export with errors, request will not be imported
1 ETP150 MAIN EXPORT
1 ETP110 end date and time : "2023-04-05-09:03:11"
1 ETP111 exit code : "12"
1 ETP199 ######################################
- The HANA service traces reveal that the backup catalog heap allocators are causing consistent resource container shrinks and even OOMs on the Nameserver and Indexserver :
Reason for shrink: IPMM (other process). Request ID= 6523871
ShrinkCaller
1: 0x00007f2d0f18d586 in ResourceManager::ShrinkInformation::updateShrinkInformation(char const*, unsigned long, bool)+0xb2 at ResourceContainerShrink.cpp:725 (libhdbbasis.so)
2: 0x00007f2d0f186b94 in ResourceManager::ResourceContainerImpl::genericShrink(unsigned long, unsigned long, char const*, unsigned long, MemoryManager::ReclaimMemoryTaskType)+0x640 at ResourceContainerShrink.cpp:2491 (libhdbbasis.so)
3: 0x00007f2d0f2a4176 in MemoryManager::CompactionThread::compactCompactors(unsigned long, bool&, char const*, unsigned long, MemoryManager::ReclaimMemoryTaskType)+0x582 at mmCompactionTrigger.cpp:955 (libhdbbasis.so)
4: 0x00007f2d0f29f4d6 in MemoryManager::CompactionThread::doCompactionIntern(MemoryManager::Precharge&, unsigned long, unsigned long, unsigned long, unsigned long&, char const*, unsigned long, MemoryManager::ReclaimMemoryTaskType, bool)+0xfc2 at mmCompactionTrigger.cpp:1116 (libhdbbasis.so)
5: 0x00007f2d0f2a04f5 in MemoryManager::CompactionThread::doIpmmCompactionIntern(unsigned long, int, unsigned long, unsigned long, unsigned long, MemoryManager::ProcessSlot::RequestedTask)+0x1b1 at mmCompactionTrigger.cpp:1704 (libhdbbasis.so)
6: 0x00007f2d0f2a143c in MemoryManager::CompactionThread::run(void*&)+0x188 at mmCompactionTrigger.cpp:1659 (libhdbbasis.so)
7: 0x00007f2d0f40ccf5 in Execution::Thread::staticMainImp(Execution::Thread*)+0x531 at Thread.cpp:522 (libhdbbasis.so)
8: 0x00007f2d0f3fc978 in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x1e4 at ThreadInterposition.cpp:639 (libhdbbasis.so)
9: 0x00007f2d0ea58539 in start_thread+0xd5 (libpthread.so.0)
10: 0x00007f2d0d0daecf in __GI___clone+0x3b (libc.so.6)
IPMM short info:
GLOBAL_ALLOCATION_LIMIT (GAL) = 292.84gb (314438582272b), SHARED_MEMORY = 19.55gb (20996517888b), CODE_SIZE = 2.88gb (3100405760b), OOM_RESERVATION_ALLOCATOR_SIZE = 96.14mb (100810752b)
PID=48854 (hdbnameserver), PAL=483.78gb (519464042496b), AB=153.61gb (164941623296b), UA=0, U=145.08gb (155783798981b), FSL=0b, FMC=0b
PID=49509 (hdbcompileserver), PAL=483.78gb (519464042496b), AB=447.98mb (469745664b), UA=0, U=115.51mb (121128841b), FSL=0b, FMC=0b, Blocked=796.86mb (835575808b)
PID=49512 (hdbpreprocessor), PAL=483.78gb (519464042496b), AB=217.05mb (227594240b), UA=0, U=121.94mb (127865865b), FSL=0b, FMC=0b
PID=49565 (hdbxsengine), PAL=483.78gb (519464042496b), AB=846.22mb (887328768b), UA=0, U=667.26mb (699678136b), FSL=0b, FMC=0b
PID=49562 (hdbindexserver), PAL=483.78gb (519464042496b), AB=115.26gb (123764838400b), UA=0, U=104.27gb (111960169124b), FSL=0b, FMC=0b
PID=50706 (hdbwebdispatcher), PAL=483.78gb (519464042496b), AB=408.50mb (428347392b), UA=0, U=325.82mb (341649832b), FSL=0b, FMC=0b
Total allocated memory= 293.19gb (314816401408b)
Total used memory = 272.99gb (293131214427b)
Sum AB = 290719477760
Sum Used = 269034290779
Heap memory fragmentation: 6
Top "M_HEAP_MEMORY" allocators (component, name, size). Ordered descending by exclusive_size_in_use.
1: Monitoring & Statistical Data: Pool/RowEngine/MonitorView/StatisticsMonitors/M_DEV_BACKUP_CATALOG_LOG 59.16gb (63528320512b) (256mb (268435456b) precharged, 1.48kb (1520b) in preparation)
2: Monitoring & Statistical Data: Pool/RowEngine/MonitorView/StatisticsMonitors/M_DEV_BACKUP_CATALOG_LOG_FILES 35.92gb (38577895936b) (256mb (268435456b) precharged, 1.21kb (1240b) in preparation)
3: Monitoring & Statistical Data: Pool/Statistics 33.15gb (35605021424b)
4: System: Pool/BackupRecoveryAllocator 10.08gb (10831460384b)
5: System: AllocateOnlyAllocator-unlimited/FLA-UL<120,256>/BigBlockInfoAllocator 2.96gb (3186451560b)
6: System: AllocateOnlyAllocator-unlimited/FLA-UL<48,128>/FreeBigBlockInfoAllocator 1.18gb (1274580624b)
7: System: AllocateOnlyAllocator-unlimited/FLA-UL<24592,1>/MemoryMapLevel3Nodes 1.17gb (1261569600b)
8: Column Store Tables: Pool/SerializedObject 384.61mb (403298224b)
9: System: Pool/RowEngine/QueryExecution/SearchAlloc 263.49mb (276298680b)
10: System: Pool/malloc/libhdbns.so 256.12mb (268568384b) (256mb (268435456b) precharged, 1.37kb (1408b) in preparation)
11: Statement Execution & Intermediate Results: Pool/JOB_EXECUTOR/Op 256.03mb (268468256b) (256mb (268435456b) precharged, 1.12kb (1152b) in preparation)
12: Statement Execution & Intermediate Results: StackAllocator 235.75mb (247201792b)
13: Column Store Tables: Pool/Text/AEText/split_positional_index 107.20mb (112415248b)
14: System: Pool/loadhistory 90.02mb (94403184b)
15: Statement Execution & Intermediate Results: Pool/SQLScript/Compile/Preprocessor 79.59mb (83464295b)
16: System: Pool/RowEngine/ContainerManager 46.75mb (49021008b)
17: Monitoring & Statistical Data: Pool/M_DELTA_MERGE_STATISTICS 42.72mb (44800448b)
18: System: Pool/malloc/libhdbrskernel.so 41.22mb (43226754b)
19: System: Pool/ResourceContainer 32.91mb (34511096b)
20: System: Pool/Metadata 31.33mb (32854760b)
[MEMORY_OOM] Information about current out of memory situation: (2023-04-06 17:24:12 847 Local)
OUT OF MEMORY occurred.
Host: <>
Executable: hdbnameserver
PID: 48854
Failed to allocate 47.18kb (48320b).
Allocation failure type: GLOBAL_ALLOCATION_LIMIT (early exit)
Current callstack:
1: 0x00007f2d0f212515 in MemoryManager::PoolAllocator::notifyOOMImpl(unsigned long, unsigned long, bool, ltt::allocation_failure_type, bool)+0x1b1 at mmPoolAllocator.cpp:2276 (libhdbbasis.so)
2: 0x00007f2d0f0c7add in ltt::allocator::notifyOOM(unsigned long, unsigned long, bool, ltt::allocation_failure_type, bool) [clone .constprop.0]+0x59 at memory.cpp:127 (libhdbbasis.so)
3: 0x00007f2d0f2196d0 in MemoryManager::PoolAllocator::oomHandling(unsigned long, unsigned long, bool)+0x60 at mmPoolAllocator.cpp:1220 (libhdbbasis.so)
4: 0x00007f2d0f212a73 in MemoryManager::PoolAllocator::allocateAlignedNoThrowImpl(unsigned long, unsigned long, void const*)+0xa0 at mmPoolAllocator.cpp:1812 (libhdbbasis.so)
5: 0x00007f2d143639f9 in ltt::allocator::allocateAligned(unsigned long, unsigned long)+0x25 at memory.cpp:298 (libhdbbasement.so)
6: 0x00007f2d147ec85c in TrexThreads::ThreadManager::getStatistics(ltt_adp::vector<TrexThreads::ThreadInfo, ltt::integral_constant<bool, true> >*, bool, bool, bool, bool, ltt_adp::map<unsigned long, ltt_adp::vector<unsigned long, ltt::integral_constant<bool, true> >, ltt::less<unsigned long>, ltt::integral_constant<bool, true> >*, bool)+0x1108 at memory.hpp:1212 (libhdbbasement.so)
7: 0x00007f2d147f71bf in Execution::ServiceThreadSamplerThread::createThreadSamples()+0x17b at ServiceThreadSamples.cpp:738 (libhdbbasement.so)
8: 0x00007f2d14802885 in Execution::ServiceThreadSamplerThread::run(void*&)+0x211 at ServiceThreadSamples.cpp:700 (libhdbbasement.so)
9: 0x00007f2d0f40ccf5 in Execution::Thread::staticMainImp(Execution::Thread*)+0x531 at Thread.cpp:522 (libhdbbasis.so)
10: 0x00007f2d0f3fc978 in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x1e4 at ThreadInterposition.cpp:639 (libhdbbasis.so)
11: 0x00007f2d0ea58539 in start_thread+0xd5 (libpthread.so.0)
12: 0x00007f2d0d0daecf in __GI___clone+0x3b (libc.so.6)
Memory consumption information of last failing ProvideMemory, PM-INX=2652335:
IPMM short info:
GLOBAL_ALLOCATION_LIMIT (GAL) = 292.84gb (314438582272b), SHARED_MEMORY = 19.55gb (20996517888b), CODE_SIZE = 2.88gb (3100405760b), OOM_RESERVATION_ALLOCATOR_SIZE = 96.14mb (100810752b)
PID=48854 (hdbnameserver), PAL=483.78gb (519464042496b), AB=158.45gb (170141044736b), UA=0, U=149.78gb (160834945085b), FSL=0b, FMC=0b
PID=49509 (hdbcompileserver), PAL=483.78gb (519464042496b), AB=703.34mb (737509376b), UA=0, U=115.43mb (121042313b), FSL=0b, FMC=0b, Blocked=796.86mb (835575808b)
PID=49512 (hdbpreprocessor), PAL=483.78gb (519464042496b), AB=217.11mb (227659776b), UA=0, U=121.92mb (127845417b), FSL=0b, FMC=0b
PID=49565 (hdbxsengine), PAL=483.78gb (519464042496b), AB=842.01mb (882913280b), UA=0, U=663.59mb (695830176b), FSL=0b, FMC=0b
PID=49562 (hdbindexserver), PAL=483.78gb (519464042496b), AB=109.86gb (117965447168b), UA=0, U=98.99gb (106292438504b), FSL=0b, FMC=0b
PID=50706 (hdbwebdispatcher), PAL=483.78gb (519464042496b), AB=403.62mb (423235584b), UA=0, U=320.03mb (335585128b), FSL=0b, FMC=0b
Total allocated memory= 292.87gb (314474733568b)
Total used memory = 272.41gb (292504610271b)
Sum AB = 290377809920
Sum Used = 268407686623
Heap memory fragmentation: 6
Top "M_HEAP_MEMORY" allocators (component, name, size). Ordered descending by exclusive_size_in_use.
1: Monitoring & Statistical Data: Pool/RowEngine/MonitorView/StatisticsMonitors/M_DEV_BACKUP_CATALOG_LOG 82.97gb (89089765888b) (256mb (268435456b) precharged, 1.48kb (1520b) in preparation)
2: Monitoring & Statistical Data: Pool/Statistics 33.15gb (35604689104b)
3: Monitoring & Statistical Data: Pool/RowEngine/MonitorView/StatisticsMonitors/M_DEV_BACKUP_CATALOG_LOG_FILES 17.09gb (18354745856b) (256mb (268435456b) precharged, 1.21kb (1240b) in preparation)
4: System: Pool/BackupRecoveryAllocator 10.08gb (10831460384b)
5: System: AllocateOnlyAllocator-unlimited/FLA-UL<120,256>/BigBlockInfoAllocator 2.75gb (2957311320b)
Read more...
Environment
SAP HANA Platform Edition 2.0
Product
SAP HANA, platform edition 2.0
Keywords
KBA , HAN-DB , SAP HANA Database , BC-CTS-CCO , Client Copy (For ByD issues select BC-TLM-CP) , HAN-DB-BAC , SAP HANA Backup & Recovery , Problem
About this page
This is a preview of a SAP Knowledge Base Article. Click more to access the full version on SAP for Me (Login required).Search for additional results
Visit SAP Support Portal's SAP Notes and KBA Search.
/support/notes/service/facebook.svg)
/support/notes/service/twitter.svg)
/support/notes/service/youtube.svg)
/support/notes/service/linkedin.svg)
/support/notes/service/instagram2.svg)