2962726 - HANA DB generating many catalog backup files

HANA DB generating backup catalog history files every few minutes with size of more than 7GB and which is causing file system to DISK FULL situation.

>>><<<
-13658]{-1}[-1/-1] 2020-06-26 11:59:26.781577 i Backup BackupExecutor.cpp(00550) : Starting serial FILE backup in 1 chunks. 1.: Backup of BackupSource: [CATALOG] Version 1 @ 0x00007f0f00e87240 into BackupDestination: [FILE][/usr/sap/ABC/ABC03/backup/log/DB_ABC/log_backup_0_0_0_0.1593143966778], max size 18446744073709551615, version 10 @ 0x00007f1e537fc180, channel="<root>/.log_backup_0_0_0_0.1593143966778" ((open, mode= W, access= rw-r-----, flags= ASYNC|DIRECT|TRUNCATE|UNALIGNED_SIZE), factory= (root= "/usr/sap/ABC/ABC03/backup/log/DB_ABC/" (access= rw-r-----, flags= AUTOCREATE_PATH|DISKFULL_ERROR, usage= CATALOG_BACKUP, fs= xfs, config= (async_write_submit_active=on,async_write_submit_blocks=all,async_read_submit=on,num_submit_queues=1,num_completion_queues=1,size_kernel_io_queue=512,max_parallel_io_requests=64,min_submit_batch_size=16,max_submit_batch_size=64)), callback=0x00007f0f00863240
[13146]{-1}[-1/-1] 2020-06-26 11:59:39.518772 e FileIO LocalFileCallback.cpp(00354) : ERROR in async. file transfer: exception 1: no.2000008 (Basis/IO/FileAccess/impl/LocalFileCompletionThread.cpp:320) TID: 13146
Error during asynchronous file transfer (io_getevents), rc=28: No space left on device; $fileCallback$=[W] , buffer= 0x00007f1815440000, offset= 6291460096, size= 0/8388608, file= "<root>/.log_backup_0_0_0_0.1593143966778" ((open, mode= W, access= rw-r-----, flags= ASYNC|DIRECT|TRUNCATE|UNALIGNED_SIZE), factory= (root= "/usr/sap/ABC/ABC03/backup/log/DB_ABC/" (access= rw-r-----, flags= AUTOCREATE_PATH|DISKFULL_ERROR, usage= CATALOG_BACKUP, fs= xfs, config= (async_write_submit_active=on,async_write_submit_blocks=all,async_read_submit=on,num_submit_queues=1,num_completion_queues=1,size_kernel_io_queue=512,max_parallel_io_requests=64,min_submit_batch_size=16,max_submit_batch_size=64))) {shortRetries= 0, fullRetries= 0 (0/10)}
exception throw location:
1: 0x00007f1f8a8e21f9 in FileAccess::LocalFileIOControlBlock::reportError(char const*, unsigned long, char const*, int)+0x35 at LocalFileCallback.cpp:347 (libhdbbasis.so)
2: 0x00007f1f8a8e4f99 in FileAccess::LocalFileCompletionThread::run(void*&)+0xe05 at LocalFileCompletionThread.cpp:320 (libhdbbasis.so)
3: 0x00007f1f8a92ab48 in Execution::Thread::staticMainImp(Execution::Thread*)+0x534 at Thread.cpp:529 (libhdbbasis.so)
4: 0x00007f1f8a91a79d in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x169 at ThreadInterposition.cpp:636 (libhdbbasis.so)
5: 0x00007f1f8a0a42de in start_thread+0xfa (libpthread.so.0)
6: 0x00007f1f888a0a63 in __GI___clone+0x40 (libc.so.6)
exception type information:
- 0: public ltt::exception@0x7f1f8a008960
[13600]{-1}[59/-1] 2020-06-26 11:59:39.522172 e Backup BackupSrc_Catalog.cpp(00149) : something went wrong: exception 1: no.110089 (Backup/Destination/impl/BackupDest_DestCallback.cpp:150) TID: 13600
Error writing backup to 'FILE' '/usr/sap/ABC/ABC03/backup/log/DB_ABC/log_backup_0_0_0_0.1593143966778'
exception throw location:
1: 0x00007f1f94950a8b in Backup::BackupDest_DestCallback::wait(unsigned long, bool)+0x3b7 at BackupDest_DestCallback.cpp:150 (libhdbbackup.so)
2: 0x00007f1f9495aaac in Backup::BackupDest_DestinationSPI::sendSynchronous(void*, unsigned long)+0x108 at BackupDest_DestinationSPI.cpp:229 (libhdbbackup.so)
3: 0x00007f1f9492cd0a in Backup::BackupSrc_Catalog::executeSave(ltt::shared_ptr<Backup::BackupDest_Destination, ltt::default_deleter>, Backup::Backup_Progress&)+0x136 at BackupSrc_Catalog.cpp:127 (libhdbbackup.so)
4: 0x00007f1f949d1641 in Backup::BackupExe_JobBackup::runBackupJob()+0x2e0 at BackupExe_JobBackup.cpp:101 (libhdbbackup.so)
5: 0x00007f1f949ceb26 in Backup::BackupExe_Job::run(Execution::Context&, Execution::JobObject&)+0x12 at BackupExe_Job.hpp:54 (libhdbbackup.so)
6: 0x00007f1f8a97f868 in Execution::JobObjectImpl::run(Execution::JobWorker*)+0x2174 at JobExecutorImpl.cpp:1157 (libhdbbasis.so)
7: 0x00007f1f8a9697d7 in Execution::JobWorker::runJob(ltt::smartptr_handle<Execution::JobObjectForHandle>&)+0x313 at JobExecutorThreads.cpp:381 (libhdbbasis.so)
8: 0x00007f1f8a96b635 in Execution::JobWorker::run(void*&)+0xd51 at JobExecutorThreads.cpp:1278 (libhdbbasis.so)
9: 0x00007f1f8a92ab48 in Execution::Thread::staticMainImp(Execution::Thread*)+0x534 at Thread.cpp:529 (libhdbbasis.so)
10: 0x00007f1f8a91a79d in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x169 at ThreadInterposition.cpp:636 (libhdbbasis.so)
11: 0x00007f1f8a0a42de in start_thread+0xfa (libpthread.so.0)
12: 0x00007f1f888a0a63 in __GI___clone+0x40 (libc.so.6)
exception type information:
- 0: public ltt::exception@0x7f1f8a008960
exception 2: no.2000008 (Basis/IO/FileAccess/impl/LocalFileCompletionThread.cpp:320) TID: 13146
Error during asynchronous file transfer (io_getevents), rc=28: No space left on device; $fileCallback$=[W] , buffer= 0x00007f1815440000, offset= 6291460096, size= 0/8388608, file= "<root>/.log_backup_0_0_0_0.1593143966778" ((open, mode= W, access= rw-r-----, flags= ASYNC|DIRECT|TRUNCATE|UNALIGNED_SIZE), factory= (root= "/usr/sap/ABC/ABC03/backup/log/DB_ABC/" (access= rw-r-----, flags= AUTOCREATE_PATH|DISKFULL_ERROR, usage= CATALOG_BACKUP, fs= xfs, config= (async_write_submit_active=on,async_write_submit_blocks=all,async_read_submit=on,num_submit_queues=1,num_completion_queues=1,size_kernel_io_queue=512,max_parallel_io_requests=64,min_submit_batch_size=16,max_submit_batch_size=64))) {shortRetries= 0, fullRetries= 0 (0/10)}
exception throw location:
1: 0x00007f1f8a8e21f9 in FileAccess::LocalFileIOControlBlock::reportError(char const*, unsigned long, char const*, int)+0x35 at LocalFileCallback.cpp:347 (libhdbbasis.so)
2: 0x00007f1f8a8e4f99 in FileAccess::LocalFileCompletionThread::run(void*&)+0xe05 at LocalFileCompletionThread.cpp:320 (libhdbbasis.so)
3: 0x00007f1f8a92ab48 in Execution::Thread::staticMainImp(Execution::Thread*)+0x534 at Thread.cpp:529 (libhdbbasis.so)
4: 0x00007f1f8a91a79d in Execution::pthreadFunctionWrapper(Execution::Thread*)+0x169 at ThreadInterposition.cpp:636 (libhdbbasis.so)
5: 0x00007f1f8a0a42de in start_thread+0xfa (libpthread.so.0)
6: 0x00007f1f888a0a63 in __GI___clone+0x40 (libc.so.6)
>>><<<

Housekeeping like mention in following already done:

• https://help.sap.com
• SAP Note#2505218 - Large Log Backups due to large backup catalog
• SAP Note#2582445 - HANA Log backup are growing to 16GB file size
• SAP Note#2096851 - Backup Catalog Housekeeping within HANA DB

But the size of the Backup catalog will not reduced and be still written every few minutes in the full 7Gb size.

HANA DB 2.0

high, big, overloaded , KBA , HAN-DB-BAC , SAP HANA Backup & Recovery , Problem