SAP Knowledge Base Article - Preview

3293198 - SLES15 - Operating system directory cache - SAP HANA Performance degradation

Symptom

***Consulting KBA, not a general best practice parameter recommendation***

The described symptoms were observed altogether on a physical 12TB HPE superdome 280 flex appliance during an initial data migration using AMDPs. However, all these symptoms may also occur on virtualized environments as the root cause is related to the VFS layer of the operating system.

  • AMDPs are used to load the data into the application tables.
  • Data loading gradually slowing down - SAP HANA threads are in waiting status.
  • Data load jobs are still running, not getting canceled.
  • Hundreds/thousands of HANA delta merges are executed (this case mainly the partitioned ACDOCA was merged frequently).
  • HANA delta merge is much slower than expected (e.g.: instead of 2-3 minutes, 15-20 minutes).
  • No errors are shown in HANA traces or OS logs.
  • xfs filesystems are used for the HANA data and log volumes.
  • Command sar -v shows a gradual increase in dentunusd and inode-nr to the millions (sometimes also file-nr increase is observed).
  • Command cat /proc/sys/fs/procfs-drop-fd-dentries returns 0.
  • A host reboot temporarily solves the performance problem of the HANA database.

Example output of sar -v command from the affected HANA appliance

17:29:01     LINUX RESTART      (448 CPU)

17:30:02   dentunusd   file-nr  inode-nr    pty-nr
17:40:01       550860         0    634370         2
17:50:01       552204         0    635438         2
18:00:01       557367         0    638614         1
18:10:01       561830         0    642935         2
18:20:01       586183         0    666989         1
18:30:01      7633752         0   7714264         1
18:40:01      8333978         0   8414329         1
18:50:01      9119090         0   9199236         2
19:00:01      9822858         0   9902770         2
19:10:01     10595798         0  10675525         1
19:20:01     11364800         0  11444307         1
19:30:01     11944406         0  12023604         2
19:40:01     12582432         0  12661467         1
19:50:01     13272772         0  13351700         2

20:00:01     14069036         0  14173086         2
20:10:01     14888279         0  14992185         3
20:20:01     15702080         0  15805362         3
20:30:01     23744648         0  23850623         3


Read more...

Environment

  • SLES15 SP2
  • SAP HANA 2.0 rev. 65
  • SAP S/4HANA 2021 FPS01
  • 12TB HPE superdome 280 flex appliance
  • Linux kernel 5.3.18-24.86

Product

SAP HANA, platform edition 2.0 ; SAP S/4HANA 2021

Keywords

dentunusd, SLES15, VFS, directory cache, procfs-drop-fd-dentries, /proc/sys/vm/drop_caches , KBA , BC-OP-LNX-HPE , Linux on HPE Hardware , HAN-DB-PERF , SAP HANA Database Performance , Problem

About this page

This is a preview of a SAP Knowledge Base Article. Click more to access the full version on SAP for Me (Login required).

Search for additional results

Visit SAP Support Portal's SAP Notes and KBA Search.