2520909 - DB6: "Requesting too many semaphores" error

You can not execute any SQL statement using DB2 CLP.

SQL0902C A system error occurred. Subsequent SQL statements cannot be processed.
IBM software support reason code: "". SQLSTATE=58005

db2diag.log

2017-08-08-11.30.47.802805+540 I12593456E493         LEVEL: Severe
PID     : 123456               TID : 1                     PROC : db2fmp  
INSTANCE: db2abc               NODE : 000            DB   : abc     
APPID   : *LOCAL.db2abc.170807151441
HOSTNAME: abcd
FUNCTION: DB2 UDB, database application extension for DB/DBM config, dbm_get_cfg, probe:30
MESSAGE : SQL0902C  A system error occurred. Subsequent SQL statements cannot 
          be processed. IBM software support reason code: "".

2017-08-08-11.30.47.844304+540 I12593950E464         LEVEL: Severe
PID     : 123456                TID : 1                       PROC : db2sysc 0
INSTANCE: db2abc               NODE : 000
HOSTNAME: abcd
EDUID   : 16                   EDUNAME: jdoe 3
FUNCTION: DB2 UDB, common communication, sqlccGetIPCs, probe:50
RETCODE : ZRC=0x850F0081=-2062614399=SQLO_SSEM_EXCEED_MAX
          "Requesting too many semaphores"
          DIA8336C Requested too many semaphores.

In an earlier db2diag.log, you see

2017-08-08-00.00.00.230954+540 I2165284E412          LEVEL: Severe
PID     : 123456                 TID : 1                        PROC : db2sysc 0
INSTANCE: db2abc               NODE : 000
HOSTNAME: jdoe
FUNCTION: DB2 UDB, oper system services, sqlo_waitlist::initialize, probe:10
MESSAGE : SysV semget failed with errno:
DATA #1 : Hexdump, 4 bytes
0x00007F8E31FFDAF0 : 1C00 0000                                  ....

2017-08-08-00.00.00.259320+540 I2165697E414          LEVEL: Severe
PID     : 123456                 TID :1                         PROC : db2sysc 0
INSTANCE: db2abc               NODE : 000
HOSTNAME: abcd
FUNCTION: DB2 UDB, oper system services, sqloGetShrEDUWaitElem, probe:70
MESSAGE : waitlist initialization failed, zrc=
DATA #1 : Hexdump, 4 bytes
0x00007F8E31FFDB9C : 8100 0F85                                  ....

2017-08-08-00.00.00.287382+540 E2166112E476          LEVEL: Severe
PID     : 123456                 TID : 1                        PROC : db2sysc 0
INSTANCE: db2abc              NODE : 000
HOSTNAME: abcd
FUNCTION: DB2 UDB, oper system services, sqloEDUEntry, probe:10
CALLED  : DB2 UDB, oper system services, sqloGetShrEDUWaitElem
RETCODE : ZRC=0x850F0081=-2062614399=SQLO_SSEM_EXCEED_MAX
          "Requesting too many semaphores"
          DIA8336C Requested too many semaphores.

2017-08-08-00.00.00.314470+540 I2166589E416          LEVEL: Severe
PID     : 123456                 TID : 1                        PROC : db2sysc 0
INSTANCE: db2abc              NODE : 000
HOSTNAME: abcd
EDUID   : 16                   EDUNAME: jdoe 3
FUNCTION: DB2 UDB, global services, sqzEDUObj::StartEDU, probe:10
RETCODE : ZRC=0x870F00F2=-2029059854=SQLO_NORES
          "no resources to create process or thread"

2017-08-08-00.00.00.523897+540 I2167884E498          LEVEL: Severe
PID     : 123456                 TID : 1                        PROC : db2sysc 0
INSTANCE: db2abc              NODE : 000
HOSTNAME: abcd
EDUID   : 16                   EDUNAME: jdoe 3
FUNCTION: DB2 UDB, base sys utilities, sqeAgentServices::RequestAgentForAppl, probe:2118
RETCODE : ZRC=0xFFFFFB37=-1225
          SQL1225N  The request failed because an operating system process, 
          thread, or swap space limit was reached.

• IBM Db2 on Linux and Unix operating system
• Db2 9.7 and higher

SQL1225N, DIA8336C, ADM7519W, SQLO_SSEM_EXCEED_MAX, semaphores, SysV semget, resource , KBA , semaphores , sql1225n , adm7519w , dia8336c , BC-DB-DB6 , DB2 Universal Database for Unix / NT , BC-DB-DB6-DBA , Database Administration , Problem