3261306 - ERROR [SQL-2] general error: remove not allowed;cannot remove indexserver host:port. reorg for volume <id> is in state 'failed'

• The attempted removal of an additional indexserver node fails. indexserver & nameserver traces show the following  :

[40470]\{106854\}[26/81009] 2022-10-05 12:14:22.388823 e SQL              qx_database.cc(00771) : Error in removeTenantService: removeServer.size()1 result: 18446744073709551615 error: remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed'. 
[40470]\{108745\}[26/85403] 2022-10-05 14:18:33.011952 e SQL              qx_database.cc(00771) : Error in removeTenantService: removeServer.size()1 result: 18446744073709551615 error: remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed'. 

[12831]{-1}[-1/-1] 2022-10-05 12:14:22.388506 e indexserver      TREXIndexServer.cpp(04978) : Error while handle_removeTenantService: ERROR [SQL-2] general error: remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed' at BuiltinProcedure/impl/BP_UpdateLandscapeConfiguration.cc:59
    remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed'
[62771]{-1}[-1/-1] 2022-10-05 14:18:33.011458 e indexserver      TREXIndexServer.cpp(04978) : Error while handle_removeTenantService: ERROR [SQL-2] general error: remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed' at BuiltinProcedure/impl/BP_UpdateLandscapeConfiguration.cc:59
    remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed'
 
 

[96963]\{348494\}[-1/-1] 2022-10-05 12:14:21.562316 e LandscapeReorg   Location.cpp(00274) : Table 'SAPHANADB'.'/BIC/BD000000276' - Part 1 found in persistence of location Hostname:30040
[96963]\{348494\}[-1/-1] 2022-10-05 12:14:21.562318 e LandscapeReorg   Location.cpp(00274) : Table 'SAPHANADB'.'/BIC/BD000000280' - Part 1 found in persistence of location Hostname:30040
[96963]{-1}[-1/-1] 2022-10-05 12:14:21.562504 e LandscapeReorg   Location.cpp(00291) : Actual counted 180 tables/Parts in persistence on Hostname:30040. Host is not empty.
[96963]{-1}[-1/-1] 2022-10-05 12:14:21.562512 e LandscapeReorg   Location.cpp(00298) : Persistence Check: Location Hostname:30040 is NOT empty. Check took 194 ms
[96963]{-1}[-1/-1] 2022-10-05 12:14:21.578987 e LandscapeReorg   Algo_ClearServer.cpp(00260) : updated indexserver removal state for Hostname:30040 to 'REORG FAILED'
[12831]{-1}[-1/-1] 2022-10-05 12:14:22.388506 e indexserver      TREXIndexServer.cpp(04978) : Error while handle_removeTenantService: ERROR [SQL-2] general error: remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed' at BuiltinProcedure/impl/BP_UpdateLandscapeConfiguration.cc:59
exception  1: no.71000002  (BuiltinProcedure/impl/BP_UpdateLandscapeConfiguration.cc:59) TID: 12831
    remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed'
NO exception throw location recorded. Stack generation suppressed.
exception type information:
 - 0: public ptime::SQLException@0x00007fb4129a8308 SI
   - 0: public ptime::SQLExceptionBase@0x00007fb4129a7140 SI
     - 0: public Diagnose::SQLExceptionBase@0x00007fb4129a5798 SI
       - 0: public ltt::exception@0x00007fb3e9eda8e8
    
    
    
[63073]\{302226\}[-1/-1] 2022-10-05 14:18:29.934039 e LandscapeReorg   Location.cpp(00274) : Table 'SAPHANADB'.'/BIC/BD000000276' - Part 1 found in persistence of location Hostname:30040
[63073]\{302226\}[-1/-1] 2022-10-05 14:18:29.934041 e LandscapeReorg   Location.cpp(00274) : Table 'SAPHANADB'.'/BIC/BD000000280' - Part 1 found in persistence of location Hostname:30040
[63073]{-1}[-1/-1] 2022-10-05 14:18:29.934227 e LandscapeReorg   Location.cpp(00291) : Actual counted 180 tables/Parts in persistence on Hostname:30040. Host is not empty.
[63073]{-1}[-1/-1] 2022-10-05 14:18:29.934235 e LandscapeReorg   Location.cpp(00298) : Persistence Check: Location Hostname:30040 is NOT empty. Check took 214 ms
[63073]{-1}[-1/-1] 2022-10-05 14:18:29.948085 e LandscapeReorg   Algo_ClearServer.cpp(00260) : updated indexserver removal state for Hostname:30040 to 'REORG FAILED'
[62771]{-1}[-1/-1] 2022-10-05 14:18:33.011458 e indexserver      TREXIndexServer.cpp(04978) : Error while handle_removeTenantService: ERROR [SQL-2] general error: remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed' at BuiltinProcedure/impl/BP_UpdateLandscapeConfiguration.cc:59
exception  1: no.71000002  (BuiltinProcedure/impl/BP_UpdateLandscapeConfiguration.cc:59) TID: 62771
    remove not allowed;cannot remove indexserver Hostname:30040. reorg for volume 5 is in state 'failed'
NO exception throw location recorded. Stack generation suppressed.
exception type information:
 - 0: public ptime::SQLException@0x00007f76ebcbd308 SI
   - 0: public ptime::SQLExceptionBase@0x00007f76ebcbc140 SI
     - 0: public Diagnose::SQLExceptionBase@0x00007f76ebcba798 SI
       - 0: public ltt::exception@0x00007f76c31ef8e8

• Already followed KBA 2342394 - Unable to remove additional index server, but the errors still remain post reorg.

SAP HANA platform edition 2.0

SAP HANA platform edition 1.0

KBA , HAN-DB , SAP HANA Database , HAN-LM-PLT , SAP HANA Platform Lifecycle Management , Problem