3300830 - Query Errors : "Insufficient buffers for 'Sort' " or "Insufficient buffers for 'Run' " -- SAP IQ

• Either during periods of peak data loading(inserting) or Query operations like ordering(sort) and grouping, the following error may occur frequently,
  
  Insufficient buffers for 'Sort'
  Insufficient buffers for 'Run'

• After the migration to IQ16.1(0) from lower version (IQ15.4), such 'Insufficient buffers' errors could be often produced because IQ16.x enforced parallel operations and required more buffers.
  
  
• Under such long & heavy Insufficient buffer conditions, server may become unresponsive status because of no more available buffer conditions
  Error Messages:
  ...
  Exception Thrown from slib/s_csort.cxx:1381, Err# 2, tid 3 origtid 3
  O/S Err#: 0, ErrID: 2062 (hs_csortexception); SQLCode: -1009134, SQLState: 'QSB34', Severity: 14
  [21023]: Insufficient buffers for 'Sort'. -- (slib/s_csort.cxx 1381)
  
  OR
  Could not execute statement.
  Insufficient buffers for 'Run'.
  -- (slib/s_PinCache.cxx 171)
  SQLCODE=-1009134, ODBC 3 State="HY000"
  
  
• Following informational stacktrace could be found.
  • Stack exampe 1:
    hs_csort..DumpExceptionForSort ..
    hs_csort..PlanPinnedBuffers ..
    hs_csort..InitializeResources ..
    hs_csort..PrepareToInsert ..
    
    dfo_cOrderBy..PrefetchAndSort ..
    dfo_cOrderBy.FetchOpus ..
    dfjo_MergeBase..FirstFetch ..
    dfjo_MergeRightKeyedOuters ..
    dfo_Join9FetchOpusEv ..
    
    
  • Stack exampe 2:
    StackTraceForThisThread ..
    hs_csort::DumpExceptionForSort ..
    hs_csort::PlanPinnedBuffers ..
    hs_csort::InitializeResources ..
    hs_csort::PrepareToInsert ..
    
    dfo_GroupByUnordered::PrepareCommon ..
    dfo_GroupByUnordered::PrepareForNextWorkUnit ..
    dfo_cOrderByParaIn::ExecWork ..
    
    
  • Stack exampe 3:
    StackTraceForThisThread ..
    hc_dmfrun::CheckException ..
    hc_dmfrun::SelectInputRun_WithTryCatch ..
    hc_dmfrun::AdvanceBuffer ..
    
    dfo_Combiner::FetchOpus ..
    dfo_Sequencer::FetchOpus ..
    dfo_Root::FetchOpus ..
    dfo::Fetch ..
    db_dmlcommand::ExecuteDFOTree ..
    db_InsertRoot::Execute ..
    st_command::DoCmdThroughResourceGate ..
    st_iqdml::Insert ..

• SAP IQ15.X
• SAP IQ16.0
• SAP IQ16.1

SORT_PINNABLE_CACHE_PERCENT, HASH_PINNABLE_CACHE_PERCEN, s_PinCache, Insufficient buffers for 'Run', QCPRun, 'db_sqlins.cxx', hs_PinCacheException, 'insufficient buffers for sort', "Insufficient buffers", "All buffer cache pages are in use" , s_csort,  KBAs: 2278361 2252629 2452208 2142208 21447351 2762484 2149266 2003554 2305087 , KBA , BC-SYB-IQ , Sybase IQ , BW-SYS-DB-IQ , BW on HANA with Sybase IQ Near-line Storage , Known Error