3779257 - Solr indexing cronjob fails due to timeout when using InfixLookupFactory in suggester configuration

• Solr indexing fails with timeout errors.

• The following error can be observed:

  Timeout occurred while waiting response from server xxx

• Azure disk IOPS utilization reaches close to 100%.
• Thread dump analysis shows long-running Solr threads during indexing operations, with stack traces related to suggester build operations.:

  "searcherExecutor-250-thread-3-processing-solr-0.solr.default.svc.cluster.local:8983_solr master_xxx_xxx_xxx_flop_shard1_replica_n2 solr-0.solr.default.svc.cluster.local-15829 master_xxx_xxx_xxx_flop shard1 core_node4" #1461 [4437] prio=5 os_prio=0 cpu=405640.27ms elapsed=2603.13s allocated=435G defined_classes=2 tid=0x00007878a0025300 nid=4437 runnable  [0x000078789297d000]
     java.lang.Thread.State: RUNNABLE
      at org.apache.lucene.util.compress.LZ4.decompress(LZ4.java:138)
      at org.apache.lucene.codecs.lucene90.LZ4WithPresetDictCompressionMode$LZ4WithPresetDictDecompressor.decompress(LZ4WithPresetDictCompressionMode.java:136)
      at org.apache.lucene.codecs.lucene90.compressing.Lucene90CompressingStoredFieldsReader$BlockState.document(Lucene90CompressingStoredFieldsReader.java:595)
      at org.apache.lucene.codecs.lucene90.compressing.Lucene90CompressingStoredFieldsReader.serializedDocument(Lucene90CompressingStoredFieldsReader.java:610)
      at org.apache.lucene.codecs.lucene90.compressing.Lucene90CompressingStoredFieldsReader.document(Lucene90CompressingStoredFieldsReader.java:628)
      at org.apache.lucene.index.CodecReader$1.document(CodecReader.java:109)
      at org.apache.lucene.index.BaseCompositeReader$2.document(BaseCompositeReader.java:187)
      at org.apache.lucene.index.StoredFields.document(StoredFields.java:72)
      at org.apache.lucene.search.suggest.DocumentDictionary$DocumentInputIterator.next(DocumentDictionary.java:169)
      at org.apache.lucene.search.suggest.analyzing.AnalyzingInfixSuggester.build(AnalyzingInfixSuggester.java:346)
      - locked <0x00000003005fb438> (a java.lang.Object)
      at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:175)
      at org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:175)
      at org.apache.solr.handler.component.SuggestComponent$SuggesterListener.buildSuggesterIndex(SuggestComponent.java:583)
      at org.apache.solr.handler.component.SuggestComponent$SuggesterListener.newSearcher(SuggestComponent.java:569)
      at org.apache.solr.core.SolrCore.lambda$getSearcher$20(SolrCore.java:2653)
      at org.apache.solr.core.SolrCore$$Lambda/0x0000000800a0e180.call(Unknown Source)
      at java.util.concurrent.FutureTask.run(java.base@21.0.11/FutureTask.java:317)
      at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)
      at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda/0x0000000800482920.run(Unknown Source)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@21.0.11/ThreadPoolExecutor.java:1144)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@21.0.11/ThreadPoolExecutor.java:642)
      at java.lang.Thread.runWith(java.base@21.0.11/Thread.java:1596)
      at java.lang.Thread.run(java.base@21.0.11/Thread.java:1583)

     Locked ownable synchronizers:
      - <0x0000000310a3c810> (a java.util.concurrent.ThreadPoolExecutor$Worker)

• SAP Commerce Cloud
• Apache Solr + Azure premium ssd v1 disk

solr timeout, backoffice indexing, recovering replica, zookeeper, buildOnCommit, suggester, blendedinfixlookupfactory, fstlookupfactory, freetextlookupfactory, tlog growth, disk full, no space left on device, iops saturation, commit timeout, after_batch commit , KBA , CEC-SCC-COM-SRC-SER , Search and Navigation , Problem