SAP Knowledge Base Article - Preview

2436358 - CSV Input Adapter stopped processing data - SAP Event Stream Processor

Symptom

  • The Streaming project is using a CSV Input Adapter to read data from CSV files.
  • The project is processing approximately 45000 transactions per second from the input adapter.
  • When monitoring the _ESP_Connectors metadata stream for the project, the status for the adapter is shown as "CONTINUOUS" and the total processed rows (Good Rows) are shown as increasing (as expected).
  • However, at some point, around 15-16 hours later, the following occurred:
    • The project stopped processing data because the CSV Input adapter was unable to read data from the files.
    • The _ESP_Connectors for the project indicated that the status for the adapter was "CONTINUOUS", and showed the total rows processed (Good Rows) was "2147473408" and then remained at this value.
    • The following error message was reported in the stdstream.log: "AdapterMonitor.printModuleBufferInfo) Current size of buffer between module FileInputTransporter and CsvStringToEspFormatter is 20480, and it is beyond its threshold 7168."
    • Instructions for troubleshooting this error message cannot be found in the Adapters Guide.
    • Instructions on how to increase the buffer size value cannot be found in the Adapters guide.
    • However, the buffer size value was changed from 10240 to 30720 in /SybaseEsp/ESP-5_1/adapters/framework/instances/file_csv_input/adapter_config.xml, and the ESP project was restarted.
    • It was then observed that the CSV input adapter was able to process data.
    • It is unclear if restarting the project resolved the issue, or if increasing the buffer size resolved the issue.
    • It was then observed that the warning messages logged in stdstreams.log were as follows:
      • "(AdapterMonitor.printModuleBufferInfo) Current size of buffer between module FileInputTransporter and CsvStringToEspFormatter is 20480, and it is beyond its threshold 7168."
      • "(AdapterMonitor.printModuleBufferInfo) Current size of buffer between module CsvStringToEspFormatter and MyInStream_Publisher is 30699, and it is beyond its threshold 21504."


Read more...

Environment

  • SAP Event Stream Processor (ESP) 5.1 SP12 SP12 Rev122 PL03
  • Linux on AMD/Intel x86_64

Product

SAP Event Stream Processor 5.1

Keywords

streaming, processing,esp , KBA , BC-SYB-ESP , Sybase ESP (Event Stream Processor) , Problem

About this page

This is a preview of a SAP Knowledge Base Article. Click more to access the full version on SAP for Me (Login required).

Search for additional results

Visit SAP Support Portal's SAP Notes and KBA Search.