Symptom
- The Streaming project is using a CSV Input Adapter to read data from CSV files.
- The project is processing approximately 45000 transactions per second from the input adapter.
- When monitoring the _ESP_Connectors metadata stream for the project, the status for the adapter is shown as "CONTINUOUS" and the total processed rows (Good Rows) are shown as increasing (as expected).
- However, at some point, around 15-16 hours later, the following occurred:
- The project stopped processing data because the CSV Input adapter was unable to read data from the files.
- The _ESP_Connectors for the project indicated that the status for the adapter was "CONTINUOUS", and showed the total rows processed (Good Rows) was "2147473408" and then remained at this value.
- The following error message was reported in the stdstream.log: "AdapterMonitor.printModuleBufferInfo) Current size of buffer between module FileInputTransporter and CsvStringToEspFormatter is 20480, and it is beyond its threshold 7168."
- Instructions for troubleshooting this error message cannot be found in the Adapters Guide.
- Instructions on how to increase the buffer size value cannot be found in the Adapters guide.
- However, the buffer size value was changed from 10240 to 30720 in /SybaseEsp/ESP-5_1/adapters/framework/instances/file_csv_input/adapter_config.xml, and the ESP project was restarted.
- It was then observed that the CSV input adapter was able to process data.
- It is unclear if restarting the project resolved the issue, or if increasing the buffer size resolved the issue.
- It was then observed that the warning messages logged in stdstreams.log were as follows:
- "(AdapterMonitor.printModuleBufferInfo) Current size of buffer between module FileInputTransporter and CsvStringToEspFormatter is 20480, and it is beyond its threshold 7168."
- "(AdapterMonitor.printModuleBufferInfo) Current size of buffer between module CsvStringToEspFormatter and MyInStream_Publisher is 30699, and it is beyond its threshold 21504."
Read more...
Environment
- SAP Event Stream Processor (ESP) 5.1 SP12 SP12 Rev122 PL03
- Linux on AMD/Intel x86_64
Product
SAP Event Stream Processor 5.1
Keywords
streaming, processing,esp , KBA , BC-SYB-ESP , Sybase ESP (Event Stream Processor) , Problem
About this page
This is a preview of a SAP Knowledge Base Article. Click more to access the full version on SAP for Me (Login required).Search for additional results
Visit SAP Support Portal's SAP Notes and KBA Search.