2501031 - How to analyze/increase the Extractor Framework performance/throughput

The Extractor Framework in the SAP Solution Manager is not able to trigger all extractors in the correct period. For example, extractors that should run every 30 or 60 minutes are not executed correctly in this period. Some extractors that are delayed show the message:

• Time based chunks <timestamp of data collected>

The Extractor Framework has a main job which controls and triggers all active extractors in the SAP Solution Manager system, the job name is EFWK RESOURCE MANAGER. The EFWK RESOURCE MANAGER is (must be) scheduled to run every minute in the SAP Solution Manager system.

When the Extractor Framework is overloaded, one symptom is the following messages in the job log:

• Message: DIA WP Resource Cap Exceeded
• NONE  Message: RFC Resource Cap Exceeded
• NONE DIA WP Resource Failure

If the above messages appears sporadically in a few job executions, they might not indicate a resource issue. However, if the above messages are frequently shown the Extractor Framework probably has a resource issue.

Another way to check if the Extractor Framework is being able to process all the load is mentioned in section 'Analyzing the Performance' of the Extractor Framework Troubleshooting (sap.com). In case that the Extractor Framework is not able to process 100% of the extractors in most of the time, there is a backlog in the Extractor Framework.

To check directly the size of the backlog, do as follows:

1. Display table E2E_EFWK_STATUS in transaction SE16.
2. Set the priority field between 100 and 998.
3. Click on "Number of Entries" at the top. This is the size of the backlog.

Ideally the EFWK RESOURCE MANAGER job duration would not exceed 60 seconds, but when the Solution Manager system has a high number of managed systems and thus a high number of extractors to be executed, we can expect to see the job running for up to 300 seconds without meaning a resource issue if the required throughput is achieved and there is no backlog in the table above.

• SAP Solution Manager 7.10 and 7.20
• SAP Solution Manager Diagnostics

 BW extractors, ITSM, CHARM, EFWK RESOURCE MANAGER , KBA , SV-SMG-DIA-SRV-EFW , Extractor Framework , Problem