Symptom
When running the Survey Response (CSV) report for a specific period of time, for example three months, it can return different results depending of the report criteria submitted for date range in question.
Environment
SAP SuccessFactors Learning
Reproducing the Issue
- Access the Survey Response (CSV) report
- In the following example the report will be run three separate times: for March, April and May.
- The report is generated and for March there are 383 rows, April has 112 rows and May has 342 rows.
- 837 rows in total are generated
- Now run the report but this time for the full period of March 1st thru May 30th inclusive.
- 823 rows in total are generated. A discrepancy of 14 rows for the exact same time period
Cause
This is the expected behaviour of the standard report.
The data of the individual filter need not essentially add up to the combined data as the report is aggregating the response for all the survey responses of a given question with Item Completion date and within the range specified in the filter.
Resolution
The following explanation has been provided which confirms the behaviour. Consider the below data setup:
Survey A with Survey ID of 1001 has 1 question with a rating scale of 5
Survey Response | |||||
Row no | User | Item Completion Date | SurveyID | Question ID | Response |
1 | User A | Jan 1st | 1001 | 1 | 5 |
2 | User B | Feb 1st | 1001 | 1 | 3 |
Report Output: | |||||
Filter 1 : Jan 1st to Jan 30 | |||||
SurveyID | Total Survey | Completed Survey | SurveyID | QuestionID | Mean Score |
1 | 1 | 1001 | 1 | 5 | |
No of records : 1 | |||||
Filter 2: Feb 1st to Feb 28 | |||||
SurveyID | Total Survey | Completed Survey | SurveyID | QuestionID | Mean Score |
1 | 1 | 1001 | 1 | 3 | |
No of records : 1 | |||||
Filter 3: Jan 1st to Feb 28 | |||||
SurveyID | Total Survey | Completed Survey | SurveyID | QuestionID | Mean Score |
1 | 2 | 2 | 1001 | 1 | 4 |
No of records : 1 |
So when Individual filters are applied, the report for each month returns with one row for filters 1 and 2.
Whereas when a filter inclusive of both the data ranges is applied, filter 3, the data is aggregated and only one record is returned for a particular question. However for a given question, columns like Completed Survey and Total Survey should add up when a filter is applied for each month (or time range) individually.
So in relation to the data example in the Reproducing the Issue section. While there is an apparent discrepancy of 14 rows overall between the individual reports and the overall report the discrepancy is attributed to the aggregated score within the overall report for those questions where it has been possible to do so.
Keywords
Survey Response (CSV), Completed Survey, Total Survey, discrepancy, report, , KBA , LOD-SF-LMS-REP , Reporting Data , Bug Filed