SAP Knowledge Base Article - Public

3421960 - Survey Response (CSV) report returns different results for the same timeline

Symptom

When running the Survey Response (CSV) report for a specific period of time, for example three months, it can return different results depending of the report criteria submitted for date range in question.

Environment

SAP SuccessFactors Learning

Reproducing the Issue

  1. Access the Survey Response (CSV) report
  2. In the following example the report will be run three separate times: for March, April and May.
  3. The report is generated and for March there are 383 rows, April has 112 rows and May has 342 rows. 
  4. 837 rows in total are generated
  5. Now run the report but this time for the full period of March 1st thru May 30th inclusive.
  6. 823 rows in total are generated. A discrepancy of 14 rows for the exact same time period

Cause

This is the expected behaviour of the standard report.

The data of the individual filter need not essentially add up to the combined data as the report is aggregating the response for all the survey responses of a given question with Item Completion date and within the range specified in the filter.



Resolution

The following explanation has been provided which confirms the behaviour. Consider the below data setup:

Survey A with Survey ID of 1001 has 1 question with a rating scale of 5

Survey Response     
Row noUser      Item Completion DateSurveyIDQuestion IDResponse
1User AJan 1st100115
2User BFeb 1st100113

Report Output:     
Filter 1 : Jan 1st to Jan 30     
SurveyIDTotal Survey    Completed Survey       SurveyID           QuestionID       Mean Score
11 100115
      
No of records : 1     
      
Filter 2: Feb 1st to Feb 28     
SurveyIDTotal Survey    Completed Survey       SurveyID           QuestionID       Mean Score
11 100113
      
No of records : 1      
      
Filter 3: Jan 1st to Feb 28     
SurveyIDTotal Survey    Completed Survey       SurveyID           QuestionID       Mean Score
122100114
      
No of records : 1      

So when Individual filters are applied, the report for each month returns with one row for filters 1 and 2.

Whereas when a filter inclusive of both the data ranges is applied, filter 3, the data is aggregated and only one record is returned for a particular question. However for a given question, columns like Completed Survey and Total Survey should add up when a filter is applied for each month (or time range) individually.

So in relation to the data example in the Reproducing the Issue section. While there is an apparent discrepancy of 14 rows overall between the individual reports and the overall report the discrepancy is attributed to the aggregated score within the overall report for those questions where it has been possible to do so.

Keywords

Survey Response (CSV), Completed Survey, Total Survey, discrepancy, report,  , KBA , LOD-SF-LMS-REP , Reporting Data , Bug Filed

Product

SAP SuccessFactors Learning all versions