Scoring, sometimes also referred to as weighting, is where a
numeric value is assigned to each of a question's answer response options.
A popular format is to use a scale such as in the following
By assigning a score to each answer option it is possible
to then benefit from Survey Galaxy's online Results Analyzer's inbuilt score reporting
facilities and display the results as both a chart and table as shown below.
and/or as a table,
Using the Results Analyzer's scoring facility a specific
value can be assigned to each answer response and will:
- allow a score to be assigned to any type of question/answer format
- support both numeric scale and titled headings
- allow answer options to be ignored such as 'Not Applicable'
- support any ordering of the answer options
- allow the use of the randomise answer facility
- allow the scoring to be unevenly weighted
- allow the use of decimal scores
- support non-English and/or multi-language surveys.
Scoring is assigned to answer options using the Composer,
when adding or modifying survey items.
For Non-grid formats the scores are assigned by selecting
the 'Answer Attributes' option under
the 'Answers' field.
Clicking on the 'Answer Attributes' button will list the answers allowing scores to be
assigned to each answer option.
Leaving an answer score blank option will indicate that the
response for a person choosing that option will be ignored. This would be used
for answers like 'Not Applicable' and 'No Comment'.
Leaving an answer score
blank is different to assigning a score of zero where the person's response
will be counted but no score will be derived from it.
For grid style formats the 'Answer Attributes' button is displayed under each format's answers, columns
When selected, the 'Answer Attributes' option will open up to allow
scores to be assigned to each of the listed answer options.
The assigned score can be any positive numeric value
including decimal numbers.
Assigning scores to answer options can help improve the
clarity of surveys by allowing the publisher to dispense with the need for
issuing instructions to the respondent to indicate if an answer option such as 'Strongly
Agree' is to be scored high or low.
For example, instead of:
The survey can be displayed in a more respondent friendly
With each scale scores being assigned to each of the column
Preview the Scoring
An overview of the assigned scoring is automatically displayed
in the Composer's preview screen. The scores are only shown in the Composer's
preview screen, they are not shown if the 'Preview' button is used to preview
the survey and they are not shown when the survey is published.
For non-grid formats the scores are shown in brackets as a
subscript next to the associated answer option:
For grid formats the assigned scores are shown in brackets
as a subscript in the column headings.
For drop down formats the scores are shown in the preview
when the drop down list is shown:
The scores are shown in brackets:
Results Analyzer Scoring Facilities
If the Results Analyzer detects that scores have been
applied to the survey then additional scoring options will be added to the
Master Settings section and an additional 'Survey Scoring Report' section will
Master Settings section
- Use Scores: Results
With the 'Results' option checked the assigned scores will be used to determine the value of each response
option i.e. number of times the answer has been selected multiplied by that
answer option's assigned score.
Use Scores: Titles
The 'Titles' option will display each answer options assigned score in the titles as shown below:
In addition to the additional Master Settings score options if
any scores have been assigned a 'Survey Scoring Report' section will be displayed
after the survey item options.
The 'Survey Scoring Report' will provide the option to display
a chart summary of the scored answers.
To display the Scoring Summary chart, set the Data to either
'Numbers' or '%'s', to turn off the chart select 'None (Hide Chart)'.
Click on the Result Analyzer's 'Apply' button to display the chart with the configured settings.
By adjusting the 'Survey Scoring Report' settings the
reporting data can be filtered to only show those items that match a defined
The criteria's value can be set by using the '%' pick list:
The 'Mark @' option
will not filter the results but instead will draw a line on the chart marking
the specified value on the chart.
Checking the 'Hide buildup charts' option will hide the individual charts that
are used to build up the score summary chart.
The 'Show:' options can be set to configure the chart to show References ('Ref's'), if they have been assigned, and/or the Question. If the Average ('Avg') is checked, a line will be shown on the chart to indicate the average value.
Individual survey items that are marked as 'Hide' will not
be included in the Score Summary Report.
- When the data has been set to report as a '%', the score report will show the percentage using the formula:-
((Answer option's total score for all included responses/Max possible score of all included responses)*100)
- Leave the score field blank for any answer option such as 'Not Applicable' that is to be excluded from the summary chart and any calculation.
- To revise the scoring of a publish survey the Compose Characteristics option can be used to adjust the scoring without the need to stop the survey publication.
- Scored results are not part of the exported results.
Summary Chart Calculation
For a survey question that
offered four answer options, including one Not Applicable (N/A), and having
received ten responses, the following illustrates how the overall percentage of
maximum score that is shown on the Score report Summary chart is calculated.
The survey score summary chart's
reporting value is highlighted in yellow.
The Survey Score Summary chart
will therefore show the example as below:
If the build up charts are shown
and the Master Settings configured to display the results as a percentage and also
set to use the scores, the chart will be displayed as follows.
Modifying the Scoring
It is possible to modify the
scoring for a published survey through the Compose Characteristics facility
without the need to stop or suspend the survey publication.
It is only possible to modify the
scoring of the current survey dataset, the scoring for previous datasets cannot
be modified using the Composer.