Skip to content

Consensus & statistics · Administrator

Use range consensus on rating scales

Group ordered ratings into ranges and distinguish any-range, high-range, and combined inclusion/exclusion rules.

Screenshots illustrate the controls below. Layouts and labels may vary with your survey configuration. Select an image or “View full size” to open it in a new tab.

Configure an 80% high-range criterion on a five-point scale

For Range 3 on a five-point ordered scale, the low range is choices 1–2, the middle range is choice 3, and the high range is choices 4–5. Select the intended Range 3 variant and set the question or matrix-column Stability Threshold to 80% for an 80% high-range requirement. Changing this threshold changes the upper percentage requirement; it does not change the fixed 15% low-range boundary in Range 3:1570.

Check comparison signs explicitly. The restored method reference documents less than 15%, whereas some protocols specify 15% or less. These differ at exactly 15%. Test that boundary and verify it separately against the protocol if needed; do not treat the two rules as interchangeable.

If the protocol also specifies median ≥ 4, enable and review the median separately. See combined median criteria.

What a range means

Range consensus combines adjacent choices on an ordered scale. On a nine-point scale with three ranges, ratings 1–3 form the low range, 4–6 the middle range, and 7–9 the high range. On a five-point scale, three ranges use 1–2, 3, and 4–5.

Set the Likert Scale flag and verify the stored order of the choices. Range Label changes the text shown for a range; it does not change which choices belong to it. Use the actual supported scale allocation and test non-standard scale lengths.

Choose the intended rule

Method familyInterpretation
Range Consensus 2, 3, 4, or 5Can establish agreement in a range meeting the configured threshold.
Range Consensus X HiFocuses on the highest range rather than agreement in any range.
Range Consensus 3:1570Uses a high-range threshold together with a low-range limit of less than 15%.
Range Consensus 3:1570 7015Adds a corresponding consensus-out rule; other outcomes remain undetermined.
Patient- or group-specific variantsApply additional stakeholder criteria. Confirm the variant and group mapping against the protocol.

Similar names can represent different decisions. Do not select a method only because its name includes a familiar percentage. Confirm both inclusion and exclusion behavior.

Example entry of labels for rating ranges. Range labels describe the scale; the consensus rule is configured separately.
Example entry of labels for rating ranges. Range labels describe the scale; the consensus rule is configured separately. View full size (opens in a new tab)

A worked inclusion example

Suppose the protocol specifies at least 75% of valid ratings in 7–9 and fewer than 15% in 1–3. Of 20 valid ratings, 16 are high, 2 are middle, and 2 are low. High is 80% and low is 10%, so the stated inclusion rule is satisfied.

If 16 are high, 1 middle, and 3 low, the low share is 15%, which fails a less than 15% condition. Test boundary cases in Surveylet because the required comparison signs are part of the rule, and a rounded display is not enough to resolve a boundary.

Keep the denominator explicit

Exclude the virtual “I don’t know” non-rating from scored calculations and distinguish valid ratings from total questionnaire participation. If the protocol uses another denominator or stakeholder-specific rules, verify that the selected built-in method matches it. Export the counts used for reporting.

Complete choice allocation for Range 2, 3, 4, and 5

Ranges are used to group adjacent Likert-scale choices (of 2 to 12) together into ranges (of 2, 3, 4, 5). You can use the Range consensus method for both odd (3, 5, 7, 9, 11) and even (2, 4, 6, 8, 10, 12) number of choices; but for odd number of choices the range values cannot be be distributed equally as shown below for a 5-point Likert-scale where Range 1 contains two choices, Range 2 contains one choice and Range 3 contains two choices:
Range 3 will divide a 5 point Likert-scale into the following 3 ranges (Range 1, 2, 3):
Choice #1 "Strongly Disagree" --> Range 1
Choice #2 "Disagree" --> Range 1
Choice #3 "Neither Disagree nor Agree" --> Range 2
Choice #4 "Agree" --> Range 3
Choice #5 "Strongly Agree" --> Range 3
The "Range 3" consensus method on the other hand, will establish consensus in all 3 ranges. The "Range 3 Hi" consensus method however will only establish consensus in the highest (3rd) range which in our example above contains the following choices: "Agree" and "Strongly Agree". So, if your Stability Threshold is set to 75%, then consensus will be established in the highest range if the combined percentage the "Agree" and "Strongly Agree" options received is over 75%, and all other ranges will be ignored even if they have reached over 75% of the votes.
Each range must have at least 1 choice, so for instance for Range 5, you cannot use a Likert-scale with only 4 or less choices. We recommend that you do not use Range consensus when you can allocate only 1 choice per range, for that any other consensus metrics. Instead of using Range 5 for a 5-point Likert-scale question, use Majority for consensus measure with Percentage for Group Stability.
The "Likert Scale" question or matrix column setting must be set to "Yes" when Range 2, 3, 4, 5 consensus method is used.
Ranges are labeled automatically for you (e.g. Low, Medium, High for Range 3), but you can override these defaults from your question or matrix column settings ("Range Label").
Surveylet will assign a range to each Likert-scale choice as follows:

Range 2: choice positions by range

Number of choicesLowHigh
212
31–23
41–23–4
51–34–5
61–34–6
71–34–7
81–45–8
91–56–9
101–56–10
111–67–11
121–67–12

Range 3: choice positions by range

Number of choicesLowMediumHigh
3123
4123–4
51–234–5
61–23–45–6
71–345–7
81–34–56–8
91–34–67–9
101–34–78–10
111–45–78–11
121–45–89–12

Range 4: choice positions by range

Number of choicesVery LowLowHighVery High
41234
51234–5
61–2345–6
71–2345–7
81–23–45–67–8
91–23–45–67–9
101–34–56–78–10
111–34–56–89–11
121–34–67–910–12

Range 5: choice positions by range

Number of choicesVery LowLowNeutralHighVery High
512345
612345–6
71–23456–7
81–234–567–8
91–23–456–78–9
101–23–45–67–89–10
111–23–45–78–910–11
121–34–56–78–910–12

Choose the correct Range 3 method

MethodConsensus inConsensus out / other status
Range 3Any range reaches the configured threshold.Other results do not meet consensus.
Range 3 HiOnly the high range reaches the threshold.A low- or middle-range majority does not qualify.
Range 3:1570High ≥ threshold and low < 15%.Everything else is consensus out.
Range 3:1570 7015High ≥ threshold and low < 15%.Out: low ≥ threshold and high < 15%. Otherwise undetermined.
Range 3:1570|50Overall high ≥ threshold and low < 15%, or patient-group high > threshold.Out: high ≤ 50% in each stakeholder group. Otherwise undetermined.
Range 3:1570|50GOverall high ≥ threshold and low < 15%.Out: overall high ≤ 50%. Otherwise undetermined.

The default threshold documented for these range methods is 70%; use the threshold required by your protocol. The patient-weighted variant identifies a stakeholder choice whose title contains “Patient”; otherwise the documented fallback is the first choice in the stakeholder demographic question. Check this mapping before using the patient rule.

On a three-point scale, Range 3 assigns each choice to its own range. On a nine-point scale it groups 1–3, 4–6, and 7–9. A “Range 3” label therefore does not always mean ratings 7–9; the scale length matters.