Skip to content

Consensus & statistics · Administrator

Understand statistics and “Group Stability”

Enable the measures you need before launch and distinguish within-round agreement from change between rounds.

Screenshots illustrate the controls below. Layouts and labels may vary with your survey configuration. Select an image or “View full size” to open it in a new tab.

Find the calculation you need

Enable statistics before collection

In Survey Settings → Statistics, available display states include Admin Only, Admin + User, and Disabled. The question’s Statistics to Display list further controls what appears under that question.

Newly enabled statistics are calculated on subsequent answer or revision events. Their earlier historical values are not backfilled. Enable the measures needed for the study before data collection.

Read the common statistics

MeasurePlain-language meaning
MedianMiddle of the ordered ratings.
MeanArithmetic average of the numerical values.
ModeMost frequent value or category.
IQRSpread of the middle half of the ratings.
Standard deviationVariation around the mean.
Percentage in a rangeShare of valid ratings falling in that range.

Choose measures that fit the data. Category identifiers are labels; their numeric codes do not create meaningful averages. Ordered ratings and measured numerical quantities may require different interpretation.

Example of statistics displayed in participant feedback.
Example of statistics displayed in participant feedback. View full size (opens in a new tab)
More screenshots and examples (1)
Example of statistical measures and a timeline displayed in participant feedback.
Example of statistical measures and a timeline displayed in participant feedback. View full size (opens in a new tab)

Group Stability is method-dependent

Surveylet’s Group Stability label describes the strength or concentration of agreement for the selected method. It is not automatically evidence that a panel’s opinions stopped changing between rounds. For percentage-based methods, the displayed value is tied to choice or range agreement; coefficient-based methods use a different calculation.

To evaluate round-to-round stability, compare the relevant datasets and measures over rounds according to your protocol. A high within-round agreement level and a small change between rounds answer different questions.

Check coefficient-based examples

The documented Likert Mean/CV example uses sample standard deviation and Group Stability = 100% − CV. Its numeric-entry example instead uses population standard deviation divided by the allowed value range and Group Stability = 100% − 2 × that ratio. These are different calculations.

Do not apply one formula to every question type. Validate the output with the actual question settings and known data, and describe the selected method explicitly in your report.

Detailed instructions: Statistics Tab

Surveylet can calculate and display 30+ statistical measures for panelists and survey administrators alike. There are 6 default statistics that are always switched on and cannot be removed. By clicking on the chart icon of the statistic, you will toggle its visibility which is also displayed under the statistics name.
Statistics Tab — configuration example
The 3 available options are:
Admin Only (blue),
If a statistics is set to Admin only, only survey administrators and moderators will be able to track in when viewing question analytics.
Admin + User (red)
If it's set to Admin + User, then both administrators and survey panelists alike will be able to view the statistics calculated and displayed under the question.
Disabled (white)
If it's set to disabled (blank white circle) then this statistic is not tracked, meaning that it is not calculated and monitored.
You may switch statistics on and off at any time, but its value is only calculated if the question receives at least one response or revision after it was enabled. If you switch it on during the survey, the statistics will not be recalculated historically backward in time, only going forward; so if you want to monitor historical values for a statistic, you must switch it on before you start your survey.
The following statistics are only tracked when the RAM Method is enabled from the Consensus tab:
Inter-Percentile Range (IPR)
IPR Adjusted for Symmetry (IPRAS)
Central point of IPR (IPRCP)
Assymetry Index (AI)
Lower limit IPR (Lp)
Upper limit IPR (Up)
Level of Agreement (AGREEMENT)
Level of Appropriateness (APPROPRIATENESS)
To get familiar with statistics, visit a any free online tutorial provided by 3rd parties such as this website.

Detailed instructions: Statistics Tab

Surveylet can collect data for 30+ statistical measures. Only statistics that are enabled on Survey Settings > Statistics tab are displayed on this page. You can visualize two statistical measures side by side in the same chart; one as a historical bar chart, the other one as a line chart. Click on the "Bar chart" or "Line Chart" dropdown boxes to select the statistics to display.
Statistics Tab — configuration example
Statistics are collected when a response event to a question happens. A response is event is a new response, or a revision of an existing response. When an event occurs, a new event id is generated. Statistics that were enabled will be calculated and stored in the database under that event id and will be displayed on this page. You may enable statistics at any time, but values will only be created going forward and will not be created retrospectively backward in time.

Choose statistics for the data type

Nominal categories have no numerical order; use counts, percentages, and mode. Ordered categories, including Likert ratings, income bands, and education levels, support ordered summaries such as median and distributions. Measured numeric quantities can use means and standard deviations where appropriate. Numeric category codes do not turn labels into measured quantities.

Common questions

Why does a newly enabled statistic have no earlier history?

Historical values are stored when answer or revision events occur while the measure is enabled. Enabling it later does not recreate those earlier events.

Is “Group Stability” the same as a stopping rule?

No. Your stopping rule is a study decision, such as a planned number of rounds or a defined change criterion. The displayed Group Stability value alone does not implement that decision.