Skip to content

Run the study · Administrator

Control when participants see feedback

Combine the consensus method, saved answers, display permissions, and minimum-answer threshold.

Screenshots from the original Surveylet guide illustrate the controls below. Layouts and labels may vary with your survey configuration. Select an image or “View full size” to open it in a new tab.

The four checks

  1. Feedback dataset: Real-Time Delphi uses the current round; Multi-round Delphi uses the previous round.
  2. Participant answer: feedback is normally available after the person answers and saves the question.
  3. Minimum Responses to Display Analytics: the question must have the configured number of answers.
  4. Display settings: the relevant analytics tabs, statistics, comments, and optional subgroup report must be enabled.

These checks serve different purposes. Creating a round is not a substitute for setting a minimum number of panelists per question.

Configure the question or matrix column

In Question Settings, review Display Analytics Tab and Minimum Responses to Display Analytics. In Survey Settings → Statistics, check whether each measure is enabled for Admin + User. Review the question’s Statistics to Display list as well.

Survey-level options can allow analytics before an answer, filter comments by language, hide response counts, and control change alerts. If your protocol requires an independent first rating, keep feedback hidden until the rating is saved.

Choose the feedback tabs to show under the question.
Choose the feedback tabs to show under the question. View full size (opens in a new tab)

Explain feedback to participants

Tell participants to answer and click Save if they want to inspect feedback without moving on. They may still see no feedback if too few panelists have answered, the first Multi-round round has no earlier dataset, or their study does not display those tabs.

Consensus Change Alert can notify people of changes on other pages in Real-Time Delphi. Test it for your study length; frequent alerts can interrupt participation. A changing chart is a reason to consider the evidence, not an instruction to conform.

Example notification when consensus changes.
Example notification when consensus changes. View full size (opens in a new tab)
More screenshots and examples (2)
Example notification when consensus is lost.
Example notification when consensus is lost. View full size (opens in a new tab)
Example notification when consensus is reached.
Example notification when consensus is reached. View full size (opens in a new tab)

Common questions

The administrator sees analytics, but panelists do not. Why?

Administrator access and participant display rules differ. Check the saved answer, feedback round, minimum-answer threshold, tabs, and Admin + User visibility.

Will feedback appear as soon as a new snapshot is created?

Only if the other display conditions are satisfied. The snapshot and minimum-answer threshold are independent settings.