Skip to content

Getting started · Administrator

Plan the study before programming

Turn your protocol into a survey structure, feedback plan, and analysis checklist before you start building.

Decide what the study needs

  • Define the research question, panel eligibility, stakeholder groups, and recruitment method.
  • Choose Real-Time Delphi, Multi-round Delphi, or a planned combination.
  • Specify the rating scale, its direction, and the meaning of each anchor.
  • Define consensus in, consensus out, and undetermined outcomes where applicable. State the denominator and how “I don’t know” will be treated.
  • Plan feedback timing, subgroup reports, reminders, and the end of participation.
  • Decide which datasets and statistics you will need for analysis and publication.

Real-time or multi-round feedback

ApproachParticipant feedbackPlanning implication
Real-Time DelphiFeedback uses the current round’s collected answers.Participants can reconsider answers as the panel’s results change.
Multi-round DelphiFeedback uses the previous round’s results.Plan when each new round starts and how participants will be instructed to return.

Both approaches can use rounds. A round snapshot and a minimum-answer threshold for showing feedback are separate controls. Neither one automatically defines your study’s stopping rule.

Keep instructions practical

Tell participants what to rate, what each end of the scale means, how to save, when feedback appears, and whether they should revisit their answers. Give them a study contact. For a live session, test the same devices, navigation, and feedback settings you plan to use during the event.

Use the Delphi study checklist and your protocol as a pre-launch review. Keep the final questionnaire wording and configuration with your study records.