Plan comparable round data and distinguish aggregate movement from individual rating changes, accounting for participation and attrition.
Delphi consensus, expert panels, and research guides
Delphi consensus is agreement assessed using predefined rules after independent ratings, structured feedback, and an opportunity to reconsider. Explore the consensus process and criteria, expert panels, the modified Delphi method, and Real-Time Delphi in our research guides.
Latest articles
Explore our latest practical guidance on Delphi studies, questionnaires, and structured group decisions.
Plan a medical consensus study around an evidence gap, preserve disagreement, and define useful reporting outputs.
Effective Does Not Mean Feasible: Multidimensional RAND/UCLA Consensus
Separate expected benefit from realistic implementation
Plan separate effectiveness and feasibility ratings, classify each dimension under the approved protocol, and report paired results and implementation barriers without blending the judgments.
Delphi foundations
What the Delphi method is, why it works for expert consensus, and how it differs from the surveys and adaptations it is often confused with.
Next: Study design & panelsLearn how the Delphi method helps researchers and organizations gather expert input, refine opinions over multiple rounds, reduce groupthink, and measure consensus in a structured and transparent way.
Understand why Delphi is useful for reducing dominant voices, encouraging independent judgment, supporting structured feedback, measuring consensus, and creating a transparent record of expert input.
Learn how Delphi studies differ from traditional surveys and why expert consensus often requires structured feedback, multiple rounds, participant reflection, and clear consensus criteria.
Learn what modified Delphi studies are, how they differ from traditional Delphi, and how teams can adapt the method while preserving transparency, credibility, and clear reporting.
Study design & panels
Decisions to make before the first round opens: who sits on the panel, how many experts you need, and which pitfalls weaken a study.
Next: Consensus & analysisA practical guide to planning expert panels, Delphi rounds, rating scales, structured feedback, consensus thresholds, administration, analysis, and reporting before launching a study.
How Many Experts Does a Delphi Study Need?
Why panel-size justification matters more than a universal minimum
Plan panel size around the research question, required expertise and stakeholder perspectives, expected attrition, and intended analyses—and report the rationale transparently.
Can One Large Stakeholder Group Dominate a Delphi Result?
Overall consensus and stakeholder consensus answer different questions
A pooled percentage gives every participant equal weight. See when the largest group can decide the result even if smaller, essential groups disagree—and how to analyze and report by stakeholder group.
Learn common Delphi study mistakes and how to avoid problems with unclear objectives, weak panel design, poor item wording, undefined consensus criteria, and weak feedback workflows.
Two Delphi Design Errors That Can Undermine Consensus
Restricted early input and compound statements can distort the result
Learn why every relevant perspective needs a defined role in content development—and why each survey item should ask panelists to make one interpretable judgment.
Where Bias Enters a Delphi Study—and How to Reduce It
Practical safeguards for panel selection, framing, feedback, attrition, and analysis
Identify where investigator, panel, statement, feedback, attrition, and reporting bias can influence a Delphi study—and build proportionate safeguards into the protocol and final report.
Delphi Study Design and Reporting Checklist
A practical resource for planning and transparent reporting
Review panel composition, stakeholder representation, scales, consensus rules, feedback, attrition, analysis, and transparent reporting decisions before and after your study.
What Should You Report in a Delphi Study?
A practical record of design, participation, feedback, and decisions
Document the panel, item development, planned sample size, rounds, feedback, consensus rules, attrition, revisions, and results so readers can understand and reproduce the process.
Consensus & analysis
How to define agreement, judge items on more than one dimension, and report disagreement honestly when it does not resolve.
Next: Real-time, hybrid & live formatsLearn how Delphi study teams define consensus thresholds, interpret agreement and disagreement, compare stakeholder groups, and report consensus criteria clearly.
Why a Simple Majority Is Not Necessarily Delphi Consensus
A 51% decision rule can settle a vote without demonstrating strong agreement
Learn why Delphi consensus usually needs more than a bare majority, how thresholds should be chosen before results are reviewed, and what else to examine besides one percentage.
Delphi Consensus Is Not Enough
Clarity, importance, feasibility, validity, and appropriateness may require separate decisions
Learn when an item should be evaluated on more than one dimension, how to predefine multidimensional acceptance rules, and how to report which criterion caused an item to pass, fail, or require revision.
When Delphi Should Produce Two Answers, Not One
Recognizing stable polarization and context-dependent consensus
Learn when persistent disagreement represents meaningful competing positions—and why a defensible Delphi should preserve them rather than force one artificial conclusion.
Plan comparable round data and distinguish aggregate movement from individual rating changes, accounting for participation and attrition.
Can a Delphi Panel Look Like It Agrees While Remaining Divided?
What medians, percentages, and small panels can conceal
Inspect response distributions and minority views, distinguish a protocol classification from the strength of its evidence, and report information limits without inventing a universal sample-size rule.
Real-time, hybrid & live formats
Choosing between asynchronous rounds, Real-Time Delphi, and facilitated live sessions—or combining them so each is used where it is strongest.
Next: Applications & fieldsLearn how Real-Time Delphi allows participants to review feedback and refine responses while a study is still active, helping teams build consensus more flexibly and efficiently.
Hybrid Delphi: Online Rounds, Real-Time Feedback, and Live Consensus
Use each Delphi format where it is strongest
Learn how to combine asynchronous rounds, dynamic feedback, and a focused live session while preserving independent judgment, controlled feedback, iteration, and transparent reporting.
How Live Consensus Sessions Help Groups Make Better Decisions
A structured alternative to long, uneven, and difficult meeting discussions
Learn how a Surveylet Live Consensus Session can help conferences, workshops, advisory boards, committees, and leadership groups collect independent input, share anonymized feedback, and document a decision during the meeting.
Applications & fields
Delphi at work: clinical consensus and core outcome sets, appropriateness ratings, and expert judgment in fields well beyond healthcare.
Next: Questions, risks and group decisionsDelphi in Medical Research
Clinical consensus, core outcome sets, care guidance, and research priorities
See how Delphi studies support medical research, including clinical consensus, core outcome sets, quality indicators, care pathways, public health, and publication-ready reporting.
RAND/UCLA Appropriateness Method: A Practical Overview
Medical applications, ratings, disagreement, and online study setup
Understand the RAM process, distinguish appropriateness from general consensus, and prepare a Surveylet study with a practical setup guide and worked examples.
Plan a medical consensus study around an evidence gap, preserve disagreement, and define useful reporting outputs.
Effective Does Not Mean Feasible: Multidimensional RAND/UCLA Consensus
Separate expected benefit from realistic implementation
Plan separate effectiveness and feasibility ratings, classify each dimension under the approved protocol, and report paired results and implementation barriers without blending the judgments.
Using RAND/UCLA for Real-World Cases and What-If Scenarios
Case-based appropriateness ratings under controlled comparison
Appropriateness decisions often depend on context. A case-based RAND/UCLA design lets experts rate a realistic base scenario, then test how controlled changes affect the median, disagreement, and final classification.
Explore how Delphi and Real-Time Delphi studies can support structured expert consensus in fields beyond medicine, including policy, education, space, technology, forecasting, and strategic planning.
Using Delphi to Reveal Policy Trade-Offs—not Manufacture Agreement
Who benefits, who bears costs, and under which assumptions?
Rate policy impacts separately for affected constituencies, keep panelist roles distinct from impact dimensions, and preserve benefits, burdens, uncertainty, and implementation assumptions.
Questions, risks and group decisions
Practical examples for writing Delphi questions, identifying risks, and choosing software for structured group decisions.
Delphi Technique for Risk Identification: A Practical Guide
From independent expert input to a usable risk register
A practical workflow for finding overlooked risks, clarifying assumptions, and deciding what needs further investigation.
Delphi Survey Questionnaire Example: Questions and Feedback
Example questions, rating scales, and follow-up feedback
Adapt an original example covering first-round questions, participant instructions, follow-up feedback, and consensus rules.
Consensus Building Software: How to Choose a Group Decision Tool
Compare workflows, study cost, and support
Compare Delphi workflows, total study cost, small-team value, and support before buying software for academic or policy research.
Planning a Delphi study or live consensus session?
Surveylet helps researchers and organizations manage expert panels, multiple rounds, structured feedback, Real-Time Delphi workflows, and live consensus-oriented decision-making during conferences and meetings.
