Skip to content
CalibrumDelphi knowledge hub
Calibrum Blog

Delphi consensus, expert panels, and research guides

Delphi consensus is agreement assessed using predefined rules after independent ratings, structured feedback, and an opportunity to reconsider. Explore the consensus process and criteria, expert panels, and modified Delphi method in our research guides.

New on the blog

Latest articles

Explore our latest practical guidance on Delphi studies, questionnaires, and structured group decisions.

NewReporting guide

What Should You Report in a Delphi Study?

A practical record of design, participation, feedback, and decisions

Document the panel, item development, planned sample size, rounds, feedback, consensus rules, attrition, revisions, and results so readers can understand and reproduce the process.

NewConsensus criteria

Why a Simple Majority Is Not Necessarily Delphi Consensus

A 51% decision rule can settle a vote without demonstrating strong agreement

Learn why Delphi consensus usually needs more than a bare majority, how thresholds should be chosen before results are reviewed, and what else to examine besides one percentage.

4 articles

Delphi foundations

What the Delphi method is, why it works for expert consensus, and how it differs from the surveys and adaptations it is often confused with.

Next: Study design & panels
Guide

What Is the Delphi Method?

Benefits, uses, and why Delphi works so well for expert consensus

Learn how the Delphi method helps researchers and organizations gather expert input, refine opinions over multiple rounds, reduce groupthink, and measure consensus in a structured and transparent way.

Benefits

Why Use the Delphi Method?

Key benefits for expert consensus studies

Understand why Delphi is useful for reducing dominant voices, encouraging independent judgment, supporting structured feedback, measuring consensus, and creating a transparent record of expert input.

Comparison

Delphi vs. Traditional Surveys

When Delphi is a better fit than a standard questionnaire

Learn how Delphi studies differ from traditional surveys and why expert consensus often requires structured feedback, multiple rounds, participant reflection, and clear consensus criteria.

Method design

Modified Delphi Studies

How teams adapt Delphi while preserving credibility

Learn what modified Delphi studies are, how they differ from traditional Delphi, and how teams can adapt the method while preserving transparency, credibility, and clear reporting.

6 articles

Study design & panels

Decisions to make before the first round opens: who sits on the panel, how many experts you need, and which pitfalls weaken a study.

Next: Consensus & analysis
Guide

How to Plan a Delphi Study

Panel selection, rounds, rating scales, feedback, and reporting

A practical guide to planning expert panels, Delphi rounds, rating scales, structured feedback, consensus thresholds, administration, analysis, and reporting before launching a study.

Panel design

How Many Experts Does a Delphi Study Need?

Why panel-size justification matters more than a universal minimum

Plan panel size around the research question, required expertise and stakeholder perspectives, expected attrition, and intended analyses—and report the rationale transparently.

Stakeholder analysis

Can One Large Stakeholder Group Dominate a Delphi Result?

Overall consensus and stakeholder consensus answer different questions

A pooled percentage gives every participant equal weight. See when the largest group can decide the result even if smaller, essential groups disagree—and how to analyze and report by stakeholder group.

Pitfalls

Common Delphi Study Mistakes

Practical issues that can weaken Delphi studies

Learn common Delphi study mistakes and how to avoid problems with unclear objectives, weak panel design, poor item wording, undefined consensus criteria, and weak feedback workflows.

Checklist

Delphi Study Design and Reporting Checklist

A practical resource for planning and transparent reporting

Review panel composition, stakeholder representation, scales, consensus rules, feedback, attrition, analysis, and transparent reporting decisions before and after your study.

NewReporting guide

What Should You Report in a Delphi Study?

A practical record of design, participation, feedback, and decisions

Document the panel, item development, planned sample size, rounds, feedback, consensus rules, attrition, revisions, and results so readers can understand and reproduce the process.

4 articles

Consensus & analysis

How to define agreement, judge items on more than one dimension, and report disagreement honestly when it does not resolve.

Next: Real-time, hybrid & live formats
Thresholds

Consensus Thresholds

How to define, interpret, and report agreement clearly

Learn how Delphi study teams define consensus thresholds, interpret agreement and disagreement, compare stakeholder groups, and report consensus criteria clearly.

NewConsensus criteria

Why a Simple Majority Is Not Necessarily Delphi Consensus

A 51% decision rule can settle a vote without demonstrating strong agreement

Learn why Delphi consensus usually needs more than a bare majority, how thresholds should be chosen before results are reviewed, and what else to examine besides one percentage.

Study design

Delphi Consensus Is Not Enough

Clarity, importance, feasibility, validity, and appropriateness may require separate decisions

Learn when an item should be evaluated on more than one dimension, how to predefine multidimensional acceptance rules, and how to report which criterion caused an item to pass, fail, or require revision.

Disagreement

When Delphi Should Produce Two Answers, Not One

Recognizing stable polarization and context-dependent consensus

Learn when persistent disagreement represents meaningful competing positions—and why a defensible Delphi should preserve them rather than force one artificial conclusion.

3 articles

Real-time, hybrid & live formats

Choosing between asynchronous rounds, Real-Time Delphi, and facilitated live sessions—or combining them so each is used where it is strongest.

Next: Applications & fields
Fast feedback

Real-Time Delphi

A faster way to build expert consensus

Learn how Real-Time Delphi allows participants to review feedback and refine responses while a study is still active, helping teams build consensus more flexibly and efficiently.

Conference decisions

How Live Consensus Sessions Help Groups Make Better Decisions

A structured alternative to long, uneven, and difficult meeting discussions

Learn how a Surveylet Live Consensus Session can help conferences, workshops, advisory boards, committees, and leadership groups collect independent input, share anonymized feedback, and document a decision during the meeting.

3 articles

Applications & fields

Delphi at work: clinical consensus and core outcome sets, appropriateness ratings, and expert judgment in fields well beyond healthcare.

Next: Questions, risks and group decisions
Clinical consensus

Delphi in Medical Research

Clinical consensus, core outcome sets, care guidance, and research priorities

See how Delphi studies support medical research, including clinical consensus, core outcome sets, quality indicators, care pathways, public health, and publication-ready reporting.

Appropriateness

Using RAND/UCLA for Real-World Cases and What-If Scenarios

Case-based appropriateness ratings under controlled comparison

Appropriateness decisions often depend on context. A case-based RAND/UCLA design lets experts rate a realistic base scenario, then test how controlled changes affect the median, disagreement, and final classification.

Use cases

Delphi Studies Beyond Healthcare

Examples from policy, education, space, technology, and planning

Explore how Delphi and Real-Time Delphi studies can support structured expert consensus in fields beyond medicine, including policy, education, space, technology, forecasting, and strategic planning.

3 articles

Questions, risks and group decisions

Practical examples for writing Delphi questions, identifying risks, and choosing software for structured group decisions.

Planning a Delphi study or live consensus session?

Surveylet helps researchers and organizations manage expert panels, multiple rounds, structured feedback, Real-Time Delphi workflows, and live consensus-oriented decision-making during conferences and meetings.