Skip to content
CalibrumDelphi study formats
Hybrid Delphi Study Design

Hybrid Delphi: combine online rounds, real-time feedback, and live consensus sessions

A hybrid Delphi design uses each format where it is strongest: asynchronous online rounds for broad, independent participation; Real-Time Delphi for faster feedback and reconsideration; and a carefully structured live session when focused discussion can help resolve or clarify the remaining issues.

Multi-round DelphiReal-Time DelphiLive consensusAnonymized feedbackDocumented decisions

One study does not have to use only one Delphi format

Traditional multi-round, Real-Time, and live consensus approaches are not competing choices. They can be combined deliberately around the needs of the panel, the maturity of the items, the time available, and the kind of outcome the study must produce.

Online rounds broaden participation

Panelists can respond independently, across time zones, with adequate time to review evidence and explain their judgments.

Real-time feedback accelerates reflection

Participants can review controlled group feedback during an active phase and revise responses without waiting for a completely separate round.

Live sessions focus discussion

A facilitated meeting can concentrate on unresolved, ambiguous, or high-consequence items while preserving independent voting and a transparent record.

A practical hybrid Delphi workflow

The sequence should be specified in advance where possible and adapted only through documented methodological decisions. A common design is:

Develop and test the candidate itemsDefine the study question, panel composition, rating scale, consensus criteria, feedback rules, revision process, and stopping logic before launch.
Run an asynchronous online roundGive the full panel time to rate items independently, provide comments, propose revisions, and identify missing considerations.
Return controlled feedbackShow appropriately selected distributions, consensus indicators, subgroup information, and anonymized reasoning while protecting participant confidentiality.
Use real-time reconsideration where helpfulAllow panelists to revisit responses during a defined window as feedback develops, while retaining response history and clear participation rules.
Bring selected issues to a live sessionReserve synchronous time for items that remain divided, need clarification, or require prioritization—not for re-discussing every item.
Collect a final independent responseAfter structured discussion, ask participants to rate or vote privately again and report agreement, disagreement, changes, and unresolved issues.

Choose the format by purpose

Study needBest-fit componentWhy it helps
Geographically dispersed or busy expertsAsynchronous online roundParticipants respond on their own schedule and have time to consider evidence and comments.
Broad item generation or detailed qualitative inputAsynchronous online roundReduces meeting pressure and supports thoughtful, independent contribution.
Rapid feedback and iterative refinementReal-Time Delphi phaseShortens the delay between response, group feedback, and reconsideration.
A small number of persistent disagreementsLive consensus sessionFocused discussion can clarify wording, assumptions, evidence, and reasons for divergence.
A final priority or recommendation decisionLive discussion plus independent re-ratingCombines deliberation with protection against public-pressure voting.
Issues that remain legitimately dividedDocument and retain disagreementA defensible Delphi process should reveal meaningful differences rather than force artificial consensus.

What the 2026 methodological paper adds

A 2026 peer-reviewed paper in BMC Medical Research Methodology reported a four-round modified Delphi study in which real-time polling was integrated into two hybrid meetings. The design used anonymous voting, immediate aggregated results, and iterative discussion. The authors reported that the approach facilitated consensus on multiple recommendations within a single session, reduced study duration, supported interaction, and maintained anonymity.

The practical lesson is not simply “use live polling.” The stronger design principle is to preserve the core Delphi features—independent judgment, anonymity where appropriate, controlled feedback, statistical aggregation, and iteration—while selecting technology and meeting formats that make the process more efficient.

Reference: O’Hagan E, Sheahen B, Cho K, et al. Integrating real-time polling into modified Delphi methodology: lessons from a consensus study on cardiac implantable electronic device remote monitoring. BMC Medical Research Methodology. 2026;26:73. https://doi.org/10.1186/s12874-026-02807-2

Methodological safeguards still matter

Plan before the meeting

  • Predefine consensus and disagreement criteria
  • Specify which items advance to live review
  • Decide what feedback participants will see
  • Define whether and when responses can be revised
  • Plan how remote and in-room participants will participate equally

Protect the integrity of the response

  • Collect an independent rating before open discussion
  • Present feedback without identifying individual panelists
  • Use neutral facilitation and balanced speaking opportunities
  • Collect a private post-discussion rating
  • Report changes, attrition, disagreement, and protocol deviations transparently
A live meeting should not become a shortcut around rigor. If discussion, hierarchy, or visible voting can pressure participants toward conformity, the session may weaken rather than strengthen the Delphi process. Hybrid designs work best when the live component is structured as part of the methodology—not added as an informal final vote.

When a hybrid design may not be the best choice

The panel cannot meet equitably

Time-zone, accessibility, technology, language, or scheduling barriers may exclude important voices or create unequal influence.

Participants need more reflection

Complex evidence, sensitive topics, or extensive qualitative reasoning may benefit from another asynchronous round instead of immediate reconsideration.

The study requires full anonymity

Even anonymous voting may not remove interpersonal pressure when panelists know who is present and hear identifiable viewpoints during discussion.

How Surveylet supports the combined design

Surveylet can keep the online, real-time, and live components within one structured study environment, reducing the need to reconstruct the process across unrelated survey and polling tools.

Flexible study phases

Configure multi-round surveys, Real-Time Delphi feedback, time-limited reconsideration, and live session questions around the approved protocol.

Controlled feedback

Present response distributions, consensus information, and anonymized comments to support informed reconsideration.

Traceable results

Track responses and revisions, monitor participation, export study data, and document the path from initial ratings to final outcomes.

Frequently asked questions

Is a hybrid Delphi the same as Real-Time Delphi?

No. Real-Time Delphi is one possible component. A hybrid design deliberately combines two or more modes, such as asynchronous rounds, real-time feedback, and a synchronous consensus meeting.

Must every panelist attend the live session?

Not necessarily, but attendance rules and the effect of missing participants must be planned and reported. A live subset should not silently replace the composition of the wider Delphi panel.

Should the live session discuss every item?

Usually no. Time is better used on unresolved, ambiguous, high-priority, or high-consequence items. Items already meeting the protocol’s decision rule can often be retained without further discussion.

Does discussion guarantee consensus?

No—and consensus should not be forced. Persistent disagreement can be a valid and important study finding.

Plan the right sequence for your panel and decision

Tell us your research question, panel, current study stage, timeline, and intended output. Calibrum can help determine whether your project should remain multi-round, use Real-Time Delphi, add a focused Live Consensus Session, or combine these approaches in a documented hybrid design.