When a Delphi Item Falls Just Below the Consensus Threshold
An item can fall just below a consensus threshold and still matter to the study team. Keep its calculated status visible, explain any later decision to retain it, and record what further review is needed.
A recent syllabus study reported two different outcomes
In a November 18, 2026 spiritual-care syllabus study, 29 of 31 revised items met an 80% consensus threshold. Two competencies scored 76.5% and were retained separately as enabling competencies. The authors describe these as near-consensus and identify the syllabus as a starting point requiring evaluation.
The useful distinction is between the measured result and what the team chose to do with the item. Reporting both lets readers see how the final material was assembled. The example does not establish a universal near-consensus category or threshold.
The following vote counts and decisions are fictional Calibrum examples for an administrative training project.
Apply the original rule to the underlying counts
Suppose the protocol defines support as a rating of 4 or 5 and requires at least 80% of valid ratings. With 17 valid responses, the minimum qualifying count is 14: 13/17 is approximately 76.5%, while 14/17 is approximately 82.4%.
A result one vote below the boundary remains below the rule. Calculate from the counts or full-precision percentage, then round for display. A team’s confidence in the item or a desire for a complete framework does not alter that calculation.
Also check any participation, low-rating, or subgroup conditions in the protocol. Record explicit non-ratings and missing responses separately, and state which observations enter the denominator. See threshold arithmetic for small panels and quorum and agreement.
Record consensus status and final disposition separately
| Training item | Support among 17 valid ratings | Protocol status | Documented next step |
|---|---|---|---|
| T01: Confirm receipt of a request. | 14/17 (82.4%). | Met the 80% rule. | Retain in the consensus-supported core. |
| T02: Offer an optional orientation session. | 13/17 (76.5%). | Did not meet the 80% rule. | Team retains it as optional supporting material, with rationale and separate review. |
| T03: Escalate requests after a fixed interval. | 12/17 (70.6%). | Did not meet the 80% rule. | Revise the interval and reconsider under the planned next stage. |
T02’s presence in the final document should not cause its status to change to “consensus achieved.” Identify who made the retention decision, when it was made, the intended use, and what review remains. Keep the original rating result alongside it.
The same distinction applies to retirement. A team may remove a statement for duplication or scope even when it met the agreement rule. Explain that editorial decision instead of rewriting the result.
Use the protocol to decide what happens next
Before launch, specify what will happen to unresolved items: further feedback, revision and re-rating, discussion at a meeting, retirement, or retention in a separately labeled appendix. Set the stopping rule and identify who can approve each action.
If the study genuinely prespecified more than one acceptance tier, report each tier and its purpose. If a label or exception was introduced after results were seen, disclose its timing and rationale. Preserve the primary classification and identify any post-hoc sensitivity analysis as such.
Read comments before choosing a revision. A term may be unclear, the proposed action may be infeasible, or panelists may hold materially different views. Each calls for a different response. Retain minority reasoning that affects interpretation.
When wording changes the action, population, or conditions, preserve the earlier version and explain the renewed assessment. Support for the earlier wording cannot automatically establish support for a materially different statement.
Make the final report readable without reconstructing decisions
Original reporting example
“T02 received 13/17 supporting ratings (76.5%) and did not meet the prespecified 80% criterion. After reviewing the comments, the study team retained it as optional orientation material. This was a team decision, and T02 is excluded from the count of items achieving consensus.”
Use separate columns for the rule, counts, calculated status, disposition, reason, and responsible reviewer. Report a retained optional item in the appropriate appendix or table so its evidence status remains clear.
Surveylet can collect item ratings and comments and provide data for reporting. Preserve the configured result and maintain any later retention or approval decision in the agreed study record. A custom disposition table or exception process should be scoped explicitly; this guide does not introduce an additional automatic Surveylet status.
For the complete methods record, use the Delphi reporting guide. Plan a practitioner review or field pilot when the final material is intended for use.
Sources and scope
Memaryan N, Mortazavi FS, Nouri M, Zaidi SN. A consensus-based syllabus for training spiritual care providers: a Delphi study. BMC Health Services Research. Published November 18, 2026; peer-reviewed early release. DOI: 10.1186/s12913-026-16184-5. The linked abstract reports the threshold and the separate treatment of enabling competencies.
See the ACCORD reporting guideline for documenting methods and decisions transparently. The training items, dispositions, and reporting sentence here are original illustrations. The publication is a methodological example, with no claim that it used Surveylet.
Define unresolved-item decisions before launch
Share your protocol, planned rounds, and reporting requirements so we can scope the Surveylet configuration and analysis support.
