Skip to content
CalibrumCore outcome sets
Core Outcome Set Delphi Studies

Delphi support for core outcome set development

Surveylet helps research teams develop core outcome sets using structured Delphi and real-time Delphi methods, with support for stakeholder panels, outcome prioritization, controlled feedback, consensus thresholds, and reporting-ready exports.

Delphi support for core outcome set development

A shared minimum set of outcomes for research and reporting

A core outcome set is an agreed minimum set of outcomes that should be measured and reported in all studies of a particular condition, intervention, population, or care setting. Core outcome sets help reduce outcome heterogeneity, make studies easier to compare, improve evidence synthesis, and ensure that outcomes important to patients, clinicians, researchers, and other stakeholders are considered.

Delphi methods are commonly used in core outcome set development because they allow diverse stakeholders to rate and prioritize candidate outcomes in a structured and transparent way.

Designed for outcome prioritization and stakeholder consensus

Stakeholder Group Management

Organize participants by stakeholder group, such as clinicians, researchers, patients, caregivers, policy leaders, or professional-society representatives.

Outcome Rating Scales

Use structured rating scales, such as 1–9 importance scales, agreement scales, feasibility scales, or custom rating frameworks.

Round-by-Round Feedback

Provide participants with group-level feedback, distribution summaries, and anonymized comments before they reconsider ratings.

Consensus Tracking

Monitor which outcomes meet inclusion, exclusion, or no-consensus thresholds based on predefined criteria.

Real-Time Delphi Options

Use real-time Delphi methods when the study design calls for faster iteration and participant access to updated group feedback.

Reporting-Ready Outputs

Export data and summaries for analysis, steering-committee review, consensus meetings, supplementary files, and manuscripts.

From long list to final core outcome set

Generate candidate outcomesCandidate outcomes may come from systematic reviews, interviews, focus groups, registry data, steering-committee input, prior COS work, or clinical expertise.
Prepare the Delphi surveyOutcomes are organized into domains, definitions are clarified, instructions are written, and rating scales are selected.
Recruit stakeholdersPanels may include patients, caregivers, clinicians, researchers, funders, professional organizations, regulators, or other groups affected by the research.
Conduct Delphi Round 1Participants rate the importance of each candidate outcome and may provide comments or suggest missing outcomes.
Provide structured feedbackParticipants receive feedback such as distribution of scores, stakeholder-group summaries, and comments from the prior round.
Conduct additional rounds or real-time iterationParticipants reconsider their ratings. Outcomes are tracked against predefined consensus rules.
Consensus meetingMany COS projects include a final meeting to review Delphi results and confirm the final core outcome set.
Reporting and disseminationThe study team reports the final COS, methodology, participant flow, response rates, consensus criteria, and outcome-selection process.

A platform and services model for complex consensus research

Core outcome set projects often involve multiple stakeholder groups, long candidate-outcome lists, detailed definitions, repeated ratings, carefully defined consensus thresholds, and publication-quality reporting expectations. Surveylet helps manage this complexity, while Calibrum’s services can support the operational and methodological steps needed to run the process efficiently.

Delphi Design Planning

Support for study structure, rounds, thresholds, scales, and stakeholder panels.

Surveylet Configuration

Outcome lists, domains, participant workflows, feedback, reminders, and testing.

Analysis and Reporting

Round summaries, consensus status, tables, figures, and methods-support language.

Developing a core outcome set?

Calibrum can help you structure the Delphi process, configure Surveylet, support stakeholder participation, and prepare analysis-ready outputs for your steering committee, consensus meeting, or manuscript.