Critical reflections on realist review

Insights from customizing the methodology to the needs of participatory research assessment

Justin Jagosh, Pierre Pluye, Geoff Wong, Margaret CARGO, Jon Salsberg, Paula Bush, Carol Herbert, Lawrence Green, Trish Greenhalgh, Ann Macaulay

Research output: Contribution to journalArticle

41 Citations (Scopus)

Abstract

Realist review has increased in popularity as a methodology for complex intervention assessment. Our experience suggests that the process of designing a realist review requires its customization to areas under investigation. To elaborate on this idea, we first describe the logic underpinning realist review and then present critical reflections on our application experience, organized in seven areas. These are the following: (1) the challenge of identifying middle range theory; (2) addressing heterogeneity and lack of conceptual clarity; (3) the challenge of appraising the quality of complex evidence; (4) the relevance of capturing unintended outcomes; (5) understanding the process of context, mechanism, and outcome (CMO) configuring; (6) incorporating middle-range theory in the CMO configuration process; and (7) using middle range theory to advance the conceptualization of outcomes – both visible and seemingly ‘hidden’. One conclusion from our experience is that the degree of heterogeneity of the evidence base will determine whether theory can drive the development of review protocols from the outset, or will follow only after an intense period of data immersion. We hope that presenting a critical reflection on customizing realist review will convey how the methodology can be tailored to the often complex and idiosyncratic features of health research, leading to innovative evidence syntheses.
Original languageEnglish
Pages (from-to)131-141
Number of pages11
JournalResearch Synthesis Methods
Volume5
Issue number2
DOIs
Publication statusPublished - 2014
Externally publishedYes

Fingerprint

methodology
evidence
experience
popularity
lack
present
health

Cite this

Jagosh, Justin ; Pluye, Pierre ; Wong, Geoff ; CARGO, Margaret ; Salsberg, Jon ; Bush, Paula ; Herbert, Carol ; Green, Lawrence ; Greenhalgh, Trish ; Macaulay, Ann. / Critical reflections on realist review : Insights from customizing the methodology to the needs of participatory research assessment. In: Research Synthesis Methods. 2014 ; Vol. 5, No. 2. pp. 131-141.
@article{9c62917d9e334acf93439cc8eb284c1e,
title = "Critical reflections on realist review: Insights from customizing the methodology to the needs of participatory research assessment",
abstract = "Realist review has increased in popularity as a methodology for complex intervention assessment. Our experience suggests that the process of designing a realist review requires its customization to areas under investigation. To elaborate on this idea, we first describe the logic underpinning realist review and then present critical reflections on our application experience, organized in seven areas. These are the following: (1) the challenge of identifying middle range theory; (2) addressing heterogeneity and lack of conceptual clarity; (3) the challenge of appraising the quality of complex evidence; (4) the relevance of capturing unintended outcomes; (5) understanding the process of context, mechanism, and outcome (CMO) configuring; (6) incorporating middle-range theory in the CMO configuration process; and (7) using middle range theory to advance the conceptualization of outcomes – both visible and seemingly ‘hidden’. One conclusion from our experience is that the degree of heterogeneity of the evidence base will determine whether theory can drive the development of review protocols from the outset, or will follow only after an intense period of data immersion. We hope that presenting a critical reflection on customizing realist review will convey how the methodology can be tailored to the often complex and idiosyncratic features of health research, leading to innovative evidence syntheses.",
keywords = "Context-mechanism-outcome configuring, Critical realism, Health research, Middle-range theory, Participatory research, Realist review, critical realism, realist review, middle-range theory, context-mechanism-outcome configuring, health research, participatory research",
author = "Justin Jagosh and Pierre Pluye and Geoff Wong and Margaret CARGO and Jon Salsberg and Paula Bush and Carol Herbert and Lawrence Green and Trish Greenhalgh and Ann Macaulay",
year = "2014",
doi = "10.1002/jrsm.1099",
language = "English",
volume = "5",
pages = "131--141",
journal = "Research Synthesis Methods",
issn = "1759-2887",
publisher = "John Wiley & Sons",
number = "2",

}

Jagosh, J, Pluye, P, Wong, G, CARGO, M, Salsberg, J, Bush, P, Herbert, C, Green, L, Greenhalgh, T & Macaulay, A 2014, 'Critical reflections on realist review: Insights from customizing the methodology to the needs of participatory research assessment', Research Synthesis Methods, vol. 5, no. 2, pp. 131-141. https://doi.org/10.1002/jrsm.1099

Critical reflections on realist review : Insights from customizing the methodology to the needs of participatory research assessment. / Jagosh, Justin; Pluye, Pierre; Wong, Geoff; CARGO, Margaret; Salsberg, Jon; Bush, Paula; Herbert, Carol; Green, Lawrence; Greenhalgh, Trish; Macaulay, Ann.

In: Research Synthesis Methods, Vol. 5, No. 2, 2014, p. 131-141.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Critical reflections on realist review

T2 - Insights from customizing the methodology to the needs of participatory research assessment

AU - Jagosh, Justin

AU - Pluye, Pierre

AU - Wong, Geoff

AU - CARGO, Margaret

AU - Salsberg, Jon

AU - Bush, Paula

AU - Herbert, Carol

AU - Green, Lawrence

AU - Greenhalgh, Trish

AU - Macaulay, Ann

PY - 2014

Y1 - 2014

N2 - Realist review has increased in popularity as a methodology for complex intervention assessment. Our experience suggests that the process of designing a realist review requires its customization to areas under investigation. To elaborate on this idea, we first describe the logic underpinning realist review and then present critical reflections on our application experience, organized in seven areas. These are the following: (1) the challenge of identifying middle range theory; (2) addressing heterogeneity and lack of conceptual clarity; (3) the challenge of appraising the quality of complex evidence; (4) the relevance of capturing unintended outcomes; (5) understanding the process of context, mechanism, and outcome (CMO) configuring; (6) incorporating middle-range theory in the CMO configuration process; and (7) using middle range theory to advance the conceptualization of outcomes – both visible and seemingly ‘hidden’. One conclusion from our experience is that the degree of heterogeneity of the evidence base will determine whether theory can drive the development of review protocols from the outset, or will follow only after an intense period of data immersion. We hope that presenting a critical reflection on customizing realist review will convey how the methodology can be tailored to the often complex and idiosyncratic features of health research, leading to innovative evidence syntheses.

AB - Realist review has increased in popularity as a methodology for complex intervention assessment. Our experience suggests that the process of designing a realist review requires its customization to areas under investigation. To elaborate on this idea, we first describe the logic underpinning realist review and then present critical reflections on our application experience, organized in seven areas. These are the following: (1) the challenge of identifying middle range theory; (2) addressing heterogeneity and lack of conceptual clarity; (3) the challenge of appraising the quality of complex evidence; (4) the relevance of capturing unintended outcomes; (5) understanding the process of context, mechanism, and outcome (CMO) configuring; (6) incorporating middle-range theory in the CMO configuration process; and (7) using middle range theory to advance the conceptualization of outcomes – both visible and seemingly ‘hidden’. One conclusion from our experience is that the degree of heterogeneity of the evidence base will determine whether theory can drive the development of review protocols from the outset, or will follow only after an intense period of data immersion. We hope that presenting a critical reflection on customizing realist review will convey how the methodology can be tailored to the often complex and idiosyncratic features of health research, leading to innovative evidence syntheses.

KW - Context-mechanism-outcome configuring

KW - Critical realism

KW - Health research

KW - Middle-range theory

KW - Participatory research

KW - Realist review

KW - critical realism

KW - realist review

KW - middle-range theory

KW - context-mechanism-outcome configuring

KW - health research

KW - participatory research

UR - http://www.scopus.com/inward/record.url?scp=84897064978&partnerID=8YFLogxK

UR - http://www.mendeley.com/research/critical-reflections-realist-review-insights-customizing-methodology-needs-participatory-research-as-1

U2 - 10.1002/jrsm.1099

DO - 10.1002/jrsm.1099

M3 - Article

VL - 5

SP - 131

EP - 141

JO - Research Synthesis Methods

JF - Research Synthesis Methods

SN - 1759-2887

IS - 2

ER -