Assessing the outcomes of participatory research: Protocol for identifying, selecting, appraising and synthesizing the literature for realist review

Justin Jagosh, Pierre Pluye, Ann Macaulay, Jon Salsberg, James Henderson, Erin Sirett, Paula Bush, Robbyn Seller, Geoff Wong, Trish Greenhalgh, Margaret CARGO, Carol Herbert, Sarena Seifer, Lawrence Green

Research output: Contribution to journalArticle

43 Citations (Scopus)

Abstract

Background

Participatory Research (PR) entails the co-governance of research by academic researchers and end-users. End-users are those who are affected by issues under study (e.g., community groups or populations affected by illness), or those positioned to act on the knowledge generated by research (e.g., clinicians, community leaders, health managers, patients, and policy makers). Systematic reviews assessing the generalizable benefits of PR must address: the diversity of research topics, methods, and intervention designs that involve a PR approach; varying degrees of end-user involvement in research co-governance, both within and between projects; and the complexity of outcomes arising from long-term partnerships.

Methods

We addressed the above mentioned challenges by adapting realist review methodology to PR assessment, specifically by developing inductively-driven identification, selection, appraisal, and synthesis procedures. This approach allowed us to address the non-uniformity and complexity of the PR literature. Each stage of the review involved two independent reviewers and followed a reproducible, systematic coding and retention procedure. Retained studies were completed participatory health interventions, demonstrated high levels of participation by non-academic stakeholders (i.e., excluding studies in which end-users were not involved in co-governing throughout the stages of research) and contained detailed descriptions of the participatory process and context. Retained sets are being mapped and analyzed using realist review methods.

Results

The librarian-guided search string yielded 7,167 citations. A total of 594 citations were retained after the identification process. Eighty-three papers remained after selection. Principle Investigators (PIs) were contacted to solicit all companion papers. Twenty-three sets of papers (23 PR studies), comprising 276 publications, passed appraisal and are being synthesized using realist review methods.

Discussion

The systematic and stage-based procedure addressed challenges to PR assessment and generated our robust understanding of complex and heterogeneous PR practices. To date, realist reviews have focussed on evaluations of relatively uniform interventions. In contrast our PR search yielded a wide diversity of partnerships and research topics. We therefore developed tools to achieve conceptual clarity on the PR field, as a beneficial precursor to our theoretically-driven synthesis using realist methods. Findings from the ongoing review will be provided in forthcoming publications.
Original languageEnglish
Pages (from-to)1-8
Number of pages8
JournalImplementation Science
Volume6
Issue number1
DOIs
Publication statusPublished - 2011
Externally publishedYes

Fingerprint

Outcome Assessment (Health Care)
Research
Publications
Research Personnel
Librarians
Health
Administrative Personnel
Population Groups

Cite this

Jagosh, Justin ; Pluye, Pierre ; Macaulay, Ann ; Salsberg, Jon ; Henderson, James ; Sirett, Erin ; Bush, Paula ; Seller, Robbyn ; Wong, Geoff ; Greenhalgh, Trish ; CARGO, Margaret ; Herbert, Carol ; Seifer, Sarena ; Green, Lawrence. / Assessing the outcomes of participatory research: Protocol for identifying, selecting, appraising and synthesizing the literature for realist review. In: Implementation Science. 2011 ; Vol. 6, No. 1. pp. 1-8.
@article{86dbcae8bf1c4a7aadd4226b09074cf7,
title = "Assessing the outcomes of participatory research: Protocol for identifying, selecting, appraising and synthesizing the literature for realist review",
abstract = "BackgroundParticipatory Research (PR) entails the co-governance of research by academic researchers and end-users. End-users are those who are affected by issues under study (e.g., community groups or populations affected by illness), or those positioned to act on the knowledge generated by research (e.g., clinicians, community leaders, health managers, patients, and policy makers). Systematic reviews assessing the generalizable benefits of PR must address: the diversity of research topics, methods, and intervention designs that involve a PR approach; varying degrees of end-user involvement in research co-governance, both within and between projects; and the complexity of outcomes arising from long-term partnerships.MethodsWe addressed the above mentioned challenges by adapting realist review methodology to PR assessment, specifically by developing inductively-driven identification, selection, appraisal, and synthesis procedures. This approach allowed us to address the non-uniformity and complexity of the PR literature. Each stage of the review involved two independent reviewers and followed a reproducible, systematic coding and retention procedure. Retained studies were completed participatory health interventions, demonstrated high levels of participation by non-academic stakeholders (i.e., excluding studies in which end-users were not involved in co-governing throughout the stages of research) and contained detailed descriptions of the participatory process and context. Retained sets are being mapped and analyzed using realist review methods.ResultsThe librarian-guided search string yielded 7,167 citations. A total of 594 citations were retained after the identification process. Eighty-three papers remained after selection. Principle Investigators (PIs) were contacted to solicit all companion papers. Twenty-three sets of papers (23 PR studies), comprising 276 publications, passed appraisal and are being synthesized using realist review methods.DiscussionThe systematic and stage-based procedure addressed challenges to PR assessment and generated our robust understanding of complex and heterogeneous PR practices. To date, realist reviews have focussed on evaluations of relatively uniform interventions. In contrast our PR search yielded a wide diversity of partnerships and research topics. We therefore developed tools to achieve conceptual clarity on the PR field, as a beneficial precursor to our theoretically-driven synthesis using realist methods. Findings from the ongoing review will be provided in forthcoming publications.",
author = "Justin Jagosh and Pierre Pluye and Ann Macaulay and Jon Salsberg and James Henderson and Erin Sirett and Paula Bush and Robbyn Seller and Geoff Wong and Trish Greenhalgh and Margaret CARGO and Carol Herbert and Sarena Seifer and Lawrence Green",
year = "2011",
doi = "10.1186/1748-5908-6-24",
language = "English",
volume = "6",
pages = "1--8",
journal = "Implementation Science",
issn = "1748-5908",
publisher = "BioMed Central",
number = "1",

}

Jagosh, J, Pluye, P, Macaulay, A, Salsberg, J, Henderson, J, Sirett, E, Bush, P, Seller, R, Wong, G, Greenhalgh, T, CARGO, M, Herbert, C, Seifer, S & Green, L 2011, 'Assessing the outcomes of participatory research: Protocol for identifying, selecting, appraising and synthesizing the literature for realist review', Implementation Science, vol. 6, no. 1, pp. 1-8. https://doi.org/10.1186/1748-5908-6-24

Assessing the outcomes of participatory research: Protocol for identifying, selecting, appraising and synthesizing the literature for realist review. / Jagosh, Justin; Pluye, Pierre; Macaulay, Ann; Salsberg, Jon; Henderson, James; Sirett, Erin; Bush, Paula; Seller, Robbyn; Wong, Geoff; Greenhalgh, Trish; CARGO, Margaret; Herbert, Carol; Seifer, Sarena; Green, Lawrence.

In: Implementation Science, Vol. 6, No. 1, 2011, p. 1-8.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Assessing the outcomes of participatory research: Protocol for identifying, selecting, appraising and synthesizing the literature for realist review

AU - Jagosh, Justin

AU - Pluye, Pierre

AU - Macaulay, Ann

AU - Salsberg, Jon

AU - Henderson, James

AU - Sirett, Erin

AU - Bush, Paula

AU - Seller, Robbyn

AU - Wong, Geoff

AU - Greenhalgh, Trish

AU - CARGO, Margaret

AU - Herbert, Carol

AU - Seifer, Sarena

AU - Green, Lawrence

PY - 2011

Y1 - 2011

N2 - BackgroundParticipatory Research (PR) entails the co-governance of research by academic researchers and end-users. End-users are those who are affected by issues under study (e.g., community groups or populations affected by illness), or those positioned to act on the knowledge generated by research (e.g., clinicians, community leaders, health managers, patients, and policy makers). Systematic reviews assessing the generalizable benefits of PR must address: the diversity of research topics, methods, and intervention designs that involve a PR approach; varying degrees of end-user involvement in research co-governance, both within and between projects; and the complexity of outcomes arising from long-term partnerships.MethodsWe addressed the above mentioned challenges by adapting realist review methodology to PR assessment, specifically by developing inductively-driven identification, selection, appraisal, and synthesis procedures. This approach allowed us to address the non-uniformity and complexity of the PR literature. Each stage of the review involved two independent reviewers and followed a reproducible, systematic coding and retention procedure. Retained studies were completed participatory health interventions, demonstrated high levels of participation by non-academic stakeholders (i.e., excluding studies in which end-users were not involved in co-governing throughout the stages of research) and contained detailed descriptions of the participatory process and context. Retained sets are being mapped and analyzed using realist review methods.ResultsThe librarian-guided search string yielded 7,167 citations. A total of 594 citations were retained after the identification process. Eighty-three papers remained after selection. Principle Investigators (PIs) were contacted to solicit all companion papers. Twenty-three sets of papers (23 PR studies), comprising 276 publications, passed appraisal and are being synthesized using realist review methods.DiscussionThe systematic and stage-based procedure addressed challenges to PR assessment and generated our robust understanding of complex and heterogeneous PR practices. To date, realist reviews have focussed on evaluations of relatively uniform interventions. In contrast our PR search yielded a wide diversity of partnerships and research topics. We therefore developed tools to achieve conceptual clarity on the PR field, as a beneficial precursor to our theoretically-driven synthesis using realist methods. Findings from the ongoing review will be provided in forthcoming publications.

AB - BackgroundParticipatory Research (PR) entails the co-governance of research by academic researchers and end-users. End-users are those who are affected by issues under study (e.g., community groups or populations affected by illness), or those positioned to act on the knowledge generated by research (e.g., clinicians, community leaders, health managers, patients, and policy makers). Systematic reviews assessing the generalizable benefits of PR must address: the diversity of research topics, methods, and intervention designs that involve a PR approach; varying degrees of end-user involvement in research co-governance, both within and between projects; and the complexity of outcomes arising from long-term partnerships.MethodsWe addressed the above mentioned challenges by adapting realist review methodology to PR assessment, specifically by developing inductively-driven identification, selection, appraisal, and synthesis procedures. This approach allowed us to address the non-uniformity and complexity of the PR literature. Each stage of the review involved two independent reviewers and followed a reproducible, systematic coding and retention procedure. Retained studies were completed participatory health interventions, demonstrated high levels of participation by non-academic stakeholders (i.e., excluding studies in which end-users were not involved in co-governing throughout the stages of research) and contained detailed descriptions of the participatory process and context. Retained sets are being mapped and analyzed using realist review methods.ResultsThe librarian-guided search string yielded 7,167 citations. A total of 594 citations were retained after the identification process. Eighty-three papers remained after selection. Principle Investigators (PIs) were contacted to solicit all companion papers. Twenty-three sets of papers (23 PR studies), comprising 276 publications, passed appraisal and are being synthesized using realist review methods.DiscussionThe systematic and stage-based procedure addressed challenges to PR assessment and generated our robust understanding of complex and heterogeneous PR practices. To date, realist reviews have focussed on evaluations of relatively uniform interventions. In contrast our PR search yielded a wide diversity of partnerships and research topics. We therefore developed tools to achieve conceptual clarity on the PR field, as a beneficial precursor to our theoretically-driven synthesis using realist methods. Findings from the ongoing review will be provided in forthcoming publications.

U2 - 10.1186/1748-5908-6-24

DO - 10.1186/1748-5908-6-24

M3 - Article

VL - 6

SP - 1

EP - 8

JO - Implementation Science

JF - Implementation Science

SN - 1748-5908

IS - 1

ER -