Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows

J. Angus Webb, Kimberly A. Miller, Elise L. King, Siobhan C. de Little, Michael J. Stewardson, Julie K. H. Zimmerman, LeRoy POFF

Research output: Contribution to journalArticle

51 Citations (Scopus)

Abstract

Human-induced changes in river flow regimes are ubiquitous worldwide. Although numerous case studies have identified negative ecological impacts of changes in different aspects of flow regimes (e.g. magnitude, timing), there have been few attempts to systematically review this literature to derive general relationships regarding ecological responses to changes in flow regimes. Systematic literature reviews can inform science and management in ecologically complex systems not amenable to experimentation. However, such analysis of existing literature is often limited by inconsistent study design and data reporting. To attempt to overcome these difficulties, we used the recently developed Eco Evidence method and software to analyse 165 studies of ecological responses to changes in river flow regimes. Eco Evidence provides a rule set and standardised list of terms to assist reviewers to interpret consistently the results of disparate studies. The companion software assists with the synthesis of this information to reach transparent and repeatable conclusions regarding cause-effect hypotheses of ecological responses to environmental drivers. We compared our results to those of a recent, informal systematic review of the same studies, which is proving extremely influential. Stronger conclusions are reached when evidence is weighted, classified and combined according to the rules in Eco Evidence. Compared to the original review, we reached informative conclusions for a larger number of flow-response hypotheses, found that hypotheses for which the most evidence was available returned inconsistent results, addressed hypotheses at levels of conceptual resolution relevant to management and identified where insufficient evidence exists to reach a conclusion. Analyses conducted at several levels of conceptual resolution found strong support for many hypotheses regarding ecological impacts. We found a consistent sensitivity to changes in flow regime for both fish and riparian vegetation across a variety of performance metrics. While macroinvertebrate responses varied among performance metrics (e.g. abundance was negatively affected by increases or decreases in flows, diversity was only negatively affected by flow decreases, and assemblage structure was affected by neither), they were largely consistent within these metrics. We thus conclude that the Eco Evidence approach allowed us to extract more knowledge from the data set than was possible in the original review. Eco Evidence can improve synthesis of the burgeoning ecological literature and improve our general understanding in ecology. Amid widespread calls for evidence-based' environmental management, this powerful tool provides managers with a means of using research to help inform complex environmental decision-making
Original languageEnglish
Pages (from-to)2439-2451
Number of pages13
JournalFreshwater Biology
Volume58
Issue number12
DOIs
Publication statusPublished - 2013
Externally publishedYes

Fingerprint

ecological impact
river flow
software
riparian vegetation
literature review
macroinvertebrate
environmental management
rivers
synthesis
analysis
systematic review
decision making
macroinvertebrates
ecology
managers
experimental design
fish
case studies
vegetation
extracts

Cite this

Webb, J. A., Miller, K. A., King, E. L., de Little, S. C., Stewardson, M. J., Zimmerman, J. K. H., & POFF, L. (2013). Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows. Freshwater Biology, 58(12), 2439-2451. https://doi.org/10.1111/fwb.12234
Webb, J. Angus ; Miller, Kimberly A. ; King, Elise L. ; de Little, Siobhan C. ; Stewardson, Michael J. ; Zimmerman, Julie K. H. ; POFF, LeRoy. / Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows. In: Freshwater Biology. 2013 ; Vol. 58, No. 12. pp. 2439-2451.
@article{a15e1f0b344848a982accbd9a22652c6,
title = "Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows",
abstract = "Human-induced changes in river flow regimes are ubiquitous worldwide. Although numerous case studies have identified negative ecological impacts of changes in different aspects of flow regimes (e.g. magnitude, timing), there have been few attempts to systematically review this literature to derive general relationships regarding ecological responses to changes in flow regimes. Systematic literature reviews can inform science and management in ecologically complex systems not amenable to experimentation. However, such analysis of existing literature is often limited by inconsistent study design and data reporting. To attempt to overcome these difficulties, we used the recently developed Eco Evidence method and software to analyse 165 studies of ecological responses to changes in river flow regimes. Eco Evidence provides a rule set and standardised list of terms to assist reviewers to interpret consistently the results of disparate studies. The companion software assists with the synthesis of this information to reach transparent and repeatable conclusions regarding cause-effect hypotheses of ecological responses to environmental drivers. We compared our results to those of a recent, informal systematic review of the same studies, which is proving extremely influential. Stronger conclusions are reached when evidence is weighted, classified and combined according to the rules in Eco Evidence. Compared to the original review, we reached informative conclusions for a larger number of flow-response hypotheses, found that hypotheses for which the most evidence was available returned inconsistent results, addressed hypotheses at levels of conceptual resolution relevant to management and identified where insufficient evidence exists to reach a conclusion. Analyses conducted at several levels of conceptual resolution found strong support for many hypotheses regarding ecological impacts. We found a consistent sensitivity to changes in flow regime for both fish and riparian vegetation across a variety of performance metrics. While macroinvertebrate responses varied among performance metrics (e.g. abundance was negatively affected by increases or decreases in flows, diversity was only negatively affected by flow decreases, and assemblage structure was affected by neither), they were largely consistent within these metrics. We thus conclude that the Eco Evidence approach allowed us to extract more knowledge from the data set than was possible in the original review. Eco Evidence can improve synthesis of the burgeoning ecological literature and improve our general understanding in ecology. Amid widespread calls for evidence-based' environmental management, this powerful tool provides managers with a means of using research to help inform complex environmental decision-making",
author = "Webb, {J. Angus} and Miller, {Kimberly A.} and King, {Elise L.} and {de Little}, {Siobhan C.} and Stewardson, {Michael J.} and Zimmerman, {Julie K. H.} and LeRoy POFF",
note = "cited By 20",
year = "2013",
doi = "10.1111/fwb.12234",
language = "English",
volume = "58",
pages = "2439--2451",
journal = "Freshwater Biology",
issn = "0046-5070",
publisher = "Wiley-Blackwell",
number = "12",

}

Webb, JA, Miller, KA, King, EL, de Little, SC, Stewardson, MJ, Zimmerman, JKH & POFF, L 2013, 'Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows', Freshwater Biology, vol. 58, no. 12, pp. 2439-2451. https://doi.org/10.1111/fwb.12234

Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows. / Webb, J. Angus; Miller, Kimberly A.; King, Elise L.; de Little, Siobhan C.; Stewardson, Michael J.; Zimmerman, Julie K. H.; POFF, LeRoy.

In: Freshwater Biology, Vol. 58, No. 12, 2013, p. 2439-2451.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Squeezing the most out of existing literature: A systematic re-analysis of published evidence on ecological responses to altered flows

AU - Webb, J. Angus

AU - Miller, Kimberly A.

AU - King, Elise L.

AU - de Little, Siobhan C.

AU - Stewardson, Michael J.

AU - Zimmerman, Julie K. H.

AU - POFF, LeRoy

N1 - cited By 20

PY - 2013

Y1 - 2013

N2 - Human-induced changes in river flow regimes are ubiquitous worldwide. Although numerous case studies have identified negative ecological impacts of changes in different aspects of flow regimes (e.g. magnitude, timing), there have been few attempts to systematically review this literature to derive general relationships regarding ecological responses to changes in flow regimes. Systematic literature reviews can inform science and management in ecologically complex systems not amenable to experimentation. However, such analysis of existing literature is often limited by inconsistent study design and data reporting. To attempt to overcome these difficulties, we used the recently developed Eco Evidence method and software to analyse 165 studies of ecological responses to changes in river flow regimes. Eco Evidence provides a rule set and standardised list of terms to assist reviewers to interpret consistently the results of disparate studies. The companion software assists with the synthesis of this information to reach transparent and repeatable conclusions regarding cause-effect hypotheses of ecological responses to environmental drivers. We compared our results to those of a recent, informal systematic review of the same studies, which is proving extremely influential. Stronger conclusions are reached when evidence is weighted, classified and combined according to the rules in Eco Evidence. Compared to the original review, we reached informative conclusions for a larger number of flow-response hypotheses, found that hypotheses for which the most evidence was available returned inconsistent results, addressed hypotheses at levels of conceptual resolution relevant to management and identified where insufficient evidence exists to reach a conclusion. Analyses conducted at several levels of conceptual resolution found strong support for many hypotheses regarding ecological impacts. We found a consistent sensitivity to changes in flow regime for both fish and riparian vegetation across a variety of performance metrics. While macroinvertebrate responses varied among performance metrics (e.g. abundance was negatively affected by increases or decreases in flows, diversity was only negatively affected by flow decreases, and assemblage structure was affected by neither), they were largely consistent within these metrics. We thus conclude that the Eco Evidence approach allowed us to extract more knowledge from the data set than was possible in the original review. Eco Evidence can improve synthesis of the burgeoning ecological literature and improve our general understanding in ecology. Amid widespread calls for evidence-based' environmental management, this powerful tool provides managers with a means of using research to help inform complex environmental decision-making

AB - Human-induced changes in river flow regimes are ubiquitous worldwide. Although numerous case studies have identified negative ecological impacts of changes in different aspects of flow regimes (e.g. magnitude, timing), there have been few attempts to systematically review this literature to derive general relationships regarding ecological responses to changes in flow regimes. Systematic literature reviews can inform science and management in ecologically complex systems not amenable to experimentation. However, such analysis of existing literature is often limited by inconsistent study design and data reporting. To attempt to overcome these difficulties, we used the recently developed Eco Evidence method and software to analyse 165 studies of ecological responses to changes in river flow regimes. Eco Evidence provides a rule set and standardised list of terms to assist reviewers to interpret consistently the results of disparate studies. The companion software assists with the synthesis of this information to reach transparent and repeatable conclusions regarding cause-effect hypotheses of ecological responses to environmental drivers. We compared our results to those of a recent, informal systematic review of the same studies, which is proving extremely influential. Stronger conclusions are reached when evidence is weighted, classified and combined according to the rules in Eco Evidence. Compared to the original review, we reached informative conclusions for a larger number of flow-response hypotheses, found that hypotheses for which the most evidence was available returned inconsistent results, addressed hypotheses at levels of conceptual resolution relevant to management and identified where insufficient evidence exists to reach a conclusion. Analyses conducted at several levels of conceptual resolution found strong support for many hypotheses regarding ecological impacts. We found a consistent sensitivity to changes in flow regime for both fish and riparian vegetation across a variety of performance metrics. While macroinvertebrate responses varied among performance metrics (e.g. abundance was negatively affected by increases or decreases in flows, diversity was only negatively affected by flow decreases, and assemblage structure was affected by neither), they were largely consistent within these metrics. We thus conclude that the Eco Evidence approach allowed us to extract more knowledge from the data set than was possible in the original review. Eco Evidence can improve synthesis of the burgeoning ecological literature and improve our general understanding in ecology. Amid widespread calls for evidence-based' environmental management, this powerful tool provides managers with a means of using research to help inform complex environmental decision-making

U2 - 10.1111/fwb.12234

DO - 10.1111/fwb.12234

M3 - Article

VL - 58

SP - 2439

EP - 2451

JO - Freshwater Biology

JF - Freshwater Biology

SN - 0046-5070

IS - 12

ER -