Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management.

J. Webb, Stephen Wealands, P Lea, Susan Nichols, Siobhan De Little, Michael Stewardson, Richard Norris

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    13 Citations (Scopus)

    Abstract

    In the face of increasing human-induced pressures on natural environments, managers must balance the needs of environmental and human uses in a transparent and defensible manner. Sound decision making in environmental management relies on understanding causal relationships between environmental stressors and ecological responses. However, causal relations are difficult to demonstrate in natural environments because of the difficulty of performing experiments, natural variability, lack of replication, and the presence of confounding influences. Partly because of this, most environmental management decisions are made using expert opinion. Such decisions can lack transparency. Epidemiologists recognized similar difficulties in ascribing causality in the 1960s, and developed â¿¿causal criteriaâ¿¿ to assess causal relations in epidemiological investigations. Causal criteria analysis builds a case for causality based on the cumulative strength of many individually weak pieces of evidence. There have been several calls to use causal criteria analysis in environmental science, but few case studies exist. This may partly result from the lack of standardized methods and analysis tools (analogous to statistical software). We describe the Eco Evidence software package, which has been developed to facilitate causal criteria analysis in environmental science. It employs the published scientific literature as a previously underused source of evidence for such analyses. The software consists of a web database application â¿¿ the Eco Evidence Database â¿¿ for storing and sharing â¿¿evidence itemsâ¿¿ (the information extracted from individual studies necessary for the causal criteria analysis); and a desktop analysis tool â¿¿ the Eco Evidence Analyser â¿¿ that uses evidence shared via the web application to assess causal hypotheses. The database provides a permanent, online repository for causal evidence, accessible with any web browser. Moreover, it allows users to access evidence items entered by previous users, thereby reducing the burden of extracting evidence from the literature. The analysis tool uses a wizard-style interface to guide users through an 8-step standardized approach to causal criteria analysis specifically designed for use in the environmental sciences. A full report is produced at the end of the assessment, which contains all the information used to reach the conclusion. This maximizes transparency of the assessment, and means that any bias in the review will be detected more easily compared to a traditional literature review. We demonstrate the Eco Evidence approach with an example that investigates the evidence for the question of whether increased base flows and increased frequency of high flow events can reduce the encroachment of terrestrial vegetation into the channels of regulated rivers. Legislative and social imperatives are prompting a move from an experience-based to an evidence-based model of environmental management. This will lead to more transparent and repeatable decisions, and potentially better decisions overall. However, such a major change of practice will not be easily achieved. Tools such as Eco Evidence will facilitate the transformation by assisting managers to use scientific evidence to inform difficult decisions. With the Eco Evidence software now publicly released and freely available, we are turning our attention to facilitating uptake of the method through promotion and training. We expect that early adopters of Eco Evidence will help to drive rapid evolution of the method and software. However, the current version is already sufficiently well-developed to aid environmental science and management.
    Original languageEnglish
    Title of host publicationSustaining our Future: understanding and living with uncertainty, MODSIM2011
    EditorsF Chan, D Marinova, R S Anderssen
    Place of PublicationAustralia
    PublisherModelling and Simulation Society of Australia and New Zealand
    Pages2472-2478
    Number of pages7
    ISBN (Print)9780987214317
    Publication statusPublished - 2011
    Event19th International Congress on Modelling and Simulation: MODSIM 2011 - Perth, Perth, Australia
    Duration: 12 Dec 201116 Dec 2011
    http://mssanz.org.au/modsim2011/index.htm (Conference Link)

    Conference

    Conference19th International Congress on Modelling and Simulation
    Abbreviated titleMODSIM 2011
    CountryAustralia
    CityPerth
    Period12/12/1116/12/11
    Internet address

    Fingerprint

    environmental management
    decision making
    software
    transparency
    tool use
    analysis
    baseflow
    river channel
    literature review
    repository
    decision
    environmental science
    vegetation
    method
    experiment

    Cite this

    Webb, J., Wealands, S., Lea, P., Nichols, S., De Little, S., Stewardson, M., & Norris, R. (2011). Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management. In F. Chan, D. Marinova, & R. S. Anderssen (Eds.), Sustaining our Future: understanding and living with uncertainty, MODSIM2011 (pp. 2472-2478). Australia: Modelling and Simulation Society of Australia and New Zealand.
    Webb, J. ; Wealands, Stephen ; Lea, P ; Nichols, Susan ; De Little, Siobhan ; Stewardson, Michael ; Norris, Richard. / Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management. Sustaining our Future: understanding and living with uncertainty, MODSIM2011. editor / F Chan ; D Marinova ; R S Anderssen. Australia : Modelling and Simulation Society of Australia and New Zealand, 2011. pp. 2472-2478
    @inproceedings{fb659c38ac894d9f9508a00a71997d72,
    title = "Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management.",
    abstract = "In the face of increasing human-induced pressures on natural environments, managers must balance the needs of environmental and human uses in a transparent and defensible manner. Sound decision making in environmental management relies on understanding causal relationships between environmental stressors and ecological responses. However, causal relations are difficult to demonstrate in natural environments because of the difficulty of performing experiments, natural variability, lack of replication, and the presence of confounding influences. Partly because of this, most environmental management decisions are made using expert opinion. Such decisions can lack transparency. Epidemiologists recognized similar difficulties in ascribing causality in the 1960s, and developed {\^a}¿¿causal criteria{\^a}¿¿ to assess causal relations in epidemiological investigations. Causal criteria analysis builds a case for causality based on the cumulative strength of many individually weak pieces of evidence. There have been several calls to use causal criteria analysis in environmental science, but few case studies exist. This may partly result from the lack of standardized methods and analysis tools (analogous to statistical software). We describe the Eco Evidence software package, which has been developed to facilitate causal criteria analysis in environmental science. It employs the published scientific literature as a previously underused source of evidence for such analyses. The software consists of a web database application {\^a}¿¿ the Eco Evidence Database {\^a}¿¿ for storing and sharing {\^a}¿¿evidence items{\^a}¿¿ (the information extracted from individual studies necessary for the causal criteria analysis); and a desktop analysis tool {\^a}¿¿ the Eco Evidence Analyser {\^a}¿¿ that uses evidence shared via the web application to assess causal hypotheses. The database provides a permanent, online repository for causal evidence, accessible with any web browser. Moreover, it allows users to access evidence items entered by previous users, thereby reducing the burden of extracting evidence from the literature. The analysis tool uses a wizard-style interface to guide users through an 8-step standardized approach to causal criteria analysis specifically designed for use in the environmental sciences. A full report is produced at the end of the assessment, which contains all the information used to reach the conclusion. This maximizes transparency of the assessment, and means that any bias in the review will be detected more easily compared to a traditional literature review. We demonstrate the Eco Evidence approach with an example that investigates the evidence for the question of whether increased base flows and increased frequency of high flow events can reduce the encroachment of terrestrial vegetation into the channels of regulated rivers. Legislative and social imperatives are prompting a move from an experience-based to an evidence-based model of environmental management. This will lead to more transparent and repeatable decisions, and potentially better decisions overall. However, such a major change of practice will not be easily achieved. Tools such as Eco Evidence will facilitate the transformation by assisting managers to use scientific evidence to inform difficult decisions. With the Eco Evidence software now publicly released and freely available, we are turning our attention to facilitating uptake of the method through promotion and training. We expect that early adopters of Eco Evidence will help to drive rapid evolution of the method and software. However, the current version is already sufficiently well-developed to aid environmental science and management.",
    keywords = "Systematic review, Database, Analysis software, Causal Criteria Analysis, Decision making",
    author = "J. Webb and Stephen Wealands and P Lea and Susan Nichols and {De Little}, Siobhan and Michael Stewardson and Richard Norris",
    year = "2011",
    language = "English",
    isbn = "9780987214317",
    pages = "2472--2478",
    editor = "F Chan and D Marinova and Anderssen, {R S}",
    booktitle = "Sustaining our Future: understanding and living with uncertainty, MODSIM2011",
    publisher = "Modelling and Simulation Society of Australia and New Zealand",

    }

    Webb, J, Wealands, S, Lea, P, Nichols, S, De Little, S, Stewardson, M & Norris, R 2011, Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management. in F Chan, D Marinova & RS Anderssen (eds), Sustaining our Future: understanding and living with uncertainty, MODSIM2011. Modelling and Simulation Society of Australia and New Zealand, Australia, pp. 2472-2478, 19th International Congress on Modelling and Simulation, Perth, Australia, 12/12/11.

    Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management. / Webb, J.; Wealands, Stephen; Lea, P; Nichols, Susan; De Little, Siobhan; Stewardson, Michael; Norris, Richard.

    Sustaining our Future: understanding and living with uncertainty, MODSIM2011. ed. / F Chan; D Marinova; R S Anderssen. Australia : Modelling and Simulation Society of Australia and New Zealand, 2011. p. 2472-2478.

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    TY - GEN

    T1 - Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management.

    AU - Webb, J.

    AU - Wealands, Stephen

    AU - Lea, P

    AU - Nichols, Susan

    AU - De Little, Siobhan

    AU - Stewardson, Michael

    AU - Norris, Richard

    PY - 2011

    Y1 - 2011

    N2 - In the face of increasing human-induced pressures on natural environments, managers must balance the needs of environmental and human uses in a transparent and defensible manner. Sound decision making in environmental management relies on understanding causal relationships between environmental stressors and ecological responses. However, causal relations are difficult to demonstrate in natural environments because of the difficulty of performing experiments, natural variability, lack of replication, and the presence of confounding influences. Partly because of this, most environmental management decisions are made using expert opinion. Such decisions can lack transparency. Epidemiologists recognized similar difficulties in ascribing causality in the 1960s, and developed â¿¿causal criteriaâ¿¿ to assess causal relations in epidemiological investigations. Causal criteria analysis builds a case for causality based on the cumulative strength of many individually weak pieces of evidence. There have been several calls to use causal criteria analysis in environmental science, but few case studies exist. This may partly result from the lack of standardized methods and analysis tools (analogous to statistical software). We describe the Eco Evidence software package, which has been developed to facilitate causal criteria analysis in environmental science. It employs the published scientific literature as a previously underused source of evidence for such analyses. The software consists of a web database application â¿¿ the Eco Evidence Database â¿¿ for storing and sharing â¿¿evidence itemsâ¿¿ (the information extracted from individual studies necessary for the causal criteria analysis); and a desktop analysis tool â¿¿ the Eco Evidence Analyser â¿¿ that uses evidence shared via the web application to assess causal hypotheses. The database provides a permanent, online repository for causal evidence, accessible with any web browser. Moreover, it allows users to access evidence items entered by previous users, thereby reducing the burden of extracting evidence from the literature. The analysis tool uses a wizard-style interface to guide users through an 8-step standardized approach to causal criteria analysis specifically designed for use in the environmental sciences. A full report is produced at the end of the assessment, which contains all the information used to reach the conclusion. This maximizes transparency of the assessment, and means that any bias in the review will be detected more easily compared to a traditional literature review. We demonstrate the Eco Evidence approach with an example that investigates the evidence for the question of whether increased base flows and increased frequency of high flow events can reduce the encroachment of terrestrial vegetation into the channels of regulated rivers. Legislative and social imperatives are prompting a move from an experience-based to an evidence-based model of environmental management. This will lead to more transparent and repeatable decisions, and potentially better decisions overall. However, such a major change of practice will not be easily achieved. Tools such as Eco Evidence will facilitate the transformation by assisting managers to use scientific evidence to inform difficult decisions. With the Eco Evidence software now publicly released and freely available, we are turning our attention to facilitating uptake of the method through promotion and training. We expect that early adopters of Eco Evidence will help to drive rapid evolution of the method and software. However, the current version is already sufficiently well-developed to aid environmental science and management.

    AB - In the face of increasing human-induced pressures on natural environments, managers must balance the needs of environmental and human uses in a transparent and defensible manner. Sound decision making in environmental management relies on understanding causal relationships between environmental stressors and ecological responses. However, causal relations are difficult to demonstrate in natural environments because of the difficulty of performing experiments, natural variability, lack of replication, and the presence of confounding influences. Partly because of this, most environmental management decisions are made using expert opinion. Such decisions can lack transparency. Epidemiologists recognized similar difficulties in ascribing causality in the 1960s, and developed â¿¿causal criteriaâ¿¿ to assess causal relations in epidemiological investigations. Causal criteria analysis builds a case for causality based on the cumulative strength of many individually weak pieces of evidence. There have been several calls to use causal criteria analysis in environmental science, but few case studies exist. This may partly result from the lack of standardized methods and analysis tools (analogous to statistical software). We describe the Eco Evidence software package, which has been developed to facilitate causal criteria analysis in environmental science. It employs the published scientific literature as a previously underused source of evidence for such analyses. The software consists of a web database application â¿¿ the Eco Evidence Database â¿¿ for storing and sharing â¿¿evidence itemsâ¿¿ (the information extracted from individual studies necessary for the causal criteria analysis); and a desktop analysis tool â¿¿ the Eco Evidence Analyser â¿¿ that uses evidence shared via the web application to assess causal hypotheses. The database provides a permanent, online repository for causal evidence, accessible with any web browser. Moreover, it allows users to access evidence items entered by previous users, thereby reducing the burden of extracting evidence from the literature. The analysis tool uses a wizard-style interface to guide users through an 8-step standardized approach to causal criteria analysis specifically designed for use in the environmental sciences. A full report is produced at the end of the assessment, which contains all the information used to reach the conclusion. This maximizes transparency of the assessment, and means that any bias in the review will be detected more easily compared to a traditional literature review. We demonstrate the Eco Evidence approach with an example that investigates the evidence for the question of whether increased base flows and increased frequency of high flow events can reduce the encroachment of terrestrial vegetation into the channels of regulated rivers. Legislative and social imperatives are prompting a move from an experience-based to an evidence-based model of environmental management. This will lead to more transparent and repeatable decisions, and potentially better decisions overall. However, such a major change of practice will not be easily achieved. Tools such as Eco Evidence will facilitate the transformation by assisting managers to use scientific evidence to inform difficult decisions. With the Eco Evidence software now publicly released and freely available, we are turning our attention to facilitating uptake of the method through promotion and training. We expect that early adopters of Eco Evidence will help to drive rapid evolution of the method and software. However, the current version is already sufficiently well-developed to aid environmental science and management.

    KW - Systematic review

    KW - Database

    KW - Analysis software

    KW - Causal Criteria Analysis

    KW - Decision making

    M3 - Conference contribution

    SN - 9780987214317

    SP - 2472

    EP - 2478

    BT - Sustaining our Future: understanding and living with uncertainty, MODSIM2011

    A2 - Chan, F

    A2 - Marinova, D

    A2 - Anderssen, R S

    PB - Modelling and Simulation Society of Australia and New Zealand

    CY - Australia

    ER -

    Webb J, Wealands S, Lea P, Nichols S, De Little S, Stewardson M et al. Eco Evidence: using the scientific literature to inform evidence-based decision making in environmental management. In Chan F, Marinova D, Anderssen RS, editors, Sustaining our Future: understanding and living with uncertainty, MODSIM2011. Australia: Modelling and Simulation Society of Australia and New Zealand. 2011. p. 2472-2478