CLEF 2017 eHealth evaluation lab overview

Lorraine Goeuriot, Liadh Kelly, Hanna Suominen, Aurélie Névéol, Aude Robert, Evangelos Kanoulas, Rene Spijker, João Palotti, Guido Zuccon

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    41 Citations (Scopus)

    Abstract

    In this paper we provide an overview of the fifth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French corpora, Task 2 on technologically assisted reviews in empirical medicine as a new pilot task, and Task 3 on patient-centered information retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We also continued the replication track from 2016. Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

    Original languageEnglish
    Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction
    Subtitle of host publication8th International Conference of the CLEF Association, CLEF 2017, Proceedings
    PublisherSpringer-Verlag London Ltd.
    Pages291-303
    Number of pages13
    ISBN (Electronic)9783319658131
    ISBN (Print)9783319658124
    DOIs
    Publication statusPublished - 11 Sep 2017
    Event8th International Conference of the CLEF Association, CLEF 2017 - Dublin, Ireland
    Duration: 11 Sep 201714 Sep 2017

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume10456 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference8th International Conference of the CLEF Association, CLEF 2017
    CountryIreland
    CityDublin
    Period11/09/1714/09/17

    Fingerprint

    Information retrieval
    Information Retrieval
    Evaluation
    Medicine
    Resources
    Authoring
    Information Extraction
    Health
    Research and Development
    Replication
    Continue
    Methodology

    Cite this

    Goeuriot, L., Kelly, L., Suominen, H., Névéol, A., Robert, A., Kanoulas, E., ... Zuccon, G. (2017). CLEF 2017 eHealth evaluation lab overview. In Experimental IR Meets Multilinguality, Multimodality, and Interaction : 8th International Conference of the CLEF Association, CLEF 2017, Proceedings (pp. 291-303). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10456 LNCS). Springer-Verlag London Ltd.. https://doi.org/10.1007/978-3-319-65813-1_26
    Goeuriot, Lorraine ; Kelly, Liadh ; Suominen, Hanna ; Névéol, Aurélie ; Robert, Aude ; Kanoulas, Evangelos ; Spijker, Rene ; Palotti, João ; Zuccon, Guido. / CLEF 2017 eHealth evaluation lab overview. Experimental IR Meets Multilinguality, Multimodality, and Interaction : 8th International Conference of the CLEF Association, CLEF 2017, Proceedings. Springer-Verlag London Ltd., 2017. pp. 291-303 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{7857ffa2dddc4b178caa4937ab5ae2e2,
    title = "CLEF 2017 eHealth evaluation lab overview",
    abstract = "In this paper we provide an overview of the fifth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French corpora, Task 2 on technologically assisted reviews in empirical medicine as a new pilot task, and Task 3 on patient-centered information retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We also continued the replication track from 2016. Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.",
    keywords = "Entity linking, Evaluation, Health records, Information extraction, Information retrieval, Medical informatics, Self-diagnosis, Systematic reviews, Test-set generation, Text classification, Text segmentation",
    author = "Lorraine Goeuriot and Liadh Kelly and Hanna Suominen and Aur{\'e}lie N{\'e}v{\'e}ol and Aude Robert and Evangelos Kanoulas and Rene Spijker and Jo{\~a}o Palotti and Guido Zuccon",
    year = "2017",
    month = "9",
    day = "11",
    doi = "10.1007/978-3-319-65813-1_26",
    language = "English",
    isbn = "9783319658124",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer-Verlag London Ltd.",
    pages = "291--303",
    booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction",

    }

    Goeuriot, L, Kelly, L, Suominen, H, Névéol, A, Robert, A, Kanoulas, E, Spijker, R, Palotti, J & Zuccon, G 2017, CLEF 2017 eHealth evaluation lab overview. in Experimental IR Meets Multilinguality, Multimodality, and Interaction : 8th International Conference of the CLEF Association, CLEF 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10456 LNCS, Springer-Verlag London Ltd., pp. 291-303, 8th International Conference of the CLEF Association, CLEF 2017, Dublin, Ireland, 11/09/17. https://doi.org/10.1007/978-3-319-65813-1_26

    CLEF 2017 eHealth evaluation lab overview. / Goeuriot, Lorraine; Kelly, Liadh; Suominen, Hanna; Névéol, Aurélie; Robert, Aude; Kanoulas, Evangelos; Spijker, Rene; Palotti, João; Zuccon, Guido.

    Experimental IR Meets Multilinguality, Multimodality, and Interaction : 8th International Conference of the CLEF Association, CLEF 2017, Proceedings. Springer-Verlag London Ltd., 2017. p. 291-303 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10456 LNCS).

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    TY - GEN

    T1 - CLEF 2017 eHealth evaluation lab overview

    AU - Goeuriot, Lorraine

    AU - Kelly, Liadh

    AU - Suominen, Hanna

    AU - Névéol, Aurélie

    AU - Robert, Aude

    AU - Kanoulas, Evangelos

    AU - Spijker, Rene

    AU - Palotti, João

    AU - Zuccon, Guido

    PY - 2017/9/11

    Y1 - 2017/9/11

    N2 - In this paper we provide an overview of the fifth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French corpora, Task 2 on technologically assisted reviews in empirical medicine as a new pilot task, and Task 3 on patient-centered information retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We also continued the replication track from 2016. Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

    AB - In this paper we provide an overview of the fifth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French corpora, Task 2 on technologically assisted reviews in empirical medicine as a new pilot task, and Task 3 on patient-centered information retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We also continued the replication track from 2016. Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

    KW - Entity linking

    KW - Evaluation

    KW - Health records

    KW - Information extraction

    KW - Information retrieval

    KW - Medical informatics

    KW - Self-diagnosis

    KW - Systematic reviews

    KW - Test-set generation

    KW - Text classification

    KW - Text segmentation

    UR - http://www.scopus.com/inward/record.url?scp=85029423658&partnerID=8YFLogxK

    UR - http://www.mendeley.com/research/clef-2017-ehealth-evaluation-lab-overview-bt-8th-international-conference-clef-association-clef-2017

    U2 - 10.1007/978-3-319-65813-1_26

    DO - 10.1007/978-3-319-65813-1_26

    M3 - Conference contribution

    SN - 9783319658124

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 291

    EP - 303

    BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction

    PB - Springer-Verlag London Ltd.

    ER -

    Goeuriot L, Kelly L, Suominen H, Névéol A, Robert A, Kanoulas E et al. CLEF 2017 eHealth evaluation lab overview. In Experimental IR Meets Multilinguality, Multimodality, and Interaction : 8th International Conference of the CLEF Association, CLEF 2017, Proceedings. Springer-Verlag London Ltd. 2017. p. 291-303. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-65813-1_26