CLEF 2017 eHealth evaluation lab overview

Lorraine Goeuriot, Liadh Kelly, Hanna Suominen, Aurélie Névéol, Aude Robert, Evangelos Kanoulas, Rene Spijker, João Palotti, Guido Zuccon

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    43 Citations (Scopus)

    Abstract

    In this paper we provide an overview of the fifth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French corpora, Task 2 on technologically assisted reviews in empirical medicine as a new pilot task, and Task 3 on patient-centered information retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We also continued the replication track from 2016. Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

    Original languageEnglish
    Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction
    Subtitle of host publication8th International Conference of the CLEF Association, CLEF 2017, Proceedings
    PublisherSpringer-Verlag London Ltd.
    Pages291-303
    Number of pages13
    ISBN (Electronic)9783319658131
    ISBN (Print)9783319658124
    DOIs
    Publication statusPublished - 11 Sep 2017
    Event8th International Conference of the CLEF Association, CLEF 2017 - Dublin, Ireland
    Duration: 11 Sep 201714 Sep 2017

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume10456 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference8th International Conference of the CLEF Association, CLEF 2017
    CountryIreland
    CityDublin
    Period11/09/1714/09/17

      Fingerprint

    Cite this

    Goeuriot, L., Kelly, L., Suominen, H., Névéol, A., Robert, A., Kanoulas, E., ... Zuccon, G. (2017). CLEF 2017 eHealth evaluation lab overview. In Experimental IR Meets Multilinguality, Multimodality, and Interaction : 8th International Conference of the CLEF Association, CLEF 2017, Proceedings (pp. 291-303). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10456 LNCS). Springer-Verlag London Ltd.. https://doi.org/10.1007/978-3-319-65813-1_26