Task 1: ShARe/CLEF eHealth evaluation lab 2013

Sameer Pradhan; Noemie Elhadad; Brett R. South; David Martinez; Lee Christensen; Amy Vogel; Hanna Suominen; Wendy W. Chapman; Guergana Savova

Task 1: ShARe/CLEF eHealth evaluation lab 2013

Sameer Pradhan, Noemie Elhadad, Brett R. South, David Martinez, Lee Christensen, Amy Vogel, Hanna Suominen, Wendy W. Chapman, Guergana Savova

Research output: Contribution to conference (non-published works) › Other › peer-review

28 Citations (Scopus)

Abstract

This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and evaluation tools available for future research and development.

Original language	English
Pages	1-6
Number of pages	1
Publication status	Published - 23 Sept 2013
Externally published	Yes
Event	CLEF 2013 Conference - Working notes - Valencia, Valencia, Spain Duration: 23 Sept 2013 → 26 Sept 2013 http://ceur-ws.org/Vol-1179/

Other

Other	CLEF 2013 Conference - Working notes
Country/Territory	Spain
City	Valencia
Period	23/09/13 → 26/09/13
Internet address	http://ceur-ws.org/Vol-1179/

Cite this

@conference{6bc6c3aecff94355b5bbb77b5d7ae20e,

title = "Task 1: ShARe/CLEF eHealth evaluation lab 2013",

abstract = "This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and evaluation tools available for future research and development.",

keywords = "Medical informatics, Natural language processing, Reference standard generation, Text normalization",

author = "Sameer Pradhan and Noemie Elhadad and South, {Brett R.} and David Martinez and Lee Christensen and Amy Vogel and Hanna Suominen and Chapman, {Wendy W.} and Guergana Savova",

year = "2013",

month = sep,

day = "23",

language = "English",

pages = "1--6",

note = "CLEF 2013 Conference - Working notes ; Conference date: 23-09-2013 Through 26-09-2013",

url = "http://ceur-ws.org/Vol-1179/",

}

TY - CONF

T1 - Task 1

T2 - CLEF 2013 Conference - Working notes

AU - Pradhan, Sameer

AU - Elhadad, Noemie

AU - South, Brett R.

AU - Martinez, David

AU - Christensen, Lee

AU - Vogel, Amy

AU - Suominen, Hanna

AU - Chapman, Wendy W.

AU - Savova, Guergana

PY - 2013/9/23

Y1 - 2013/9/23

N2 - This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and evaluation tools available for future research and development.

AB - This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and evaluation tools available for future research and development.

KW - Medical informatics

KW - Natural language processing

KW - Reference standard generation

KW - Text normalization

UR - http://www.scopus.com/inward/record.url?scp=84922022518&partnerID=8YFLogxK

UR - http://clef2013.clef-initiative.eu/index.php

UR - http://ceur-ws.org/Vol-1179/

M3 - Other

AN - SCOPUS:84922022518

SP - 1

EP - 6

Y2 - 23 September 2013 through 26 September 2013

ER -

Task 1: ShARe/CLEF eHealth evaluation lab 2013

Abstract

Other

Other files and links

Fingerprint

Cite this