Information extraction to improve standard compliance: The case of clinical handover

Liyuan Zhou, Hanna Suominen

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

1 Citation (Scopus)


Clinical handover refers to healthcare workers transferring responsibility and accountability for patient care, e.g., between shifts or wards. Safety and quality health standards call for this process to be systematically structured across the organisation and synchronous with its documentation. This paper evaluates information extraction as a way to help comply with these standards. It implements the handover process of first specifying a structured handover form, whose hierarchy of headings guides the handover narrative, followed by the technology filling it out objectively and almost instantly for proofing and sign-off. We trained a conditional random field with 8 feature types on 101 expert-annotated documents to 36-class classify. This resulted in good generalization to an independent set of 50 validation and 50 test documents that we now release: 77.9% F1 in filtering out irrelevant information, up to 98.4% F1 for the 35 classes for relevant information, and 52.9% F1 after macro-averaging over these 35 classes, whilst these percentages were 86.2, 100.0, and 70.2 for the leave-one-document-out cross-validation across the first set of 101 documents. Also as a result of this study, the validation and test data were released to support further research.

Original languageEnglish
Title of host publicationAI 2015, Advances in Artificial Intelligence
Subtitle of host publication28th Australasian Joint Conference Canberra, ACT, Australia, November 30 – December 4, 2015 Proceedings
EditorsBernhard Pfahringer, Jochen Renz
Place of PublicationCham, Switzerland
Number of pages6
ISBN (Electronic)9783319263502
ISBN (Print)9783319263496
Publication statusPublished - 2015
Event28th Australasian Joint Conference on Artificial Intelligence, AI 2015: Advances in Artificial Intelligence (AI 2015) - Canberra, Canberra, Australia
Duration: 30 Nov 20154 Dec 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)03029743
ISSN (Electronic)16113349


Conference28th Australasian Joint Conference on Artificial Intelligence, AI 2015
Abbreviated titleAI 2015


Dive into the research topics of 'Information extraction to improve standard compliance: The case of clinical handover'. Together they form a unique fingerprint.

Cite this