Suominen, Hanna, Kelly, Liadh, Goeuriot, Lorraine, Neveol, Aurelie, Ramadier, Lionel, Robert, Aude, Kanoulas, Evangelos, Spijker, Rene, Azzopardi, Leif, Li, Dan, Jimmy, Palotti, Joao and Zuccon, Guido (2018) Overview of the CLEF eHealth Evaluation Lab 2018. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction. Part of the Lecture Notes in Computer Science book series (LNCS) (11018). Springer, pp. 286-301. ISBN 9783319658131
Preview
LK_computer science_overview.pdf
Download (326kB) | Preview
Abstract
In this paper, we provide an overview of the sixth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2018 continues
our evaluation resource building efforts around the easing and support of
patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual
setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French and English
corpora to French, Hungarian, and Italian; Task 2 on technologically
assisted reviews in empirical medicine building on last year’s pilot task in English; and Task 3 on Consumer Health Search (CHS) in mono- and
multilingual settings that builds on the 2013–17 Information Retrieval
tasks. In total 28 teams took part in these tasks (14 in Task 1, 7 in Task
2 and 7 in Task 3). Herein, we describe the resources created for these
tasks, outline our evaluation methodology adopted and provide a brief
summary of participants of this year’s challenges and results obtained.
As in previous years, the organizers have made data and tools associated
with the lab tasks available for future research and development.
Item Type: | Book Section |
---|---|
Additional Information: | Cite as: Suominen H. et al. (2018) Overview of the CLEF eHealth Evaluation Lab 2018. In: Bellot P. et al. (eds) Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2018. Lecture Notes in Computer Science, vol 11018. Springer, Cham. https://doi-org.jproxy.nuim.ie/10.1007/978-3-319-98932-7_26 |
Keywords: | Evaluation; Entity linking; Information retrieval Health records; Information extraction; Medical informatics; Systematic reviews; Total recall; Test-set generation; Text classification; Text segmentation; Self-diagnosis; |
Academic Unit: | Faculty of Science and Engineering > Computer Science Faculty of Science and Engineering > Research Institutes > Hamilton Institute Faculty of Science and Engineering > Research Institutes > Human Health Institute |
Item ID: | 13394 |
Identification Number: | 10.1007/978-3-319-98932-7_26 |
Depositing User: | Liadh Kelly |
Date Deposited: | 05 Oct 2020 14:45 |
Publisher: | Springer |
Refereed: | Yes |
Related URLs: | |
URI: | https://mu.eprints-hosting.org/id/eprint/13394 |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only (login required)
Downloads
Downloads per month over past year