Jimmy, Zuccon, Guido, Palotti, Joao, Goeuriot, Lorraine and Kelly, Liadh (2018) Overview of the CLEF 2018 Consumer Health Search Task. In: CLEF 2018 - Conference and Labs of the Evaluation Forum, 10-14 September 2018., Avignon, France.
Preview
LK_computer science_overview 2.pdf
Download (672kB) | Preview
Abstract
This paper details the collection, systems and evaluation
methods used in the CLEF 2018 eHealth Evaluation Lab, Consumer
Health Search (CHS) task (Task 3). This task investigates the effectiveness of search engines in providing access to medical information present
on the Web for people that have no or little medical knowledge. The task
aims to foster advances in the development of search technologies for
Consumer Health Search by providing resources and evaluation methods
to test and validate search systems. Built upon the the 2013-17 series
of CLEF eHealth Information Retrieval tasks, the 2018 task considers
both mono- and multilingual retrieval, embracing the Text REtrieval
Conference (TREC) -style evaluation process with a shared collection of
documents and queries, the contribution of runs from participants and
the subsequent formation of relevance assessments and evaluation of the
participants submissions.
For this year, the CHS task uses a new Web corpus and a new set of
queries compared to the previous years. The new corpus consists of Web
pages acquired from the CommonCrawl and the new set of queries consists of 50 queries issued by the general public to the Health on the Net
(HON) search services. We then manually translated the 50 queries to
French, German, and Czech; and obtained English query variations of
the 50 original queries.
A total of 7 teams from 7 different countries participated in the 2018 CHS
task: CUNI (Czech Republic), IMS Unipd (Italy), MIRACL (Tunisia),
QUT (Australia), SINAI (Spain), UB-Botswana (Botswana), and UEvora
(Portugal).
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Keywords: | Evaluation; Consumer Health Search; Medical Information Retrieval; |
Academic Unit: | Faculty of Science and Engineering > Computer Science Faculty of Science and Engineering > Research Institutes > Hamilton Institute Faculty of Science and Engineering > Research Institutes > Human Health Institute |
Item ID: | 13395 |
Depositing User: | Liadh Kelly |
Date Deposited: | 05 Oct 2020 15:04 |
Refereed: | Yes |
URI: | https://mu.eprints-hosting.org/id/eprint/13395 |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only (login required)
Downloads
Downloads per month over past year