MURAL - Maynooth University Research Archive Library



    Overview of the CLEF 2018 Consumer Health Search Task


    Jimmy, Zuccon, Guido, Palotti, Joao, Goeuriot, Lorraine and Kelly, Liadh (2018) Overview of the CLEF 2018 Consumer Health Search Task. In: CLEF 2018 - Conference and Labs of the Evaluation Forum, 10-14 September 2018., Avignon, France.

    [thumbnail of LK_computer science_overview 2.pdf]
    Preview
    Text
    LK_computer science_overview 2.pdf

    Download (672kB) | Preview

    Abstract

    This paper details the collection, systems and evaluation methods used in the CLEF 2018 eHealth Evaluation Lab, Consumer Health Search (CHS) task (Task 3). This task investigates the effectiveness of search engines in providing access to medical information present on the Web for people that have no or little medical knowledge. The task aims to foster advances in the development of search technologies for Consumer Health Search by providing resources and evaluation methods to test and validate search systems. Built upon the the 2013-17 series of CLEF eHealth Information Retrieval tasks, the 2018 task considers both mono- and multilingual retrieval, embracing the Text REtrieval Conference (TREC) -style evaluation process with a shared collection of documents and queries, the contribution of runs from participants and the subsequent formation of relevance assessments and evaluation of the participants submissions. For this year, the CHS task uses a new Web corpus and a new set of queries compared to the previous years. The new corpus consists of Web pages acquired from the CommonCrawl and the new set of queries consists of 50 queries issued by the general public to the Health on the Net (HON) search services. We then manually translated the 50 queries to French, German, and Czech; and obtained English query variations of the 50 original queries. A total of 7 teams from 7 different countries participated in the 2018 CHS task: CUNI (Czech Republic), IMS Unipd (Italy), MIRACL (Tunisia), QUT (Australia), SINAI (Spain), UB-Botswana (Botswana), and UEvora (Portugal).
    Item Type: Conference or Workshop Item (Paper)
    Keywords: Evaluation; Consumer Health Search; Medical Information Retrieval;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Faculty of Science and Engineering > Research Institutes > Human Health Institute
    Item ID: 13395
    Depositing User: Liadh Kelly
    Date Deposited: 05 Oct 2020 15:04
    Refereed: Yes
    URI: https://mu.eprints-hosting.org/id/eprint/13395
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads