MURAL - Maynooth University Research Archive Library



    Consumer Health Search at CLEF eHealth 2021


    Goeuriot, Lorraine, Suominen, Hanna, Pasi, Gabriella, Bassani, Elias, Brew-Sam, Nicola, González-Sáez, Gabriela, Kelly, Liadh, Mulhem, Phillippe, Seneviratne, Sandaru, Upadhyay, Rishabh, Viviani, Marco and Xu, Chenchen (2021) Consumer Health Search at CLEF eHealth 2021. CEUR Workshop Proceedings. pp. 1-19. ISSN 1613-0073

    [thumbnail of LK_consumer health.pdf]
    Preview
    Text
    LK_consumer health.pdf

    Download (1MB) | Preview

    Abstract

    This paper details materials, methods, results, and analyses of the Consumer Health Search Task of the CLEF eHealth 2021 Evaluation Lab. This task investigates the effectiveness of information retrieval (IR) approaches in providing access to medical information to laypeople. For this a TREC-style evaluation methodology was applied: a shared collection of documents and queries is distributed, participants’ runs received, relevance assessments generated, and participants’ submissions evaluated. The task generated a new representative web corpus including web pages acquired from a 2021 CommonCrawl and social media content from Twitter and Reddit, along with a new collection of 55 manually generated layperson medical queries and their respective credibility, understandability, and topicality assessments for returned documents. This year’s task focused on three subtask: (i) ad-hoc IR, (ii) weakly supervised IR, and (iii) document credibility prediction. In total, 15 runs were submitted to the three subtasks: eight addressed the ad-hoc IR task, three the weakly supervised IR challenge, and 4 the document credibility prediction challenge. As in previous years, the organizers have made data and tools associated with the task available for future research and development.
    Item Type: Article
    Keywords: Dimensions of Relevance; eHealth; Evaluation; Health Records; Medical Informatics; Information Storage and Retrieval; Self-Diagnosis; Test-set Generation;
    Academic Unit: Assisting Living & Learning,ALL institute
    Faculty of Science and Engineering > Computer Science
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Faculty of Science and Engineering > Research Institutes > Human Health Institute
    Item ID: 15468
    Depositing User: Liadh Kelly
    Date Deposited: 09 Feb 2022 12:45
    Journal or Publication Title: CEUR Workshop Proceedings
    Publisher: CEUR
    Refereed: Yes
    Related URLs:
    URI: https://mu.eprints-hosting.org/id/eprint/15468
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads