MURAL - Maynooth University Research Archive Library



    Ghost Towns: Semantically Labelled Object Removal From Video


    Clifford, William and Markham, Charles (2019) Ghost Towns: Semantically Labelled Object Removal From Video. In: IMVIP 2019: Irish Machine Vision and Image Processing, 28-30 August 2019, Technological University Dublin.

    [thumbnail of WC_ghost towns.pdf]
    Preview
    Text
    WC_ghost towns.pdf

    Download (4MB) | Preview

    Abstract

    This paper describes a method used to produce a video of a road in which the foreground items which obstruct the view of the road have been removed i.e. other vehicles. Once these regions have been identified they are replaced using suitable images that closely resemble the original background. The work considers an approach that uses multiple video sequences of the same road (C1...Cn). One video is identified as video Cp , that requires the least repair. All instances of vehicles in each frame of video were identified using a Convolutional Neural Network (CNN). The regions associated with each vehicle were then filled using suitable regions from the frames from the remaining streams (assuming at least one of these streams has a background region visible which matches our query region in Cp ). To match frames and locate suitable patches ideally the video sequences need to be aligned both temporally and structurally. To match the frames temporally a bag of visual words approach was taken. To align the frames structurally a template search was performed on regions surrounding the region to be replaced. Given the template matches, the region between these templates in the matching frame were used to fill where the vehicles were previously, leaving behind only the background.
    Item Type: Conference or Workshop Item (Paper)
    Keywords: Imaging; Image Processing; Machine Vision; Driving Simulation; Video;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 14360
    Depositing User: Dr. Charles Markham
    Date Deposited: 21 Apr 2021 13:49
    Refereed: Yes
    URI: https://mu.eprints-hosting.org/id/eprint/14360
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads