MURAL - Maynooth University Research Archive Library



    Fusion of camera images and laser scans for wide baseline 3D scene alignment in urban environments


    Yang, Michael Ying, Cao, Yanpeng and McDonald, John (2011) Fusion of camera images and laser scans for wide baseline 3D scene alignment in urban environments. ISPRS Journal of Photogrammetry and Remote Sensing, 66 (6 Supp). S52-S61. ISSN 0924-2716

    [thumbnail of McDonaldJ_Fusion_2011.pdf]
    Preview
    Text
    McDonaldJ_Fusion_2011.pdf

    Download (1MB) | Preview

    Abstract

    In this paper we address the problem of automatic laser scan registration in urban environments. This represents a challenging problem for two major reasons. First, two individual laser scans might be captured at significantly changed viewpoints (wide baseline) and have very little overlap. Second, man-made buildings usually contain many structures of similar appearances. This will result in considerable aliasing in the matching process. By sensor fusion of laser data with camera images, we propose a novel improvement to the existing 2D feature techniques to enable automatic 3D alignment between two widely separated scans. The key idea consists of extracting dominant planar structures from 3D point clouds and then utilizing the recovered 3D geometry to improve the performance of 2D image feature for wide baseline matching. The resulting feature descriptors become more robust to camera viewpoint changes after the procedure of viewpoint normalization. Moreover, the viewpoint normalized 2D features provide robust local feature information including patch scale and dominant orientation for effective repetitive structure matching in man-made environments. Comprehensive experimental evaluations with real data demonstrate the potential of the proposed method for automatic wide baseline 3D scan alignment in urban environments.
    Item Type: Article
    Keywords: Senor fusion; Terrestrial laser scan; Wide baseline alignment; Viewpoint invariant feature; Plane extraction; Feature extraction;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 12373
    Identification Number: 10.1016/j.isprsjprs.2011.09.004
    Depositing User: John McDonald
    Date Deposited: 06 Feb 2020 10:51
    Journal or Publication Title: ISPRS Journal of Photogrammetry and Remote Sensing
    Publisher: Elsevier
    Refereed: Yes
    Related URLs:
    URI: https://mu.eprints-hosting.org/id/eprint/12373
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads