Long-term visual localization in large scale urban environments exploiting street level imagery
Loading...
Author (Corporation)
Publication date
2020
Typ of student thesis
Course of study
Collections
Type
01A - Journal article
Editors
Editor (Corporation)
Supervisor
Parent work
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Special issue
DOI of the original publication
Link
Series
Series number
Volume
V-2-2020
Issue / Number
Pages / Duration
Patent number
Publisher / Publishing institution
Copernicus
Place of publication / Event location
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
In this paper, we present our approach for robust long-term visual localization in large scale urban environments exploiting street level imagery. Our approach consists of a 2D-image based localization using image retrieval (NetVLAD) to select reference images. This is followed by a 3D-structure based localization with a robust image matcher (DenseSfM) for accurate pose estimation. This visual localization approach is evaluated by means of the ‘Sun’ subset of the RobotCar seasons dataset, which is part of the Visual Localization benchmark. As the results on the RobotCar benchmark dataset are nearly on par with the top ranked approaches, we focused our investigations on reproducibility and performance with own data. For this purpose, we created a dataset with street-level imagery. In order to have independent reference and query images, we used a road-based and a tram-based mapping campaign with a time difference of four years. The approximately 90% successfully oriented images of both datasets are a good indicator for the robustness of our approach. With about 50% success rate, every second image could be localized with a position accuracy better than 0.25 m and a rotation accuracy better than 2°.
Keywords
Ubiquitous positioning, Visual localization, Image-based localization, Long-term matching, Image orientation, Pose estimation, Benchmark, Georeferencing
Subject (DDC)
Event
Exhibition start date
Exhibition end date
Conference start date
Conference end date
Date of the last check
ISBN
ISSN
2194-9050
2194-9042
2194-9042
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Published
Review
Peer review of the complete publication
Open access category
Gold
License
Citation
Meyer, J., Rettenmund, D., & Nebiker, S. (2020). Long-term visual localization in large scale urban environments exploiting street level imagery. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2-2020. https://doi.org/10.5194/isprs-annals-v-2-2020-57-2020