Nebiker, Stephan
E-Mail-Adresse
Geburtsdatum
Suchergebnisse
Outdoor mobile mapping and AI-based 3D object detection with low-cost RGB-D cameras. The use case of on-street parking statistics
A successful application of low-cost 3D cameras in combination with artificial intelligence (AI)-based 3D object detection algorithms to outdoor mobile mapping would offer great potential for numerous mapping, asset inventory, and change detection tasks in the context of smart cities. This paper presents a mobile mapping system mounted on an electric tricycle and a procedure for creating on-street parking statistics, which allow government agencies and policy makers to verify and adjust parking policies in different city districts. Our method combines georeferenced red-green-blue-depth (RGB-D) imagery from two low-cost 3D cameras with state-of-the-art 3D object detection algorithms for extracting and mapping parked vehicles. Our investigations demonstrate the suitability of the latest generation of low-cost 3D cameras for real-world outdoor applications with respect to supported ranges, depth measurement accuracy, and robustness under varying lighting conditions. In an evaluation of suitable algorithms for detecting vehicles in the noisy and often incomplete 3D point clouds from RGB-D cameras, the 3D object detection network PointRCNN, which extends region-based convolutional neural networks (R-CNNs) to 3D point clouds, clearly outperformed all other candidates. The results of a mapping mission with 313 parking spaces show that our method is capable of reliably detecting parked cars with a precision of 100% and a recall of 97%. It can be applied to unslotted and slotted parking and different parking types including parallel, perpendicular, and angle parking.
Vom physischen Stadtmodell zum interaktiven 3D-GIS - Anforderungen und Lösungsansätze am Beispiel der historischen Stadt Solothurn
Evaluating the effectiveness of representing numeric information through abstract graphics in 3D desktop virtual environments
Cloud-Based Geospatial 3D Image Spaces—A Powerful Urban Model for the Smart City
In this paper, we introduce the concept and an implementation of geospatial 3D image spaces as new type of native urban models. 3D image spaces are based on collections of georeferenced RGB-D imagery. This imagery is typically acquired using multi-view stereo mobile mapping systems capturing dense sequences of street level imagery. Ideally, image depth information is derived using dense image matching. This delivers a very dense depth representation and ensures the spatial and temporal coherence of radiometric and depth data. This results in a high-definition WYSIWYG (“what you see is what you get”) urban model, which is intuitive to interpret and easy to interact with, and which provides powerful augmentation and 3D measuring capabilities. Furthermore, we present a scalable cloud-based framework for generating 3D image spaces of entire cities or states and a client architecture for their web-based exploitation. The model and the framework strongly support the smart city notion of efficiently connecting the urban environment and its processes with experts and citizens alike. In the paper we particularly investigate quality aspects of the urban model, namely the obtainable georeferencing accuracy and the quality of the depth map extraction. We show that our image-based georeferencing approach is capable of improving the original direct georeferencing accuracy by an order of magnitude and that the presented new multi-image matching approach is capable of providing high accuracies along with a significantly improved completeness of the depth maps.
From Historical City Models to Interactive 3D GIS Requirements and Approaches Using the Example of the City of Solothurn
Visualisation of Complex 3D City Models on Mobile Webbrowsers Using Cloud-Based Image Provisioning
Rendering large city models with high polygon count and a vast amount of textures at interactive frame rates is a rather difficult to impossible task as it highly depends on the client hardware, which is often insufficient, even if out-of-core rendering techniques and level of detail approaches are used. Rendering complex city models on mobile devices is even more challenging. An approach of rendering and caching very large city models in the cloud using ray-tracing based image provisioning is introduced. This allows rendering large scenes efficiently, including on mobile devices. With this approach, it is possible to render cities with nearly unlimited number of polygons and textures.