Processing point clouds

Measuring large structures, such as physical infrastructure, generates large amounts of data. We use artificial intelligence (AI) methods to process the data generated by laser scanners and cameras so it can be used for applications such as building information modeling (BIM) or augmented reality (AR).

Data reduction and interpretation using AI is a prerequisite for geometric modeling

Point clouds are the most common data format in 3D surveying of surroundings, but they need to be pre-processed. We apply different data reduction and data interpretation strategies to process geometric measurement data for BIM and AR applications. To detect and localize relevant objects within the measurement data, semantic understanding of point clouds and image data is necessary. To this end, we’re developing artificial neural networks (ANNs) for specific interpretation tasks, such as interior spaces or certain types of physical infrastructure, such as bridges and façades. The resulting semantic understanding gives us further insights and allows us to restrict the captured scene to its main components. This provides the basis for geometric modeling of a large amount of 3D data.

Powerful hardware for training neural networks

Training neural networks requires powerful hardware to provide the vast memory required for processing large point clouds. We have powerful servers for training neural networks that allow us to perform parallel computing and process very large neural networks.

Colorized point cloud of an interior space
© Fraunhofer IPM
Colorized point cloud of an interior space
Measurement data of an office space, captured with a laser scanner and a camera: The point cloud generated by the laser scanner is fused with the camera data, providing it with color information for clear visualization.
Segmented point cloud of an interior space
© Fraunhofer IPM
Segmented point cloud of an interior space
A specially trained artificial neural network (ANN) automatically performs the semantic segmentation of the point cloud. The room ceiling (gray here) is also detected during semantic segmentation, but can be hidden when it comes to analyzing the image of the room’s interior in detail.
Segmented point cloud of an indoor space without ceiling
Segmented point cloud of an interior space without ceiling
Defined colors are assigned to individual object classes (here, for example: turquoise = wall, light green = door leaf, dark green = window, pastel grey-green = floor, blue = undefined objects such as furniture, people, plants, etc.)
Geometric modeling of an interior space
© Fraunhofer IPM
Geometric modeling of an interior space
The point cloud is reduced to a geometric model with a low data volume outlining the wall, ceiling and floor surfaces. The model can be used to calculate surface dimensions and spatial volumes.

Publications

Jahr
Year
Titel/Autor:in
Title/Author
Publikationstyp
Publication Type
2024 Scan2BIM - A Review on the Automated Creation of Semantic-Aware Geometric as-is Models of Bridges
Kellner, Maximilian; Vassilev, Hristo; Busch, Antonia; Blaskow, Robert; Ferrandon Cervantes, Mariana; Poku-Agyemang, Kwasi Nyarko; Schmitt, Annette; Weisbrich, Sven; Maas, Hans-Gerd; Neitzel, Frank; Reiterer, Alexander; Blankenbach, Jörg
Zeitschriftenaufsatz
Journal Article
2023 Reconstructing Geometrical Models of Indoor Environments Based on Point Clouds
Kellner, Maximilian; Stahl, Bastian; Reiterer, Alexander
Zeitschriftenaufsatz
Journal Article
2023 Modellierung von Gebäuden für Open- und Closed-BIM mithilfe von KI - erste Konzepte und Ergebnisse des Projekts Kit-CAD
Busert, Sarah; Negassi, Misgana; Scheuerer, Alexander; Müller, Christoph; Reiterer, Alexander
Zeitschriftenaufsatz
Journal Article
2023 Creating 3D Models of Bridges Using Different Data Sources and Machine Learning Methods
Poku-Agyemang, Kwasi Nyarko; Kellner, Maximilian; Schmitt, Annette; Reiterer, Alexander
Konferenzbeitrag
Conference Paper
Diese Liste ist ein Auszug aus der Publikationsplattform Fraunhofer-Publica

This list has been generated from the publication platform Fraunhofer-Publica