Authors:
Joakim Bruslund Haurum
;
Moaaz M. J. Allahham
;
Mathias S. Lynge
;
Kasper Schøn Henriksen
;
Ivan A. Nikolov
and
Thomas B. Moeslund
Affiliation:
Visual Analysis of People (VAP) Laboratory, Aalborg University, Rendsburggade 14, Aalborg, Denmark
Keyword(s):
3D Deep Learning, Defect Classification, Synthetic Data, Sewers, Point Clouds, Transfer Learning.
Abstract:
Sewer pipes are currently manually inspected by trained inspectors, making the process prone to human errors, which can be potentially critical. There is therefore a great research and industry interest in automating the sewer inspection process. Previous research have been focused on working with 2D image data, similar to how inspections are currently conducted. There is, however, a clear potential for utilizing recent advances within 3D computer vision for this task. In this paper we investigate the feasibility of applying two modern deep learning methods, DGCNN and PointNet, on a new publicly available sewer point cloud dataset. As point cloud data from real sewers is scarce, we investigate using synthetic data to bootstrap the training process. We investigate four data scenarios, and find that training on synthetic data and fine-tune on real data gives the best results, increasing the metrics by 6-10 percentage points for the best model. Data and code is available at https://bitb
ucket.org/aauvap/sewer3dclassification.
(More)