ON APPLICATIONS OF SEQUENTIAL MULTI-VIEW DENSE RECONSTRUCTION FROM AERIAL IMAGES

Dimitri Bulatov, Peter Wernerus, Hermann Gross

2012

Abstract

Because of an increasing need and a rapid progress in the development of (unmanned) aerial vehicles and optical sensors that can be mounted onboard of these sensor platforms, there is also a considerable progress in 3D analysis of air- and UAV-borne video sequences. This work presents a robust method for multi-camera dense reconstruction as well as two important applications: creation of dense point clouds with precise 3D coordinates and, in the case of videos with Nadir perspective, a context-based method for urban terrain modeling. This method, which represents the main contribution of this work, includes automatic generation of digital terrain models (DTM), extraction of building outlines, modeling and texturing roof surfaces. A simple interactive method for vegetation segmentation is described as well.

References

  1. Baillard, C. and Zisserman, A. (2000). A plane-sweep strategy for the 3D reconstruction of buildings from multiple images. ISPRS Congress and Exhibition in Amsterdam (Netherlands).
  2. Bodensteiner, C., Hebel, M., and Arens, M. (2010). Accurate single image multi-modal camera pose estimation. Workshop on Reconstruction and Modeling of Large-Scale 3D Virtual Environments. European Conference on Computer Vision (ECCV).
  3. Bulatov, D. (2008). Towards Euclidean reconstruction from video sequences. Int. Conf. Computer Vision Theory and Applications (2), pages 476-483.
  4. Bulatov, D. and Lavery, J. (2010). Reconstruction and texturing of 3D urban terrain from uncalibrated monocular images using L1 Splines. Photogrammetric Engineering and Remote Sensing, 75(10):439-450.
  5. Bulatov, D., Wernerus, P., and Heipke, C. (2011). Multiview dense matching supported by triangular meshes. ISPRS Journal of Photogrammetry and Remote Sensing, accepted for publication.
  6. Curless, B. and Levoy, M. (1996). A volumetric method for building complex models from range images. Proc. ACM SIGGRAPH, 30:303-312.
  7. Fischer, A., Kolbe, T., Lang, F., Cremers, A., F örstner, W., Plümer, L., and Steinhage, V. (1998). Extracting buildings from aerial images using hierarchical aggregation in 2D and 3D. Computer Vision and Image Understanding, 72(2):185-203.
  8. Geibel, R. and Stilla, U. (2000). Segmentation of Laseraltimeter data for building reconstruction: Comparison of different procedures. Int. Arch. of Photogrammetry and Remote Sensing, 33 part B3:326-334.
  9. Gross, H., Thönnessen, U., and v. Hansen, W. (2005). 3DModeling of urban structures. Joint Workshop of ISPRS/DAGM Object Extraction for 3D City Models, Road Databases, and Traffic Monitoring CMRT05, Int. Arch. of Photogrammetry and Remote Sensing, 36, Part 3W24:137-142.
  10. Haala, N. (2005). Multi-Sensor-Photogrammetrie - Vision oder Wirklichkeit? Habilitation, Deutsche Geodätische Kommission, München, C589.
  11. Harris, C. G. and Stevens, M. J. (1998). A combined corner and edge detector. Proc. of 4th Alvey Vision Conference, pages 147-151.
  12. Hartley, R. and Zisserman, A. (2000). Multiple View Geometry in Computer Vision. Cambridge University Press.
  13. Hirschmüller, H. (2008). Stereo processing by semi-global matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(2):328-341.
  14. Kobbelt, L. and Botsch, M. (2004). A survey of pointbased techniques in computer graphics. Computers & Graphics, 28(6):801-814.
  15. Lin, Y.-M., Zhang, W., Wang, Y., Fang, S.-C., and Lavery, J. E. (2006). Computationally efficient models of urban and natural terrain by non-iterative domain decomposition with l1-smoothing splines. Proc. 25th Army Science Conf., Department of the Army, Washington DC, USA.
  16. Mayer, H. (1999). Automatic object extraction from aerial imagery - A Survey focusing on buildings. Computer Vision and Image Understanding, 74(2):139-149.
  17. Mayer, H. and Bartelsen, J. (2008). Automated 3D reconstruction of urban areas from networks of widebaseline image sequences. The Int. Arch. of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 37, Part B5:633-638.
  18. Pock, T., Zebedin, L., and Bischof, H. (2011). Tgvfusion. Rain-bow of Computer Science. SpringerVerlag, 6570/2011:245-258.
  19. Rottensteiner, F. (2010). Roof plane segmentation by combining multiple images and point clouds. Proc. of Photogrammetric Computer Vision and Image Analysis Conference, Int. Arch. of Photogrammetry and Remote Sensing, 38, Part 3A:245-250.
  20. Scharstein, D. and Szeliski, R. (2002). A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms. International Journal of Computer Vision, 47(1):7-42. Images and ground truth can be downloaded at: http://bj.middlebury.edu/~schar/ stereo/data/Tsukuba/.
Download


Paper Citation


in Harvard Style

Bulatov D., Wernerus P. and Gross H. (2012). ON APPLICATIONS OF SEQUENTIAL MULTI-VIEW DENSE RECONSTRUCTION FROM AERIAL IMAGES . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM, ISBN 978-989-8425-99-7, pages 275-280. DOI: 10.5220/0003707802750280


in Bibtex Style

@conference{icpram12,
author={Dimitri Bulatov and Peter Wernerus and Hermann Gross},
title={ON APPLICATIONS OF SEQUENTIAL MULTI-VIEW DENSE RECONSTRUCTION FROM AERIAL IMAGES},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,},
year={2012},
pages={275-280},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003707802750280},
isbn={978-989-8425-99-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,
TI - ON APPLICATIONS OF SEQUENTIAL MULTI-VIEW DENSE RECONSTRUCTION FROM AERIAL IMAGES
SN - 978-989-8425-99-7
AU - Bulatov D.
AU - Wernerus P.
AU - Gross H.
PY - 2012
SP - 275
EP - 280
DO - 10.5220/0003707802750280