基于无人机影像序列的三维重建方法综述

doi:10.13209/j.0479-8023.2017.052

北京大学学报自然科学版 ›› 2017, Vol. 53 ›› Issue (6): 1165-1178.DOI: 10.13209/j.0479-8023.2017.052

基于无人机影像序列的三维重建方法综述

刘磊^1,², 孙敏¹(), 任翔¹, 刘鑫夫², 刘亮¹, 郑晖³, 黎晓东¹

1. 北京大学地球与空间科学学院, 北京 100871
2. 中国人民解放军61206部队, 北京 100042
3. 中国矿业大学(北京) 地球科学与测绘工程学院, 北京 100083

收稿日期:2016-06-01 修回日期:2016-11-07 出版日期:2017-11-20 发布日期:2017-11-20
基金资助:
国家“十二五”科技支撑项目(2012BAH27B02)和科技部援疆项目(2014AB021)资助

Review on Methods of 3D Reconstruction from UAV Image Sequences

Lei LIU^1,², Min SUN¹(), Xiang REN¹, Xinfu LIU², Liang LIU¹, Hui ZHENG³, Xiaodong LI¹

1. School of Earth and Space Sciences, Peking University, Beijing 100871
2. 61206 PLA troops, Beijing 100042
3. College of Geoscience and Surveying Engineering, China University of Mining & Technology (Beijing), Beijing 100083;;

Received:2016-06-01 Revised:2016-11-07 Online:2017-11-20 Published:2017-11-20

摘要/Abstract

摘要：

在总结无人机序列影像重建方法的基础上, 基于原理和适用性, 将目前的主要处理方法分为两类: 1) 基于传统航测理论的改进方法, 该类方法需要较多的人机交互与质量控制, 适用于大范围航迹规则的影像处理; 2) 基于多视几何理论的方法, 该类方法使用类似近景摄影测量的方式处理无人机影像, 适用于特定地物或复杂地形区域下不规则航迹采集的影像处理。通过比较不同方法的适用性, 详细探讨所涉及关键技术的优势、局限性与改进方法。最后指出, 将传统摄影测量技术与计算机视觉技术相结合是今后的研究方向, 并探讨了有待解决的关键问题。

关键词: 无人机, 序列影像, 多视几何, 摄影测量, 三维重建

Abstract:

Based on reviewing the methods for UAV image-sequence reconstruction, the classification on the principle and applicability of the methods is proposed. Generally, the methods involved can be divided into two groups. One is based on traditional photogrammetry, which needs more intermediate quality-control checks and more human-computer interactions. This method can be used to reconstruct large and regular image blocks. The other called the multi-view geometry method, is more like close range photogrammetry. It is more suitable for automatic reconstruction of irregular image blocks, such as specific objects and complex terrains. After comparing applicability of different methods, the related technology is expatiated, and the advantages, limitations and enhancement methods are discussed. Finally, it is pointed out that the combination of photogrammetry and computer vision is the future research direction, and the key problems to be solved are discussed.

Key words: UAV, image sequences, multiple view geometry, photogrammetry, 3D reconstruction

刘磊, 孙敏, 任翔, 刘鑫夫, 刘亮, 郑晖, 黎晓东. 基于无人机影像序列的三维重建方法综述[J]. 北京大学学报自然科学版, 2017, 53(6): 1165-1178.

Lei LIU, Min SUN, Xiang REN, Xinfu LIU, Liang LIU, Hui ZHENG, Xiaodong LI. Review on Methods of 3D Reconstruction from UAV Image Sequences[J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2017, 53(6): 1165-1178.

导出引用管理器 EndNote|Ris|BibTeX

链接本文: https://xbna.pku.edu.cn/CN/10.13209/j.0479-8023.2017.052

https://xbna.pku.edu.cn/CN/Y2017/V53/I6/1165

参考文献 34

[1]	Eisenbeiss H. A mini unmanned aerial vehicle (UAV): system overview and image acquisition . The Inter-national Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2004: 36-43
[2]	Colomina I, Molina P. Unmanned aerial systems for photogrammetry and remote sensing: a review. ISPRS Journal of Photogrammetry and Remote Sensing 2014, 92:79-97
[3]	Nex F, Remondino F. UAV for 3D mapping applica-tions: a review. Applied Geomatics 2014, 6(1):1-15
[4]	Eisenbeiss H.UAV photogrammetry [D]. Zurich: Swiss Federal Institute of Technology Zurich, 2009
[5]	Karras G E, Mavromati D, Madani M, et al. Digital orthophotography in archaeology with low-altitude non-metric images // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XXXII, Part 5/W11. Thes-saloniki 1999: 8-11
[6]	Haala N, Cramer M, Weimer F, et al. Performance test on UAV-Based photogrammetric data collection // In-ternational Archives of the Photogrammetry. Remote Sensing and Spatial Information Sciences 2012, 38:7-12
[7]	Eisenbeiss H. The potential of unmanned aerial vehi-cles for mapping. Photogrammetric Week 2011, 11:135-145
[8]	Eisenbeiss H, Lambers K, Sauerbier M. Photogram-metric recording of the archaeological site of Pin-chango Alto (Palpa, Peru) using a mini helicopter (UAV) // CAA 2005: Computer Apllication and Quan-titative Methods in Archaeology, Proccedings of the 33rd Conference. Tomar 2005: 238‒243
[9]	Baltsavias E, Gruen A, Eisenbeiss H, et al. High-quality image matching and automated generation of 3D tree models. International Journal of Remote Sensing 2008, 29(5):1243-1259
[10]	Lambers K, Eisenbeiss H, Sauerbier M, et al. Combining photogrammetry and laser scanning for the recording and modelling of the Late Intermediate Period site of Pinchango Alto, Palpa, Peru. Journal of Archaeological Science 2007, 34(10):1702-1712
[11]	Eisenbeiss H. Applications of photogrammetric pro-cessing using an autonomous model helicopter // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XXXVI, Part 4/W54. Urumchi 2007, 36:51-56
[12]	Eisenbeiss H. The autonomous mini helicopter: a powerful platform for mobile mapping // The Inter-national Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XXXVIII, Part 4/C1. Calgary 2008: 977-983
[13]	Eisenbeiss H, Sauerbier M. Investigation of UAV systems and flight modes for photogrammetric appli-cations. Photogrammetric Record 2011, 26:400-421
[14]	Eisenbeiss H, Li Z.Comparison of DSMs generated from mini UAV imagery and terrestrial laser scanner in a cultural heritage application // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XXXVL, Part 1/W41. Ankara 2006: 90-96
[15]	Haala N, Rothermel M.Dense multiple stereo matching of highly overlapping UAV imagery // The International Archives of the Photogrammetry, Re-mote Sensing and Spatial Information Sciences, Vol XXXIX, Part B1. Melbourne 2012: 387-392
[16]	Haala N, Cramer M, Rothermel M. Quality of 3D point clouds from highly overlapping UAV imagery // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XL, Part 1/W2. Rostock 2013: 183-188
[17]	Rothermel M, Haala N, Wenzel K, et al. Fast and robust generation of semantic urban terrain models from UAV video streams // Procceedings of Interna-tional Conference on Pattern Recognition 2014. Stock-holm:IEEE Computer Society 2014: 592-597
[18]	Rosnell T, Honkavaara E. Point cloud generation from aerial image data acquired by a quadrocopter type micro unmanned aerial vehicle and a digital still camera. Sensors 2012, 12(1):453-480
[19]	Qin R, Grün A, Huang X. UAV project — building a reality-based 3D model. Coordinates 2013, 9:18-26
[20]	Cramer M. The UAV LGL BW project — a NMCA case study // Proceedings of 54th Photogrammetric Week. Stuttgart 2013: 9-13
[21]	Jang H S, Lee J C, Kim M S, et al. Construction of national cultural heritage management system using RC helicopter photographic surveying system // The International Archives of the Photogrammetry, Re-mote Sensing and Spatial Information Sciences, Vol XXXV, Part B5. Istanbul 2004: 473-478
[22]	Fritz A, Kattenborn T, Koch B. UAV-based photo-grammetric point clouds — tree stem mapping in open stands in comparison to terrestrial laser scanner point clouds // The International Archives of the Photogrammetry, Remote Sensing and Spatial Infor-mation Sciences, Vol XL, Part 1/W2. Rostock 2013: 141-146
[23]	Lucieer A, Jong S M D, Turner D. Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photo-graphy. Progress in Physical Geography 2014, 38(1):97-116
[24]	Hugenholtz C H, Moorman B J, Riddell K, et al. Small unmanned aircraft systems for remote sensing and earth science research. Eos Transactions Ameri-can Geophysical Union 2012, 93(25):236-236
[25]	Whitehead K, Hugenholtzchris H, Myshak S, et al. Remote sensing of the environment with small un-manned aircraft systems, part 1: a review of progress and challenges. Journal of Unmanned Vehicle Sys-tems 2014, 2(3):69-85
[26]	Whitehead K, Hugenholtzchris H, Myshak S, et al. Remote sensing of the environment with small un-manned aircraft systems, part 2: scientific and com-mercial applications. Journal of Unmanned Vehicle Systems 2014, 2(3):86-102
[27]	Strecha C, Küng O, Fua P. Automatic mapping from ultra-light UAV imagery // Proceedings of the Euro-pean Calibration and Orientation Workshop 2012. Catellldefels 2012: EPFL-CONF-175351
[28]	Strecha C, Bronstein A, Bronstein M, et al. LDAHash: improved matching with smaller descriptors. IEEE Transactions on Pattern Analysis & Machine Intelli-gence 2011, 34(1):66-78
[29]	Gini R, Pagliari D, Passoni D, et al. UAV photo-grammetry: block triangulation comparisons // The International Archives of the Photogrammetry, Re-mote Sensing and Spatial Information Sciences, Vol XL, Part 1/ W2. Rostock 2013: 157-162
[30]	Turner D, Lucieer A, Wallace L. Direct georefe-rencing of ultrahigh-resolution UAV imagery. IEEE Transactions on Geoscience & Remote Sensing 2014, 52(5):2738-2745
[31]	Unger J, Reich M,Heipke C. UAV-based pho-togrammetry: monitoring of a building zone // The International Archives of the Photogrammetry, Re-mote Sensing and Spatial Information Sciences, Vol XL, Part 5. Riva del Garda 2014: 601-606
[32]	Remondino F, Barazzetti L, Nex F, et al.UAV photogrammetry for mapping and 3D modeling-current status and future perspectives. International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences, 2011, 38(1): 25-31
[33]	Remondino F, Del Pizzo S, Kersten T P, et al. Low-cost and open-source solutions for automated image orientation — a critical overview // Progress in Cul-tural Heritage Preservation: Proccedings of the 4th International Conference. Limassol 2012: 40-54
[34]	Colomina I, Molina P, Parés M E, et al. Towards a new paradigm for high-resolution low-cost photo-grammetry and remote sensing The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XXXVII, Part B1. Beijing, 2008: 1201-1206

基于无人机影像序列的三维重建方法综述

Review on Methods of 3D Reconstruction from UAV Image Sequences

PDF

PDF (翻译版)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 34

相关文章 6

编辑推荐

Metrics

留言

[1]	杨欣宇, 李培军. 综合利用光谱特征、形态学特征和霍夫变换的无人机图像玉米幼苗分布信息提取[J]. 北京大学学报自然科学版, 2023, 59(5): 843-853.
[2]	程俊毅, 张显峰, 孙敏, 罗鹏, 杨婉婷. 基于空地协同采样的植被覆盖度随机森林估算方法[J]. 北京大学学报自然科学版, 2020, 56(1): 143-154.
[3]	魏云鹏, 赵红颖, 辛甜甜, 郑鸿云. 应用于无人机视频影像密集匹配的特征描述方法[J]. 北京大学学报（自然科学版）, 2016, 52(6): 990-998.
[4]	彭凡, 董熙平 . 同步加速器X射线层析显微技术在化石胚胎Markuelia研究中的应用[J]. 北京大学学报（自然科学版）, 2008, 44(3): 447-451.
[5]	孙敏. 多视几何与传统摄影测量理论[J]. 北京大学学报（自然科学版）, 2007, 43(4): 453-459.
[6]	余永生,毕卫涛. 远景摄影测量的一种标定方法及其应用[J]. 北京大学学报（自然科学版）, 2006, 42(5): 628-631.