914
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Shading aware DSM generation from high resolution multi-view satellite images

, ORCID Icon, &
Pages 398-407 | Received 29 Dec 2021, Accepted 13 Sep 2022, Published online: 11 Nov 2022

References

  • Agarwal, S., K. Mierle, and The Ceres Solver Team. 2018. “Ceres Solver.” http://ceres-solver.org
  • Basri, R., and D. W. Jacobs. 2003. “Lambertian Reflectance and Linear Subspaces.” IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (2): 218–233. doi:10.1109/TPAMI.2003.1177153.
  • Bradski, G. 2000. “The OpenCv Library.” Dr Dobb’s Journal: Software Tools for the Professional Programmer. doi:10.1111/0023-8333.50.s1.10.
  • Esteban, C. H., and F. Schmitt. 2003. “Silhouette and Stereo Fusion for 3D Object Modeling.” Fourth International Conference on 3-D Digital Imaging and Modeling 3DIM 46–53. doi:10.1109/IM.2003.1240231.
  • Faugeras, O., and R. Keriven. 1998. “Variational Principles, Surface Evolution, Pdes, Level Set Methods, and the Stereo Problem.” IEEE Transactions on Image Processing 7 (3): 336–344. doi:10.1109/83.661183.
  • Frankot, R. T., and R. Chellappa. 1988. “A Method for Enforcing Integrability in Shape from Shading Algorithms.” IEEE Transactions on Pattern Analysis and Machine Intelligence 10 (4): 439–451. doi:10.1109/34.3909.
  • Furukawa, Y., B. Curless, S. M. Seitz, and R. Szeliski. 2009. “Manhattan-World Stereo.” In IEEE Conference on Computer Vision and Pattern Recognition, 1422–1429. doi: 10.1109/CVPR.2009.5206867.
  • Furukawa, Y., and C. Hernández. 2015. ”Multi-View Stereo : A Tutorial.” 9: 1–148. doi:10.1007/978-3-319-05558-9.
  • Furukawa, Y., and J. Ponce. 2010. “Accurate, Dense, and Robust Multiview Stereopsis.” IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (8): 1362–1376. doi:10.1109/TPAMI.2009.161.
  • Gabet, L., G. Giraudon, and L. Renouard. 1997. “Automatic Generation of High Resolution Urban Zone Digital Elevation Models.” ISPRS Journal of Photogrammetry and Remote Sensing 52: 33–47. doi:10.1016/S0924-2716(96)00030-5.
  • Gallup, D., J. M. Frahm, and M. Pollefeys. 2010. “Piecewise Planar and Non-Planar Stereo for Urban Scene Reconstruction.” In IEEE Conference on Computer Vision and Pattern Recognition, 1418–1425. doi:10.1109/CVPR.2010.5539804.
  • Goesele, M., B. Curless, and S. M. Seitz. 2006. “Multi-View Stereo Revisited.” In IEEE Conference on Computer Vision and Pattern Recognition, 2402–2409. doi: 10.1109/CVPR.2006.199.
  • Habbecke, M., and L. Kobbelt. 2006. “Iterative Multi-View Plane Fitting.” In International Fall Workshop of Vision, Modeling,and Visualization, 73–80.
  • Heipke, C., C. Piechullek, and H. Ebner. 2001. “Simulation Studies and Practical Tests Using Multi-Image Shape from Shading.” ISPRS Journal of Photogrammetry and Remote Sensing 56: 139–148. doi:10.1016/S0924-2716(01)00038-7.
  • Heise, P., B. Jensen, S. Klose, and A. Knoll. 2015. “Variational Patchmatch Multiview Reconstruction and Refinement.” In IEEE International Conference on Computer Vision (ICCV), 882–890. doi:10.1109/ICCV.2015.107.
  • Hirschmüller, H. 2007. “Stereo Processing by Semiglobal Matching and Mutual Information.” IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (2): 328–341. doi:10.1109/TPAMI.2007.1166.
  • Horn, B. K. P. 1970. Shape from Shading: A Method for Obtaining the Shape of a Smooth Opaque Object from One View. Cambridge, MA: Massachusetts Institute of Technology.
  • Horn, B. K. P., and M. J. Brooks. 1986. “The Variational Approach to Shape from Shading.” Computer Vision, Graphics, and Image Processing 33 (2): 174–208. doi:10.1016/0734-189X(86)90114-3.
  • Hou, Y., J. Peng, Z. Hu, P. Tao, and J. Shan. 2018. “Planarity Constrained Multi-View Depth Map Reconstruction for Urban Scenes.” ISPRS Journal of Photogrammetry and Remote Sensing 139: 133–145. doi:10.1016/j.isprsjprs.2018.03.003.
  • Hu, Z., Y. Hou, P. Tao, and J. Shan. 2021. “IMGTR: Image-Triangle Based Multi-View 3D Reconstruction for Urban Scenes.” ISPRS Journal of Photogrammetry and Remote Sensing 181: 191–204. doi:10.1016/j.isprsjprs.2021.09.009.
  • Ikeuchi, K., and B. K. P. Horn. 1981. “Numerical Shape from Shading and Occluding Boundaries.” Artificial Intelligence 17 (1–3): 141–184. doi:10.1016/0004-3702(81)90023-0.
  • Kemelmacher-Shlizerman, I., and R. Basri. 2010. “3D Face Reconstruction from a Single Image Using a Single Reference Face Shape.” IEEE Transactions on Pattern Analysis and Machine Intelligence 33 (2): 394–405. doi:10.1109/TPAMI.2010.63.
  • Kim, K., A. Torii, and M. Okutomi. 2016. “Multi-View Inverse Rendering Under Arbitrary Illumination and Albedo.” In European Conference on Computer Vision, 750–767. Cham: Springer. doi:10.1007/978-3-319-46487-9_46.
  • Kolmogorov, V., and R. Zabih. 2001. “Computing Visual Correspondence with Occlusions Using Graph Cuts.” In IEEE/CVF International Conference on Computer Vision (ICCV), 508–515. doi: 10.1109/ICCV.2001.937668.
  • Kwon, H., Y. W. Tai, and S. Lin. 2015. “Data-Driven Depth Map Refinement via Multi-Scale Sparse Representation.” In IEEE Conference on Computer Vision and Pattern Recognition, 159–167. doi: 10.1109/CVPR.2015.7298611.
  • Langguth, F., K. Sunkavalli, S. Hadap, and M. Goesele. 2016. “Shading-Aware Multi-View Stereo.” In European Conference on Computer Vision, 469–485. Cham: Springer. doi:10.1007/978-3-319-46487-9_29.
  • Li, D., M. Wang, and J. Jiang. 2021. “China’s High-Resolution Optical Remote Sensing Satellites and Their Mapping Applications.” Geo-Spatial Information Science 24 (1): 85–94. doi:10.1080/10095020.2020.1838957.
  • Lions, P. L., E. Rouy, and A. Tourin. 1993. “Shape-From-Shading, Viscosity Solutions and Edges.” Numerische Mathematik 64: 323–353. doi:10.1007/BF01388692.
  • Liu, J., and S. Ji. 2020. “A Novel Recurrent Encoder-Decoder Structure for Large-Scale Multi-View Stereo Reconstruction from an Open Aerial Dataset.” In IEEE Conference on Computer Vision and Pattern Recognition, 6049–6058. doi:10.1109/CVPR42600.2020.00609.
  • Liu, W. C., B. Wu, and C. Wöhler. 2018. “Effects of Illumination Differences on Photometric Stereo Shape-And-Albedo-From-Shading for Precision Lunar Surface Reconstruction.” ISPRS Journal of Photogrammetry and Remote Sensing 136: 58–72. doi:10.1016/j.isprsjprs.2017.12.010.
  • Lohse, V., C. Heipke, and R. L. Kirk. 2006. “Derivation of Planetary Topography Using Multi-Image Shape-From-Shading.” Planetary and Space Science 54 (7): 661–674. doi:10.1016/j.pss.2006.03.002.
  • Ma, X., Y. Gong, Q. Wang, J. Huang, L. Chen, and F. Yu. 2021. “EPP-Mvsnet: Epipolar-Assembling Based Depth Prediction for Multi-View Stereo.” In IEEE/CVF International Conference on Computer Vision (ICCV), 5712–5720. doi:10.1109/ICCV48922.2021.00568.
  • Maurer, D., Y. C. Ju, M. Breuß, and A. Bruhn. 2018. “Combining Shape from Shading and Stereo: A Joint Variational Method for Estimating Depth, Illumination and Albedo.” International Journal of Computer Vision 126: 1342–1366. doi:10.1007/s11263-018-1079-1.
  • Panagopoulos, A., S. Hadap, and D. Samaras. 2012. “Reconstructing Shape from Dictionaries of Shading Primitives.” In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 80–94. Berlin: Springer. doi:10.1007/978-3-642-37447-0_7.
  • Peng, J., Y. Zhang, and J. Shan. 2015. “Shading-Based DEM Refinement Under a Comprehensive Imaging Model.” ISPRS Journal of Photogrammetry and Remote Sensing 110: 24–33. doi:10.1016/j.isprsjprs.2015.09.012.
  • Quéau, Y., J. Mélou, J.-D. Durou, and D. Cremers. 2017. “Dense Multi-View 3D-Reconstruction Without Dense Correspondences.” ArXiv Abs/1704 00337. doi:10.1016/j.compgeo.2009.08.004.
  • Rothermel, M., and K. Wenzel. 2012. “SURE - Photogrammetric Surface Reconstruction from Imagery.” In Proceedings LC3D Workshop, 1–9.
  • Shan, J., Z. Hu, P. Tao, L. Wang, S. Zhang, and S. Ji. 2020. “Toward a Unified Theoretical Framework for Photogrammetry.” Geo-Spatial Information Science 23 (1): 75–86. doi:10.1080/10095020.2020.1730712.
  • Tang, X., G. Zhang, X. Zhu, H. Pan, Y. Jiang, P. Zhou, and X. Wang. 2013. “Triple Linear-Array Image Geometry Model of ZiYuan-3 Surveying Satellite and Its Validation.” International Journal of Image and Data Fusion 4 (1): 33–51. doi:10.1080/19479832.2012.734340.
  • Tao, P. 2016. 3D Surface Reconstruction and Optimization Based on Geometric and Radiometric Integral Imaging Model. Wuhan: Wuhan University.
  • Toutin, T. 2004. “Comparison of Stereo-Extracted DTM from Different High-Resolution Sensors: SPOT-5, EROS-A, IKONOS-II, and QuickBird.” IEEE Transactions on Geoscience and Remote Sensing 42 (10): 2121–2129. doi:10.1109/TGRS.2004.834641.
  • Woodham, R. J. 1980. “Photometric Method for Determining Surface Orientation from Multiple Images.” Optical Engineering 19 (1): 139–144. doi:10.1117/12.7972479.
  • Wu, B., W. C. Liu, A. Grumpe, and C. Wöhler. 2018. “Construction of Pixel-Level Resolution Dems from Monocular Images by Shape and Albedo from Shading Constrained with Low-Resolution DEM.” ISPRS Journal of Photogrammetry and Remote Sensing 140: 3–19. doi:10.1016/j.isprsjprs.2017.03.007.
  • Wu, C., B. Wilburn, Y. Matsushita, and C. Theobalt. 2011. “High-Quality Shape from Multi-View Stereo and Shading Under General Illumination.” In IEEE Conference on Computer Vision and Pattern Recognition, 969–976. doi: 10.1109/CVPR.2011.5995388.
  • Xie, J., G. Huang, R. Liu, C. Zhao, J. Dai, T. Jin, F. Mo, et al. 2020. ”Design and Data Processing of China’s First Spaceborne Laser Altimeter System for Earth Observation: GaoFen-7”. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13: 1034–1044. doi:10.1109/JSTARS.2020.2977935.
  • Xu, D., Q. Duan, J. Zheng, J. Zhang, J. Cai, and T. J. Cham. 2018. “Shading-Based Surface Detail Recovery Under General Unknown Illumination.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (2): 423–436. doi:10.1109/TPAMI.2017.2671458.