Improving Shape Transformations for RGB Cameras Using Photometric Stereo
H. I. Wahhab 1, A. N. Alanssari 2, Ahmed L. Khalaf 3, Ravi Sekhar4, * , Pritesh Shah5, Jamal F. Tawfeq6
1 College of Computer Science & Information Technology, University of Kerbala, Kerbala, 56002, Iraq
2 Faculty of Basic education, Department of Mathematics, University of Kufa, Najaf, Iraq
3 College of Engineering, Al-Iraqia University, Baghdad, 10054, Iraq
4,5 Symbiosis Institute of Technology (SIT) Pune Campus, Symbiosis International (Deemed University) (SIU), Pune, 412115, Maharashtra,India
6 Department of Medical Instrumentation Technical Engineering, Medical Technical College, Al-Farahidi University, Baghdad, 10070, Iraq
Emails: haider.wahhab@uokerbala.edu.iq; alaan.azeez@uokufa.edu.iq; ahmed.l.khalaf@aliraqia.edu.iq; ravi.sekhar@sitpune.edu.in; pritesh.shah@sitpune.edu.in; jamaltawfeq55@gmail.com
Abstract
The emergence of low-cost red, green, and blue (RGB) cameras has significantly impacted various computer vision tasks. However, these cameras often produce depth maps with limited object details, noise, and missing information. These limitations can adversely affect the quality of 3D reconstruction and the accuracy of camera trajectory estimation. Additionally, existing depth refinement methods struggle to distinguish shape from complex albedo, leading to visible artifacts in the refined depth maps. In this paper, we address these challenges by proposing two novel methods based on the theory of photometric stereo. The first method, the RGB ratio model, tackles the nonlinearity problem present in previous approaches and provides a closed-form solution. The second method, the robust multi-light model, overcomes the limitations of existing depth refinement methods by accurately estimating shape from imperfect depth data without relying on regularization. Furthermore, we demonstrate the effectiveness of combining these methods with image super-resolution to obtain high-quality, high-resolution depth maps. Through quantitative and qualitative experiments, we validate the robustness and effectiveness of our techniques in improving shape transformations for RGB cameras.
Keywords: RGB cameras; photometric stereo; RGB ratio model; multi-light model; computer vision; RGB-Fusion