Design of multipath error correction algorithm of coarse and fine sparse decomposition based on compressed sensing in time-of-flight cameras

ABSTRACT

A single pixel in time of flight cameras receives multiple reflected light from different scene points, resulting in erroneous depth information. In this paper, based on the proposed sparse decomposition, a coarse and fine sparse decomposition based on compressed sensing is applied to multipath separation. The applied method uses a linear combination of multiple frequency signals to modulate the source. The measured vector obtained through finite random measurements is subjected to two sparse decompositions – rough separation and detailed positioning, and finally the minimum direct path depth is accurately recovered. Under the premise of the same number of measurements, calculation amount, and storage space, the accuracy of the coarse and fine sparse decomposition based on compressed sensing is improved by nearly an order of magnitude compared to the sparse decomposition without compressed sensing. Moreover, our method can basically achieve multi-path separation accuracy to the sub-millimeter level.

KEYWORDS:

• Time-of-flight
• multipath interference
• multipath separation
• compressed sensing
• random measurement
• coarse and fine sparse decomposition

Disclosure statement

No potential conflict of interest was reported by the author(s).

Notes on contributors

Bin Jiang, he is currently a Postgraduate in the School of Physics and Electronic Science of Hunan Normal University. His research interests optical signal processing and systems.

Xiangliang Jin, he received the M.S. degree in micro technology with emphasis in electric circuits from Hunan University, China, in 2000, and the Ph.D. degree in micro-electronics and solid-state circuits with emphasis in CMOS image sensor design from institute of microelectronics of Chinese academy of sciences in 2004. After graduation, he sets up Superpix Micro technology Ltd. As one co-founder. From 2010 to 2018, he is a full professor in Xiangtan University. Now he is a professor in Hunan Normal University. His research interests include His research interests include micro-nano devices and hybrid integrated circuit design, optical signal processing and system integration.

Yan Peng, he is a professor and dean of the Research Institute of USV Engineering, Shanghai University, Shanghai, China. She led the team to develop eight series of unmanned surface vessel, which were delivered to the state oceanic administration, ministry of transport and other departments, and carried out missions in the East China Sea, Yellow Sea and Antarctic. She has presided over more than 20 projects, which won the second prize of national technological invention award and the first prize of Shanghai science and technology progress award.

Jun Luo, he is a professor in the School of Mechatronics Engineering and Automation, Shanghai University, Shanghai, China. From 2010 to 2011, he visited and studied in the department of mechanics, university of Toronto, Canada. He current research interests include bionic vision, anti-disturbance control of robot and unmanned aerial vehicle control technology.

ORCID

Xiangliang Jin http://orcid.org/0000-0002-9732-142X

Additional information

Funding

This work is supported by the National Natural Science Foundation of China [grant number 61827812, 61774129], Hunan Science and Technology Department Huxiang High-level Talent Gathering Project [grant number 2019RS1037] and Hunan Province Scientific and Technological Breakthrough of Strategic Emerging Industries and Transformation Projects [grant number 2019GK4016].