An H.264-based depth generation for 2D to 3D conversion

As H.264 has been chosen as one of the platforms for 3DTV applications, it is a good choice for us to generate the depth map based on H.264. In the project,motion information based on H.264 is used to derive the displacement of objects over two consecutive frames.Comparing with other algorithms, it is readily available in the form of motion vectors(MVs) at the receiver-end at no additional computational cost .What is more,there is no need for the sender to send the depth information, which makes the system real-time.

With the development of 3DTV, the conversion of existing 2D videos to 3D videos has become one of the most important component of 3D content production. One of the key steps in 2D to 3D conversion is how to generate a dense depth map.In this project, a novel depth extraction method is proposed for 2D to 3D conversion. As H.264 has been chosen as one of the platforms for 3DTV applications, it is a good choice for us to generate the depth map based on H.264. In the project,motion information based on H.264 is used to derive the displacement of objects over two consecutive frames.Comparing with other algorithms, it is readily available in the form of motion vectors(MVs) at the receiver-end at no additional computational cost .What is more,there is no need for the sender to send the depth information, which makes the system real-time. The left and right view images can be generated from the original 2D video and its Depth Image.With some pre-processing and hole-filling procedures, we finally get the left and right eye view for 3D display. The performance of generated stereoscopic video was evaluated in a subjective manner, by surveying participants after watching the stereoscopic video. Some techologies like OpenCV(an Open Computer Vision Library), Angstrom Operating System, GTK+ for the User Interface and JM(an open source lirbary)are used in the project. Meanwhile, our operating System and main algorithm are run respectively on Arm and Dsp which use the Omap 3530 beagleboard as the platform. Registrar: zhouruili.myopenid.com