High-fidelity 3D model real-time content generation for light-field 3D display based on sparse-view reprojection and raycast technique

• 1、Electronic Engineering School,Beijing University of Posts and Telecommunications，Beijing 100876

Abstract：Light field displays offer simultaneous dense multi-view information, wide viewing angles, and ultra-high image quality. Real-time rendering of high-quality 3D light fields poses a significant challenge in this field. However, current research has not achieved the simultaneous realization of high frame rate and high quality 3D light field content generation. The traditional SMV 3D rendering pipeline exhibits several deficiencies, such as non-real-time operation, poor image quality, inaccurate lighting outcomes, and restricted viewpoints. In response, we have improved our approach by enhancing frame rates through the implementation of depth reprojection from sparse to dense views and an optimized ray casting technique for surface noise, significantly benefiting both dense view generation and target view coloring stages. In the present study, for the target view coloring stage, the concept of color space mapping was employed for shading. This entails a transition from the previous color mapping from the reference view to the target view, which was previously a simple 2D warp. Instead, a 3D spatial contrast mapping was implemented, which effectively reduces image noise and improves image quality. Moreover, the proposed method is compatible with the majority of mainstream rendering algorithms, and is capable of rendering high-frame rate and high-quality 3D light field content. The method achieves a real-time frame rate of 100 fps at 8K (7680×4320) resolution in 3D light field displays.

Keywords： Real-time rendering of high-quality 3D light fields Ray cast Color mapping