WP1 aims at developing novel technologies for capturing and processing 3D models of persons while preserving their natural mimics and gestures, thus avoiding the uncanny valley effect. It addresses the following objectives:
The goal of the work package is to generate natural representations of real persons, which can be fully animated enabling new forms of immersive multi-user collaboration and storytelling. Volumetric video capture that supports high realism and the reproduction of fine details as well as subtle motion and expressions is combined with computer graphics models, which allow for interactive animation and editing. The resulting hybrid representations enable the photorealistic rendering of real humans while providing the possibility of pose modifications orthe creation of entirely new content from sample data. By relying on real captured motion sequences, which are re-combined and interpolated during animation,realism is targeted that is difficult to achieve with state-of-the-art CGI models.