Adela Barbulescu, Antoine Begault, Laurence Boissieux, Marie-Paule Cani, Maxime Garcia, Maxime Portaz, Alexis Viand, Pierre Heinish, Romain Dulery, Rémi Ronfard, Dominique Vaufreydaz
6th Workshop on Intelligent Cinematography and Editing (WICED 2017), Apr 2017, Lyon, France.
Corresponding frame for: (a) the front Kinect video data displaying the storyteller’s expressions, (b) the top Kinect video data with the current orientations and positions of the figurines, (c) a reconstructed scene including a virtual storyteller with directly transferred expressions and virtual figurines with directly transferred movements and (d) the final animated version of the story.
Abstract
Pretend play is a storytelling technique, naturally used from very young ages, which relies on object substitution to represent the characters of the imagined story. We propose “Make-believe”, a system for making movies from pretend play by using 3D printed figurines as props. We capture the rigid motions of the figurines and the gestures and facial expressions of the storyteller using Kinect cameras and IMU sensors and transfer them to the virtual story-world. As a proof-of-concept, we demonstrate our system with an improvised story involving a prince and a witch, which was successfully recorded and transferred into 3D animation.
