Project description:
It is now possible to capture time-varying 3D point clouds at high spatial and temporal resolution. This allows for high-quality acquisitions of human bodies and faces in motion. However, tools to process and analyze these data robustly and automatically are missing. Such tools are critical to learning generative models of human motion, which can be leveraged to create plausible synthetic human motion sequences. This has the potential to influence virtual reality applications such as virtual change rooms or crowd simulations. Developing such tools is challenging due to the high variability in human shape and motion and due to significant geometric and topological acquisition noise present in state-of-the-art acquisitions. The main objective of 3DMOVE is to automatically compute high-quality generative models from a database of raw dense 3D motion sequences for human bodies and faces. To achieve this objective, 3DMOVE will leverage recently developed deep learning techniques.
Members:
Scientific leader:
- Stefanie Wuhrer, Inria
Permanent members:
- Anne-Hélène Olivier, Université Rennes 2
- Jean-Sébastien Franco, Grenoble INP
- Edmond Boyer, Inria
Ph.D. students:
- Rim Rekik Nkhili (Ph.D. student at Université Grenoble Alpes since Nov. 2021, co-advised by Anne-Hélène Olivier and Stefanie Wuhrer)
- Mathieu Marsot (Ph.D. student at Université Grenoble Alpes since Nov. 2019, co-advised by Jean-Sébastien Franco and Stefanie Wuhrer)
- Raphaël Dang-Nhu (Ph.D. student at Université Grenoble Alpes Oct. 2020 – Apr. 2021, co-advised by Anne-Hélène Olivier and Stefanie Wuhrer)
Publications:
- Mathieu Marsot, Stefanie Wuhrer, Jean-Sebastien Franco, Anne Hélène Olivier. Representing motion as a sequence of latent primitives, a flexible approach for human motion modelling. Research report 2022.
- Mathieu Marsot, Stefanie Wuhrer, Jean-Sébastien Franco, Stephane Durocher. A Structured Latent Space for Human Body Motion Generation. International Conference on 3D Vision, 2022.
Code is available at https://github.com/mmarsot/A_structured_latent_space
Financing period: 2019 – 2024
Financing agency: ANR
