Demos and Videos

You are welcome to browse through our demos and videos (alphabetical order). A broad and non-exhaustive list of the team’s research topics may be found on our  homepage. Some of these demos are related to our research pages and are directly linked to recently submitted or accepted publications that can be found here. Please also refer to our complete list of publications.

Audio-visual person tracking with NAO

This video summarizes some of the work carried out by the Perception team in 2017. We use a NAO robot manufactured by Softbank Robotics Europe. Unlike the standard (commercial) version, our NAO has a stereoscopic camera pair which allows to track persons in 3D and to implement visual servoing robustly and efficiently. The vides shows …

Audio-visual speaker tracking and diarization

Speaker diarization consists of assigning speech signals to speakers engaged in dialog. We proposed audio-visual spatiotemporal diarization model that tracks multiple persons and assigns acoustic signals to each person. Below are some of our results on AVDIAR dataset. The digit displayed on top of a person head represents the “person identity” as maintained by a …

Eye gaze and visual focus of attention

This video uses examples from the LAEO dataset to  illustrate our method for tracking gaze and visual focus of attention (please visit this page for more details). Red arrows indicate the head orientations and green arrows indicate gaze directions. A circled face indicates the visual focus of attention of a person gazing towards that face. …