Technische Universität München Robotics and Embedded Systems
 

Get the visual focus-of-attention

 
Type MA
Supervisor Prof. Dr.-Ing. Alois Knoll
Advisor Dr.-Ing. Giorgio Panin, Dipl.-Ing. Claus Lenz
Student Önder Tato
Research Area CoTeSys
Associated Projects ITrackU, JAHIR
Programming Language C++
Required Skills Image Processing, Computer Vision, Computer Graphics
Useful Knowledge Techniques for face/gaze detection, modeling, tracking

Description

The goal of this project is to obtain the focus-of-attention of a person ("where is he/she looking at?") for Human-Robot interaction in the JAHIR scenario.

The proposed methodology involves a real-time, 3D face and gaze tracking system, based on a full textured model of the subject. For this purpose, the OpenTL library of the ITrackU project will be used.

This model can be acquired from two photos (front and profile view), by adapting a generic head model to the facial features (eyes, nose, lips etc.), and subsequently applying the texture images to the model. The current implementation of the modeling procedure is fast, and does not require particular user skills. However, it could be made more interactive and reliable.

The project is then articulated in the following milestones:

Main tasks:

Location: Garching

focus_attention.png focus_attention.png2

Literature

For more information about our activity, please refer to our Lectures on Model-based Visual Tracking.