PTZ control with Head tracking

This project aims to create a user interface for controlling Pan/Tilt/Zoom parameters of a remote camera with a motion of viewer's head. With such an interface, we can introduce a wider field of view into video conferencing just using a flat panel display and a cheap webcam. The technological challenges are a method to capture a wide field of view and a method to detect a face in real time for view synthesis. The experimental setup utilizes a fisheye camera and face detection algorithm with Haar-like features for this purpose, and shows good performance with a regular laptop PC.

Figure 1. Transforming fisheye
figure figure
Figure 2. Demonstration
figure figure