Tuesday, May 11th, 1999, 1pm
W4: A REAL TIME VISUAL SURVEILLANCE SYSTEM FOR MONITORING HUMAN ACTIVITIES

Ismail Haritaoglu
UMIACS
University of Maryland

ABSTRACT

W4 is a real time visual surveillance system for detecting and tracking multiple people and monitoring their activities in an outdoor environment. It operates on monocular grayscale video imagery, or on video imagery from an infrared camera. W4 employs a combination of shape analysis and tracking to locate people and their parts (head, hands, feet, torso) and to create models of people's appearance so that they can be tracked through interactions such as occlusions. It can determine whether a foreground region contains multiple people, and can segment the region into its constituent people and track them. W4 can also determine whether or not people are carrying objects, and can segment objects from their silhouette, and constructs appearance model for them so they can be identified in subsequent frames. W4 can recognize events between people and objects, such as depositing an object, exchanging bags, or removing an object.