Human-Activity Analysis in Multimedia Data

Salvetti O., Cetin E. A., Pauwels E.

Multimedia Data Analysis  Image Processing 

Many important applications in multimedia revolve around the detection of humans and the interpretation of their behavior. These include surveillance and intrusion detection, video conferencing applications, assisted living applications, and automatic analysis of sports videos, broadcasts, and movies, to name just a few. Success in these tasks often requires the integration of various sensor or data modalities such as video, audio, motion, and accompanying text, and typically hinges on a host of machine-learning methodologies to handle the inherent variability and complexity of the ensuing features. The computational efficiency of the resulting algorithms is critical since the amount of data to be processed in multimedia applications is typically large, and in real-time systems, speed is of the essence. There have been several recent special issues dealing with the dection of humans and the analysis of their activity relying solely on video footage. In this special issue, we have tried to provide a platform to contributions that make use of a broader spectrum of multimedia information, complementing video with audio or text information as well as other types of sensor signals, whenever available. The first group of papers in the special issue addresses the joint use of audio and video data. The paper

Metrics