Learning from Multiple Sources for Video Summarisation
Publication in refereed journal

Times Cited
Web of Science11WOS source URL (as at 24/11/2020) Click here for the latest count
Altmetrics Information

Other information
AbstractMany visual surveillance tasks, e.g. video summarisation, is conventionally accomplished through analysing imagery-based features. Relying solely on visual cues for public surveillance video understanding is unreliable, since visual observations obtained from public space CCTV video data are often not sufficiently trustworthy and events of interest can be subtle. We believe that non-visual data sources such as weather reports and traffic sensory signals can be exploited to complement visual data for video content analysis and summarisation. In this paper, we present a novel unsupervised framework to learn jointly from both visual and independently-drawn non-visual data sources for discovering meaningful latent structure of surveillance video data. In particular, we investigate ways to cope with discrepant dimension and representation whilst associating these heterogeneous data sources, and derive effective mechanism to tolerate with missing and incomplete data from different sources. We show that the proposed multi-source learning framework not only achieves better video content clustering than state-of-the-art methods, but also is capable of accurately inferring missing non-visual semantics from previously-unseen videos. In addition, a comprehensive user study is conducted to validate the quality of video summarisation generated using the proposed multi-source model.
All Author(s) ListZhu XT, Loy CC, Gong SG
Journal nameInternational Journal of Computer Vision
Detailed descriptionDOI: 10.1007/s11263-015-0864-3.
Volume Number117
Issue Number3
Pages247 - 268
LanguagesEnglish-United Kingdom
KeywordsEvent recognition; Heterogeneous data; Multi-source data; Video summarisation; Visual surveillance
Web of Science Subject CategoriesComputer Science; Computer Science, Artificial Intelligence

Last updated on 2020-25-11 at 00:42