Correspondence-Free Activity Analysis and Scene Modeling in Multiple Camera Views
Publication in refereed journal

Times Cited
Web of Science52WOS source URL (as at 17/11/2020) Click here for the latest count
Altmetrics Information

Other information
AbstractWe propose a novel approach for activity analysis in multiple synchronized but uncalibrated static camera views. In this paper, we refer to activities as motion patterns of objects, which correspond to paths in far-field scenes. We assume that the topology of cameras is unknown and quite arbitrary, the fields of views covered by these cameras may have no overlap or any amount of overlap, and objects may move on different ground planes. Using low-level cues, objects are first tracked in each camera view independently, and the positions and velocities of objects along trajectories are computed as features. Under a probabilistic model, our approach jointly learns the distribution of an activity in the feature spaces of different camera views. Then, it accomplishes the following tasks: 1) grouping trajectories, which belong to the same activity but may be in different camera views, into one cluster; 2) modeling paths commonly taken by objects across multiple camera views; and 3) detecting abnormal activities. Advantages of this approach are that it does not require first solving the challenging correspondence problem, and that learning is unsupervised. Even though correspondence is not a prerequisite, after the models of activities have been learned, they can help to solve the correspondence problem, since if two trajectories in different camera views belong to the same activity, they are likely to correspond to the same object. Our approach is evaluated on a simulated data set and two very large real data sets, which have 22,951 and 14,985 trajectories, respectively.
All Author(s) ListWang XG, Tieu K, Grimson WEL
Journal nameIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume Number32
Issue Number1
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages56 - 71
LanguagesEnglish-United Kingdom
Keywordsactivity analysis in multiple camera views; clustering; correspondence; Visual surveillance
Web of Science Subject CategoriesComputer Science; Computer Science, Artificial Intelligence; COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE; Engineering; Engineering, Electrical & Electronic; ENGINEERING, ELECTRICAL & ELECTRONIC

Last updated on 2020-18-11 at 00:56