• Home
  • Search
  • Comparing Visual Feature Coding for Learning Disjoint Camera Dependencies
  • Cite Icon4
  • https://doi.org/10.5244/c.26.94Copy DOI Icon

Comparing Visual Feature Coding for Learning Disjoint Camera Dependencies

  • Jan 1, 2012
  • Xiatian Zhu +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Problem: This work systematically investigates the effectiveness of various visual feature coding schemes for facilitating the learning of timedelayed dependencies among disjoint multi-camera views. Related work: Quite a few studies [3, 4, 6] have been proposed to model inter-camera dependency across non-overlapping camera views. Learning time-delayed correlations among disjoint cameras in crowded public scenarios is a non-trivial task: (1) the time gaps between camera views are unknown therefore activities in two related views may occur at arbitrary time delays with high uncertainty; (2) the features are inevitably noisy, ambiguous, and may vary drastically across views owning to illumination condition, camera angles, and changes in object pose. Most state-ofthe-art methods typically hand pick a few features tailored to the target environment, with the hope that those chosen features contain robust and sufficient statistics for correlating the time-delayed activity patterns across disjoint views. These manual approaches to hard selection of features are neither principled nor generalisable to different scene context. Our solution: In this study, we wish to examine the concept that visual features should be coded and selected automatically for robust and accurate time-delayed dependency learning. The contributions of this study are two-fold: (1) We present a systematic study and evaluation to investigate the effectiveness of supervised and unsupervised feature coding methods to facilitate the learning of inter-camera activity pattern dependencies. (2) We systematically evaluate the sensitivity of inter-camera time delayed dependency learning given different training video sizes and region decomposition qualities. These factors are critical for accurate dependency learning but have been largely ignored by the published existing work in the literature. Approach overview: We employ the Random Forest [2] as the supervised feature coding approach. In particular, given a set of localised features extracted from a region, together with people count training label over time, we first train a regression forest to learn the non-linear mapping between the crowd density and the corresponding low-level features. Given unseen data, we then construct a time series based on the predicted crowd density ŷ obtained from the regression forest (RF pred), the treestructured code (tree code) [5], or the combination of the two. As for unsupervised coding scheme, we use the Latent Dirichlet Allocation (LDA) [1] to map the low-level features into codewords that capture the topic distribution, whereby an image region patch (document) d is treated as a collection of j = 1 . . .Ni features (words). To form the unsupervised feature codes, given a sequence of localised feature vectors detected from a region, we first perform quantisation on each feature to generate a bag-of-word representation for all image patches. Similar to text documents, these bag-of-word represented image patches are fed into the LDA, which gives us a topic-based representation. Once having the topic-based code (topic code), we perform k-means quantisation on them, producing the final compact topic-based code, and concatenate them over time to form a time series. To solve the problem of using the feature codes for learning intercamera dependencies, we adopt the Time Delayed Mutual Information (TDMI) proposed in [3] due to its reported effectiveness and simplicity. The input to TDMI are time series generated from either the supervised or the unsupervised coding scheme. In addition to measuring deviation error in transition time, we propose a new metrics to evaluate the effectiveness of different coding methods, called Mutual Information Margin (MIM):

Similar Papers
  • Research Article
  • Citations5

Determination of Relevant Neuron–Neuron Connections for Neural Prosthetics Using Time-Delayed Mutual Information: Tutorial and Preliminary Results

  • Nov 04, 2011
  • World Neurosurgery
  • Alexander Taghva +4
  • Conference Article
  • Citations6

Author-topic based representation of call-center conversations

  • Dec 01, 2014
  • Mohamed Morchid +3
  • Book Chapter
  • Citations2

Stochastic Stabilizing Control of Networked Control System with Markovian Parameters

  • Oct 04, 2013
  • Ying Wu +2
  • Research Article
  • Citations11

Analysis and parameter identification of time-delay systems via shifted Jacobi polynomials

  • Oct 01, 1986
  • International Journal of Control
  • Ing-Rong Horng +1
  • Research Article
  • Citations206

Integrated adaptive robust control for multilateral teleoperation systems under arbitrary time delays

  • Oct 22, 2015
  • International Journal of Robust and Nonlinear Control
  • Zheng Chen +2
  • Research Article
  • Citations26

Quantum-kinetic study of femtosecond pump-and-probe spectra of bulk GaAs

  • Apr 15, 2000
  • Physical Review B
  • K Hannewald +2
  • Single Report

An Energy Tunable X-ray Delay Device - Phase II

  • Dec 15, 2010
  • A Robert
  • Book Chapter
  • Citations49

Bilateral Control Architectures for Telerobotics

  • Jan 01, 2007
  • Sandra Hirche +4
  • Book Chapter

Abnormal Event Detection Based on Crowd Density Distribution and Social Force Model

  • Jan 01, 2016
  • Yaomin Wen +2
  • Conference Article
  • Citations8

A novel delay locked loop for UWB-IR

  • May 18, 2004
  • S Tachikawa +1
  • Conference Article
  • Citations2

Batch Fusion Estimater Based on Relative Measurements for Sensor Network with Arbitrary Time Lags

  • Jan 01, 2007
  • Cheng-Lin Wen +1
  • Research Article
  • Citations1

Two- and three-point (in time) statistics of fission chamber signals for multiplicity counting with thermal neutrons

  • Mar 20, 2019
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment
  • L Nagy +2
  • PDF
  • Research Article
  • Citations1

Acceleration-critical density time-delay model for crowd stability analysis based on Lyapunov theory

  • Jan 01, 2022
  • MATEC Web of Conferences
  • Rongyong Zhao +5
  • Research Article
  • Citations88

Cross-Scenario Transfer Person Reidentification

  • Aug 01, 2016
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Xiaojuan Wang +3
  • Research Article
  • Citations12

Decoupling design of multivariable generalised predictive control

  • May 01, 1994
  • IEE Proceedings - Control Theory and Applications
  • T Chai +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.