A background subtraction algorithm for a pan-tilt camera

vertebral fracture is a very common outcome of osteoporosis, which is one of the major public health concerns in the world. Early detection of vertebral fractures is important because timely pharmacologic intervention can reduce the risk of subsequent additional fractures. Our goal seeks to develop a computerized method for detection of vertebral fractures by measuring the shape and appearance of vertebrae on cervical xray radiographs in order to assist radiologist’s image interpretation and thus allow the early diagnosis of osteoporosis. The statistical models of shape and appearance are powerful tools for interpreting medical images. This work introduces the application of correlation filter classifiers for identification and verification of the osteoporosis presence in cervical vertebrae training/ testing set. Correlation filter classifiers have been previously applied to other biometric classification tasks, but not to classification of cervical vertebrae images. We describe how the extraction of an appropriate region of interest in the cervical vertebrae surface can be used to design correlation filters that accomplish 90 % recognition on a database of 50 cervical bone shapes.Keywordsx-ray radiographsSegmentationASM modelingCorrelation filtervertebral deformityOsteoporosis

Learning to see stuff

In this paper, a new contour coding technique using motion information is proposed, for the object-oriented video coding. In the conventional technique using motion information by Gu, the region-based motion compensation is performed, and only the contours neighboring the motion- failure (MF) regions are encoded by the proper intra-frame contour coding technique. However, since even small local motions within a region may incur the MF regions, the temporal correlation of the contours cannot be effectively exploited by the conventional techniques. In our approach, those MF regions are significantly reduced by employing the two-stage motion compensation. While the region-based motion compensation is performed in the first stage, the MF regions proceed to the second stage motion compensation to find the contours in the previous frame which coincide with the contours of the MF regions. In addition, by introducing the notion of the error band, the current contours can be properly fitted to the motion compensated contours using inter-frame relationship of the contours. From the simulation results, it is shown that the proposed technique provides better performance than the conventional technique by Gu. Moreover, by varying the width N of the error band, it is shown that the bit amount for the shape information can be adjusted according to the channel condition.

The joint effect of mesoscale and microscale roughness on perceived gloss

The Active Appearance Model (AAM) algorithm has proved to be a successful method for matching statistical models of appearance to new images. Since the original algorithm was described there have been a variety of suggested modifications to the basic algorithm, each typically claiming to be in some way superior. We review these algorithms and report the results of experiments comparing their performance. We also investigate the effects of different methods of estimating the update matrix used in the algorithm. We find that careful choice of the latter has at least as much effect as the choice of updating technique.

This paper presents a probabilistic framework for discovering objects in video. The video can switch between different shots, the unknown objects can leave or enter the scene at multiple times, and the background can be cluttered. The framework consists of an appearance model and a motion model. The appearance model exploits the consistency of object parts in appearance across frames. We use maximally stable extremal regions as observations in the model and hence provide robustness to object variations in scale, lighting and viewpoint. The appearance model provides location and scale estimates of the unknown objects through a compact probabilistic representation. The compact representation contains knowledge of the scene at the object level, thus allowing us to augment it with motion information using a motion model. This framework can be applied to a wide range of different videos and object types, and provides a basis for higher level video content analysis tasks. We present applications of video object discovery to video content analysis problems such as video segmentation and threading, and demonstrate superior performance to methods that exploit global image statistics and frequent itemset data mining techniques.

The segmentation of moving objects in image sequence can be formulated as a background subtraction problem—the separation of objects from the background in each image frame. The background scene is learned and modeled. A pixelwise process is employed to classify each pixel as an object or background based on its similarity with the background model. The segmentation is challenging due to the occurrence of dynamic elements such as illumination change and background motions. We propose a framework for object segmentation with a novel feature for background representation and new mechanisms for updating the background model. A ternary pattern is employed to characterize the local texture. The pattern and photometric features are used for background modeling. The classification of pixel is performed based on the perceptual similarity between the current pixel and the background model. The segmented object is refined by taking into account the spatial consistency of the image feature. For the background model update, we propose two mechanisms that are able to adapt to abrupt background change and also merge new background elements into the model. We compare our framework with various background subtraction algorithms on video datasets.

In this paper, we propose a method for joint 2D segmentation and 2D-3D pose tracking. First, we define a novel energy functional which considers the discrimination between statistical appearance models and the coherence among neighboring pixels simultaneously. And then, a particle filter-like stochastic optimization technique is adopted to solve the energy functional, so that a preferable initial value can be provided for the subsequent damped Newton optimization method. Furthermore, an occlusion-aware updating strategy is utilized for appearance models, which can easily increase the foreground learning rate. As a result, our method is more suitable for the video sequences with occlusion. Experimental results highlight excellent performance on challenging synthetic and real-world sequences as compared with the state-of-the-art approaches.

Fractures of the proximal femur are one of the principal causes of mortality among elderly persons. Traditional methods for the determination of femoral fracture risk use methods for measuring bone mineral density. However, BMD alone is not sufficient to predict bone failure load for an individual patient and additional parameters have to be determined for this purpose. In this work an approach that uses statistical models of appearance to identify relevant regions and parameters for the prediction of biomechanical properties of the proximal femur will be presented. By using Support Vector Regression the proposed model based approach is capable of predicting two different biomechanical parameters accurately and fully automatically in two different testing scenarios.

Model-free tracking is a widely-accepted approach to track an arbitrary object in a video using a single frame annotation with no further prior knowledge about the object of interest. Extending this problem to track multiple objects is really challenging because: a) the tracker is not aware of the objects' type while trying to distinguish them from background (detection task), and b) The tracker needs to distinguish one object from other potentially similar objects (data association task) to generate stable trajectories. In order to track multiple arbitrary objects, most existing model-free tracking approaches rely on tracking each target individually by updating their appearance model independently. Therefore, in this scenario they often fail to perform well due to confusion between the appearance of similar objects, their sudden appearance changes and occlusion. To tackle this problem, we propose to use both appearance and motion models, and to learn them jointly using graphical models and deep neural networks features. We introduce an indicator variable to predict sudden appearance change and/or occlusion. When these happen, our model does not update the appearance model thus avoiding using the background and/or incorrect object to update the appearance of the object of interest mistakenly, and relies on our motion model to track. Moreover, we consider the correlation among all targets, and seek the joint optimal locations for all targets simultaneously as a graphical model inference problem. We learn the joint parameters for both appearance model and motion model in an online fashion under the framework of LaRank. Experiment results show that our method achieved superior performance compared to the competitive methods.

This paper proposes a method to improve the prediction accuracy of motion compensation (MC) in video coding using block-wise and pixel-wise motion with little additional information. In general MC, block-wise motion vectors (MVs) are computed by block matching (BM), but these are not always suitable for motions such as local scaling and deformation. To improve the accuracy of such motions, the proposed method estimates the pixel-wise motion precisely from two decoded frames with little additional information, and extrapolates the frame to be encoded using the pixel-wise motion and an interpolation method. This is first-stage MC. In second-stage MC, the encoder adaptively chooses the extrapolated or previous frames as a reference frame for each MC block. The block-wise MVs are then computed using BM to prevent loss of accuracy. Experimental results show that the proposed method outperforms BM for local scaling and deformation motions.

Active Appearance Models (AAMs) and Constrained Local Models (CLMs) are classical approaches for model-based image segmentation in medical image analysis. AAMs consist of global statistical models of shape and appearance, are known to be hard to fit, and often suffer from insufficient generalization capabilities in case of limited training data. CLMs model appearance only for local patches and relax or completely remove the global appearance constraint. They are, therefore, much easier to optimize but in certain cases they lack the robustness of AAMs. In this paper, we present a framework for patch-based active appearance modeling, which elegantly combines strengths of AAMs and CLMs. Our models provide global shape and appearance constraints and we make use of recent methodological advances from computer vision for efficient joint optimization of shape and appearance parameters during model fitting. Furthermore, the insufficient generalization abilities of those global models are tackled by incorporating and extending a recent approach for learning representative statistical shape models from small training populations. We evaluate our approach on publicly available chest radiographs and cardiac MRI data. The results show that the proposed framework leads to competitive results in terms of segmentation accuracy for challenging multi-object segmentation problems even when only few training samples are available.

The present paper introduces an original way to perform motion estimation and compensation. The scheme is asymmetric in the sense that the compensation stage is not merely the reverse operation of the estimation process. Motion estimation is computed using a classical block matching algorithm and the set of vectors that compose the motion information are classically transmitted to the decoder. The motion compensation uses them to deform a wireframe structure whose vertices are displaced according to the motion vectors. Conditions must be set up on the number of wireframe vertices and on their location. In comparison with a block-based compensation, the main advantage is the possibility to take into account the object information, which results in perceptually more pleasant predicted pictures.

This paper examines the process real-world SMT manufacturers are employing to evaluate, select and implement automated optical inspection (AOI) systems for post-placement/pre-reflow inspection during the PCB assembly process. A case study from a prominent European SMT manufacturer describes the process used to evaluate a post-placement/pre-reflow AOI system. Traditional, algorithm-based AOI techniques are briefly described and evaluated, along with their strengths and limitations. A new AOI methodology, called statistical appearance modeling, and a stereo-vision inspection machine are briefly described and compared to traditional AOI systems. Examples of payback and ROI calculations and analysis are highlighted. The system requirements are specified and the actual results of the AOI performance trial are summarized. Other relevant topics include analyzing GR&R, interpreting SPC data, and implementing post/placement/pre-reflow AOI.

We propose a novel background subtraction algorithm for the videos captured by a moving camera. In our technique, foreground and background appearance models in each frame are constructed and propagated sequentially by Bayesian filtering. We estimate the posterior of appearance, which is computed by the product of the image likelihood in the current frame and the prior appearance propagated from the previous frame. The motion, which transfers the previous appearance models to the current frame, is estimated by nonparametric belief propagation; the initial motion field is obtained by optical flow and noisy and incomplete motions are corrected effectively through the inference procedure. Our framework is represented by a graphical model, where the sequential inference of motion and appearance is performed by the combination of belief propagation and Bayesian filtering. We compare our algorithm with the existing state-of-the-art technique and evaluate its performance quantitatively and qualitatively in several challenging videos.