Wedgelet Enhanced Appearance Models

Generative segmentation methods such as the Active Appearance Models (AAM) establish dense correspondences by modelling variation of shape and pixel intensities. Alas, for 3D and high-resolution 2D images typical in medical imaging, this approach is rendered infeasible due to excessive storage and computational requirements. This paper extends the previous work of Wolstenholme and Taylor where Haar wavelet coefficient subsets were modelled rather than pixel intensities. In addition to a detailed review of the method and a discussion of the integration into an AAM-framework, we demonstrate that the more recent bi-orthogonal CDF 9-7 wavelet offers advantages over the traditional Haar wavelet in terms of synthesis quality and accuracy. Further, we demonstrate that the inherent frequency separation in wavelets allows for simple band-pass filtering, e.g. edge-emphasis. Experiments using Haar and CDF 9-7 wavelets on face images have shown that segmentation accuracy degrades gracefully with increasing compression ratio. Further, a proposed weighting scheme emphasizing edges was shown to be significantly more accurate at compression ratio 1:1, than a conventional AAM. At higher compression ratios the scheme offered both a decrease in complexity and an increase in segmentation accuracy.

Background. The prostate gland is delineated as the clinical target volume (CTV) in treatment planning of prostate cancer. Therefore, an accurate delineation is a prerequisite for efficient treatment. Accurate automated prostate segmentation methods facilitate the delineation of the CTV without inter-observer variation. The purpose of this study is to present an automated three-dimensional (3D) segmentation of the prostate using an active appearance model. Material and methods. Axial T2-weighted magnetic resonance (MR) scans were used to build the active appearance model. The model was based on a principal component analysis of shape and texture features with a level-set representation of the prostate shape instead of the selection of landmarks in the traditional active appearance model. To achieve a better fit of the model to the target image, prior knowledge to predict how to correct the model and pose parameters was incorporated. The segmentation was performed as an iterative algorithm to minimize the squared difference between the target and the model image. Results. The model was trained using manual delineations from 30 patients and was validated using leave-one-out cross validation where the automated segmentations were compared with the manual reference delineations. The mean and median dice similarity coefficient was 0.84 and 0.86, respectively. Conclusion. This study demonstrated the feasibility for an automated prostate segmentation using an active appearance with results comparable to other studies.

Active Appearance Models (AAMs) are generative parametric models that have been successfully used in the past to model faces. Anecdotal evidence, however, suggests that the performance of an AAM built to model the variation in appearance of a single person across pose, illumination, and expression (a Person Specific AAM) is substantially better than the performance of an AAM built to model the variation in appearance of many faces, including unseen subjects not in the training set (a Generic AAM). In this paper, we present an empirical evaluation that shows that Person Specific AAMs are, as expected, both easier to build and more robust to fit than Generic AAMs. Moreover, we show that: (1) building a generic shape model is far easier than building a generic appearance model, and (2) the shape component is the main cause of the reduced fitting robustness of Generic AAMs. We then proceed to describe two refinements to Generic AAMs to improve their performance: (1) a refitting procedure to improve the quality of the ground-truth data used to build the AAM and (2) a new fitting algorithm. For both refinements we demonstrate dramatically improved fitting performance. Finally, we evaluate the effect of these improvements on a combined model construction and fitting task.

This paper presents a novel approach to the problem of obtaining a low dimensional representation of texture (pixel intensity) variation present in a training set after alignment using a Generalised Procrustes analysis. We extend the conventional analysis of training textures in the Active Appearance Models segmentation framework. This is accomplished by augmenting the model with an estimate of the covariance of the noise present in the training data. This results in a more compact model maximising the signal-to-noise ratio, thus favouring subspaces rich on signal, but low on noise. Differences in the methods are illustrated on a set of left cardiac ventricles obtained using magnetic resonance imaging.KeywordsActive Appearance ModelDispersion MatrixTexture ModeMinimum Noise FractionLeft Cardiac VentricleThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

In this work we automatically segment the left ventricle (LV) in cardiac MR images in the end-diastole (ED) and end-systole (ES) phases using a novel approach that combines statistical and deterministic deformable models. A 3D Active Appearance Model (AAM) is used to segment the ED phase. The AAM texture model is trained on radial samples from gradient magnitude images to make the fitting process faster and more discriminative. A trained ED-to-ES shape correspondence model is used to map a given ED shape to an ES shape. Once the AAM model converges to a shape in ED, the correspondence model is used to get an approximate ES shape. We segment the LV in the ES phase by first fitting a deformable superquadric to the AAM converged shape (in ED) using data range forces and then tracking the LV using image and data range forces (for the ES shape obtained from correspondence model). We test our approach by performing leave-one-out training on a 35 patient datasets. The data comprises 19 normal patients and 16 patients having heart abnormalities (cardiomyopathy and myocardial infarction). The composition makes it a challenging data collection with significant shape variation. The performance of our method is evaluated by measuring the mismatch between automatically segmented and expert delineated contours using the Mean Perpendicular Distance (MPD) and Dice metrics. The average MPD is 2.6mm for ED and 3.7mm for ES (error mostly towards the apex and base). The average Dice is 0.9 for ED and 0.8 for ES. These results show good potential for clinical use.

In this paper a framework for face recognition using Active Appearance Model is proposed. Active appearance model has the ability to synthesize near-photo realistic images of the class learned from the training set. The recognition algorithm works on those synthesized images and tries to match the nearest face in the training set to the synthesized image.

Active Appearance Models (AAM), which have been recently introduced by Cootes et al., describe the shape of objects and gray level appearance from a set of example images. An AAM is created from user-placed contours defining the shape of objects of interest in each training image. The information about shape changes observed in the training set is used to model the shape variation. Principle component analysis (PCA) is utilized to model gray level variation observed in the training set. The resulting model describes objects as a linear combination of eigen vectors both in shape and gray levels applied to the mean image. The main purpose of this work is to investigate the clinical potential of AAMs for segmentation of cardiovascular MR images acquired in routine clinical practice. An AAM was constructed using 102 end- diastolic short-axis cardiac MR images at the papillary muscle level from normals and patients with varying pathologies. The resulting AAM is a compact representation consisting of a mean image and a limited number of coefficients of eigen vectors, representing 97% of shape and gray level variation observed in the training set. The segmentation performance is tested in 60 end-diastolic short-axis cardiac MR images from different patients.

2D Active Appearance Models (AAM) and 3D Morphable Models (3DMM) are widely used techniques. AAM provide a fast fitting process, but may represent unwanted 3D transformations unless strictly constrained not to do so. The reverse is true for 3DMM. The two approaches also require of a pre-alignment of their 2D or 3D shapes before the modeling can be carried out which may lead to errors. Furthermore, current models are insufficient to represent nonlinear shape and texture variations. In this paper, we derive a new approach that can model nonlinear changes in examples without the need of a pre-alignment step. In addition, we show how the proposed approach carries the above mentioned advantages of AAM and 3DMM. To achieve this goal, we take advantage of the inherent properties of complex spherical distributions, which provide invariance to translation, scale and rotation. To reduce the complexity of parameter estimation we take advantage of a recent result that shows how to estimate spherical distributions using their Euclidean counterpart, e.g., the Gaussians. This leads to the definition of Rotation Invariant Kernels (RIK) for modeling nonlinear shape changes. We show the superiority of our algorithm to AAM in several face datasets. We also show how the derived algorithm can be used to model complex 3D facial expression changes observed in American Sign Language (ASL).

Video-based face model fitting using Adaptive Active Appearance Model

Face registration is a challenging problem due in part to the non-rigid nature of human faces. Active Appearance Models (AAMs) have been proposed as a useful technique for face registration in part because they can account for changes in shape. Fitting of AAMs to imagery is typically done using the Gauss-Newton method; however this approach is known to fail when either the initial shape estimate is to far off and/or the appearance model fails to direct search toward a good match. In this paper, we employ Evolution Strategies (ES) to search for a near optimal fit, i.e. set of model parameters, that relate an AAM to a novel face image. In addition, we dramatically reduce the dimensionality of the search problem by analytically determining the optimal texture parameters associated with any given shape. Experimental results reveal that the proposed approach outperforms the standard AAM parameter estimation technique and some of its variants. Further, the difference is statistically significant. Finally, some basic limitations of AAMs are identified using fitness landscape analysis.

Regression-based Active Appearance Model initialization for facial feature tracking with missing frames

A background robust active appearance model using active contour technique

Visual tracking is one of the fundamental problems in computer vision. The pose of an object extracted through consecutive frames has a variety of applications ranging from robot navigation to camera based man-machine interfaces. In this paper we examine the use of Active Appearance Models(AAM) for the task of visual tracking. The original Active Appearance Model is limited to have all points of the model visible in all frames. We introduce a notion of visibility uncertainty for the points in the AAM, removing the above limitation and therefore allowing the object to contain self-occlusions. The visibility uncertainty is easily integrated into the existing AAM framework, keeping model initialization time to a minimum.We have experiments illustrating that the extension allow AAMs to track through self occlusions at near real-time.

Automated MRI cerebellar size measurements using active appearance modeling

We use the popular active appearance models (AAM) for extracting discriminative features from images of biological objects. The relevant discriminative features are combined principal component (PCA) vectors from the AAM and texture features from cooccurrence matrices. Texture features are extracted by extending the AAM's with a textural warp guided by the AAM shape. Based on this, texture cooccurrence features are calculated. We use the different features for classifying the biological objects to species using standard classifiers, and we show that even though the objects are highly variant, the AAM's are well suited for extracting relevant features, thus obtaining good classification results. Classification is conducted on two real data sets, one containing various vegetables and one containing different species of wood logs.