- Research Article
6
- 10.3168/jds.s0022-0302(98)70155-9
Detection and Utilization of Single Genes Without DNA Assays
- Sep 01, 1998
- Journal of Dairy Science
- R.L Fernando + 2 more +2
Detection and Utilization of Single Genes Without DNA Assays
One of the most important problems in general insurance is estimating the loss reserve distribution. In this article, we develop Bayesian multivariate loss reserving models for cases where losses and random effects are assumed to be distributed under the scale mixtures of multivariate normal (SMMN) distributions. This class of distributions, which contains heavy-tailed multivariate distributions such as student’s t, Pearson type VII, variance-gamma, slash and contaminated normal distributions, can be often used for robust inferences; when the assumptions of normality become questionable. The hierarchical structure of the SMMN representation has the advantage that under a Bayesian paradigm, the parameter estimation is simplified by sampling from multivariate normal distribution using Markov Chain Monte Carlo (MCMC) methods. A Bayesian case deletion influence diagnostics based on q-divergence measures is also presented. Further, simulated and real data sets are analyzed, where we show that the models under the Pearson type VII and the variance-gamma distributions outperform the usual normal models.
Detection and Utilization of Single Genes Without DNA Assays
Detection and Utilization of Single Genes Without DNA Assays
Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Wasserstein distance is costly, entropy-regularized optimal transport was proposed to computationally efficiently approximate the Wasserstein distance. The purpose of this study is to understand the theoretical aspect of entropy-regularized optimal transport. In this paper, we focus on entropy-regularized optimal transport on multivariate normal distributions and q-normal distributions. We obtain the explicit form of the entropy-regularized optimal transport cost on multivariate normal and q-normal distributions; this provides a perspective to understand the effect of entropy regularization, which was previously known only experimentally. Furthermore, we obtain the entropy-regularized Kantorovich estimator for the probability measure that satisfies certain conditions. We also demonstrate how the Wasserstein distance, optimal coupling, geometric structure, and statistical efficiency are affected by entropy regularization in some experiments. In particular, our results about the explicit form of the optimal coupling of the Tsallis entropy-regularized optimal transport on multivariate q-normal distributions and the entropy-regularized Kantorovich estimator are novel and will become the first step towards the understanding of a more general setting.
Read moreEstimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques*
Summary This paper discusses the problem of estimating marginal likelihoods for mixture and Markov switching model. Estimation is based on the method of bridge sampling (Meng and Wong 1996; Statistica Sinica 11, 552-86.) where Markov Chain Monte Carlo (MCMC) draws from the posterior density are combined with an i.i.d. sample from an importance density. The importance density is constructed in an unsupervised manner from the MCMC draws using a mixture of complete data posteriors. Whereas the importance sampling estimator as well as the reciprocal importance sampling estimator are sensitive to the tail behaviour of the importance density, we demonstrate that the bridge sampling estimator is far more robust. Our case studies range from computing marginal likelihoods for a mixture of multivariate normal distributions, testing for the inhomogeneity of a discrete time Poisson process, to testing for the presence of Markov switching and order selection in the MSAR model.
Read moreMeasures of multivariate skewness and kurtosis in high-dimensional framework
Skewness and kurtosis characteristics of a multivariate p-dimensional distribution introduced by Mardia (1970) have been used in various testing procedures and demonstrated attractive asymptotic properties in large sample settings. However these characteristics are not designed for high-dimensional problems where the dimensionality, p can largely exceeds the sample size, N. Such type of high-dimensional data are commonly encountered in modern statistical applications. This the suggests that new measures of skewness and kurtosis that can accommodate high-dimensional settings must be derived and carefully studied. In this paper, we show that, by exploiting the dependence structure, new expressions for skewness and kurtosis are introduced as an extension of the corresponding Mardia’s measures, which uses the potential advantages that the block-diagonal covariance structure has to offer in high dimensions. Asymptotic properties of newly derived measures are investigated and the cumulant based characterizations are presented along with of applications to a mixture of multivariate normal distributions and multivariate Laplace distribution, for which the explicit expressions of skewness and kurtosis are obtained. Test statistics based on the new measures of skewness and kurtosis are proposed for testing a distribution shape, and their limit distributions are established in the asymptotic framework where N→∞ and p is fixed but large, including p>N. For the dependence structure learning, the gLasso based technique is explored followed by AIC step which we propose for optimization of the gLasso candidate model. Performance accuracy of the test procedures based on our estimators of skewness and kurtosis are evaluated using Monte Carlo simulations and the validity of the suggested approach is shown for a number of cases when p>N.
Read moreMultiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models With Local Dependence
ABSTRACTWe present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures of multinomial distributions for categorical variables with Dirichlet process mixtures of multivariate normal distributions for continuous variables. We incorporate dependence between the continuous and categorical variables by (1) modeling the means of the normal distributions as component-specific functions of the categorical variables and (2) forming distinct mixture components for the categorical and continuous data with probabilities that are linked via a hierarchical model. This structure allows the model to capture complex dependencies between the categorical and continuous data with minimal tuning by the analyst. We apply the model to impute missing values due to item nonresponse in an evaluation of the redesign of the Survey of Income and Program Participation (SIPP). The goal is to compare estimates from a field test with the new design to estimates from selected individuals from a panel collected under the old design. We show that accounting for the missing data changes some conclusions about the comparability of the distributions in the two datasets. We also perform an extensive repeated sampling simulation using similar data from complete cases in an existing SIPP panel, comparing our proposed model to a default application of multiple imputation by chained equations. Imputations based on the proposed model tend to have better repeated sampling properties than the default application of chained equations in this realistic setting. Supplementary materials for this article are available online.
Read moreStructural Equation Modeling: Mixture Models
This article discusses a modeling framework that links two well‐known statistical methods: structural equation modeling (SEM) and latent class or finite mixture modeling. Mixture SEM can either be viewed as a refinement of multivariate normal (MVN) mixtures, where the within‐class covariance matrices are smoothed according to a postulated SEM structure, or as a form of multiple group SEM, in which the group variable is unobserved. After introducing standard MVN mixtures, it is shown how the SEM framework can be used to restrict the class‐specific means and covariances. Furthermore, parameter estimation, model testing, and software is discussed, and an empirical example is provided.
Read moreBayesian estimation for mean vector of multivariate normal distribution on the linear and nonlinear exponential balanced loss based on wavelet decomposition
This paper addresses the problem of Bayesian wavelet estimating the mean vector of multivariate normal distribution under a multivariate normal prior distribution based on linear and nonlinear exponential balanced loss functions. The covariance matrix of multivariate normal distribution is considered known. Bayes estimators of mean vector parameter of multivariate normal distribution are achieved. Then two soft shrinkage wavelet threshold estimators based on Stein’s unbiased risk estimate (SURE) and Bayes estimators are provided. Finally, the performance of the soft shrinkage wavelet estimators was checked through simulation study and Electrical Grid Stability Simulated data set. Simulation and real data results showed the better performance of SURE thresholds based on linear and nonlinear exponential balanced loss functions compared to other classical wavelet methods. Also, they showed better performance for SURE threshold based on nonlinear exponential balanced loss function in multivariate normal distribution with small dimensions.
Read moreDiversity sensitivity and multimodal Bayesian statistical analysis by relative entropy
A list of recognised social diversities is assembled, including those used in social action programmes in the USA. Responses to diversity are discussed and diversity sensitivity defined as the derivative of response with respect to a defining parameter of a diversity distribution. Rewards (or penalties) for diversity are listed also; sensitivities to the responses to the rewards for diversity are called diversity sensitivities of the second kind. The statistics of bimodal and multimodal distributions are discussed, including the parametric estimation of such distributions by mixtures of multivariate normal distributions. An example is considered in detail.
Read moreMultivariate slice sampling
In Bayesian decision theory, stochastic simulation techniques have been widely used by decision makers. The Markov chain Monte Carlo method (MCMC) plays a key role in stochastic simulation within the framework of Bayesian statistics. The notion of "slice sampling", or employing auxiliary variables in sampling, has been recently suggested in the literature for improving the efficiency of the traditional MCMC methods. In the existing literature, the one dimensional slice sampler has been extensively studied, yet the literature on the multidimensional case is sparse. In this study, we utilize multiple auxiliary variables in our sampling algorithms for multivariate normal distributions, which adapt better to the local properties of the target probability distributions. We show that these methods are flexible enough to allow for truncation to rectangular regions and/or the exclusion of any n dimensional hyper-quadrant. We compare these algorithms for both efficiency and accuracy via simulation experiments. Our results show that our new sampling techniques are accurate and more effective than the traditional single auxiliary variable slice sampler, especially for truncated multivariate distributions. Further, we extend our methods to general multivariate distributions including multivariate student t distributions, multivariate elliptical distributions, multivariate skew normal distributions, multivariate skew t distributions and a general class of multivariate skew elliptical distributions. We also discuss and outline some applications of our algorithms in the real business world, especially in the production and operations management and the finance areas. With regard to production and operations management, we find that the proposed multivariate normal slice sampler can be implemented in a stochastic optimization process for finding the optimal fulfillment rate of an assembly system. This system consists of n components, from which m products are assembled via a periodic review control policy. In finance area, we show that multivariate slice samplers can be used to update model parameters and predict future asset returns in a higher moments Bayesian portfolio optimization model, which is based on a general class of multivariate skew t distributions. The application of a multivariate slice sampler improves the model's ability of handling large data sets and saves computation time for deriving complicated posterior probability distributions.
Read morePatterns recognition methods to study genotypic similarity in flood-irrigated rice
Genetic diversity studies are performed based on information on a set of traits measured in a group of genotypes, considering one or more environments. The pattern recognition methods allow classifying genotypes from a set of important agronomic information. Thus, this study aimed to present and compare pattern recognition methods to inquire about the similarity of environments and genotypes in flood-irrigated rice for the recommendation of cultivars. The experim>ents were performed in the municipalities of Leopoldina, Lambari, and Janaúba, state of Minas Gerais, Brazil. To evaluate the pattern of similarity, 25 rice genotypes in three environments belonging to the flood-irrigated rice breeding program were used. Among these genotypes, five cultivars were used as an experimental control for the grain yield, the height of the plant, flowering, panicle length, grains filled by panicles, percentages of grains filled by panicles, in the 2012/2013 agricultural year. The methods us>ed were mixtures of multivariate normal distributions and density-based clustering algorithm. It was observed, therefore, that the genotypes are distributed in three distinct groups, in which there are intragroup homogeneity and intergroup heterogeneity for the agronomic traits of the flooded rice culture. The methods >used to assess the dissimilarity of environments using pattern recognition methods were efficient in classifying flooded rice irrigated environments.
Read moreGaussian Mixture Model Based Soil Classification Using Multiple Cone Penetration Tests
This study presents an application of the Gaussian mixture (GM) method for soil classification using multiple cone penetration tests (CPT). Compared to the hard clustering methods, the GM model classifies the CPT data by representing the probability density function of observed variables as a mixture of multivariate normal distributions. A GM model based expectation maximization (EM) algorithm with Bayesian information criterion (BIC) for selecting the optimal number of clusters is developed using six real CPT data performed at Dunkerque site in the north of France. The classification results are compared with the classical CPT based interpretation using the non normalized soil behavior type (SBT) index together with the Robertson chart. The results show that the GM model is able to identify accurately the soil layers. In addition, the combination of all CPTs, rather than considering them separately, may improve the soil layers identification because all the site information is considered.
Read moreA note on Bayesian inference in a regression model with elliptical errors
A note on Bayesian inference in a regression model with elliptical errors
Sample selection in the face of design constraints: Use of clustering to define sample strata for qualitative research.
To sample 40 physician organizations stratified on the basis of longitudinal cost of care measures for qualitative interviews in order to describe the range of care delivery structures and processes that are being deployed to influence the total costs of caring for patients. Three years of physician organization-level total cost of care data (n=156 in California) from the Integrated Healthcare Association's value-based pay-for-performance program. We fit total cost of care data using mixture and K-means clustering algorithms to segment the population of physician organizations into sampling strata based on 3-year cost trajectories (ie, cost curves). A mixture of multivariate normal distributions can classify physician organization cost curves into clusters defined by total cost level, shape, and within-cluster variation. K-means clustering does not accommodate differing levels of within-cluster variation and resulted in more clusters being allocated to unstable cost curves. A mixture of regressions approach focuses overly on anomalous trajectories and is sensitive to model coding. Statistical clustering can be used to form sampling strata when longitudinal measures are of primary interest. Many clustering algorithms are available; the choice of the clustering algorithm can strongly impact the resulting strata because various algorithms focus on different aspects of the observed data.
Read moreModelling the phytoplankton community in a front: a Mediterranean Sea case study.
In the ocean, fine scales (1-100 km) are short-lived structures (days to weeks) that drive ocean physics, chemistry, ecology, and can influence climate. Among them, fronts are ubiquitous fine-scale physical features that separate different water masses and create gradients of biogeochemical contents. Fronts are often associated with vertical mixing of the water column, allowing the availability of nutrients that support phytoplankton dynamics. However, how such structures affect phytoplankton distribution is not well understood, especially in oligotrophic regions. We hypothesize that the phytoplankton community observed in the frontal zone is a mixture of communities observed in the adjacent water masses, plus another community.Here, we are interested in the community composition based on nine phytoplankton functional types (PFTs) observed by flow cytometry in a front, in the western oligotrophic Mediterranean Sea. During the PROTEVSSWOT MED cruise (doi:10.17183/protevsmed_swot_2018_leg2), south of the Balearic Islands, high-resolution measurements allowed us to collect samples in the front and the two adjacent water masses along a strong salinity gradient.Our objective is to model the frontal phytoplankton community as a finite mixture of the adjacent water mass communities A and B, and a new community C. In this model, we specified that the communities in the adjacent water masses and the new community can arise from a discrete mixture of multivariate normal distributions. First, we estimated the parameters and number of components in the finite mixture for the adjacent water mass communities A and B using an Expectation Maximization algorithm. From a larger dataset, we estimated the parameters of a set of likely communities for C. Then, we developed a hierarchical Bayesian model to estimate the weight of each component of the discrete mixture. Finally, the hierarchical Bayesian model was run a second time using only the most significant components for community C.One component was sufficient to model community A (North to the front), while communities B (South to the front) and C were modeled with two components. The new community C explained a significant part of the frontal community. With very few observations in the frontal zone (n=11), our Bayesian approach highlighted the spatial distribution of the phytoplankton community around the front. Our result suggests that local environmental conditions in the front allow the emergence of a new community. This work is a first step in understanding frontal zones in an oligotrophic region, representative of the global ocean. Our modeling approach will be further applied in a larger dataset (BIOSWOT-MED cruise, doi:10.17600/18002392). In these further analyses, environmental data will be included to disentangle the physical-biological processes that shape phytoplankton distribution.This work was funded by the Institut des Mathématiques pour la Planète Terre which supports collaborations between mathematicians and life and earth sciences.
Read moreCalculating posterior distributions and modal estimates in Markov mixture models
Calculating posterior distributions and modal estimates in Markov mixture models