Bayesian multiscale tomographic reconstruction

A new multi-frame image super resolution (SR) algorithm via Bayesian modeling with natural image prior modeled by fields of experts (FoE) is proposed. Multi-frame SR can be used to obtain a high resolution (HR) image from a set of degraded low resolution (LR) images without changing any hardware device. However, SR is well known to be an ill-posed problem. So state-of-the-art solutions usually formulate the problem with Bayesian modeling techniques, which infer the HR image based on not only the LR input images but also on prior information about the HR image. Current Bayesian SR approaches typically use simple prior models such as L1 norm, TV prior and Laplacian prior, which cannot exploit the statistics of natural scenes well. In this paper, a Bayesian multi-frame image SR approach using a FOE model as the prior for natural images is presented. The Maximum a Posteriori (MAP) framework is used for estimating the HR image. The proposed method cannot only capture the statistics of natural images well, but also require less computational power than the other Bayesian modelling methods such as Sampling methods and Approximate inference. The proposed method shows superior or comparable results to the state-of-art multi-frame SR methods.

The ability to theoretically model the propagation of photon noise through PET and SPECT tomographic reconstruction algorithms is crucial in evaluating the reconstructed image quality as a function of parameters of the algorithm. In a previous approach for the important case of the iterative ML - EM (maximum-likelihood - expectation-maximization) algorithm, judicious linearizations were used to model theoretically the propagation of a mean image and a covariance matrix from one iteration to the next. Our analysis extends this approach to the case of MAP (maximum a posteriori) - EM algorithms, where the EM approach incorporates prior terms. We analyse in detail two cases: a MAP - EM algorithm incorporating an independent gamma prior, and a one-step-late (OSL) version of a MAP - EM algorithm incorporating a multivariate Gaussian prior, for which familiar smoothing priors are special cases. To validate our theoretical analyses, we use a Monte Carlo methodology to compare, at each iteration, theoretical estimates of mean and covariance with sample estimates, and show that the theory works well in practical situations where the noise and bias in the reconstructed images do not assume extreme values.

MEG source localization under multiple constraints: An extended Bayesian framework

Event Abstract Back to Event 2nd level modelling in fMRI analysis with a clinically depressed sample - Comparisons between classical and Bayesian methods Peter Goodin1, 2*, Joseph Ciorciari1, Susan Rossell1, 2, Matt Hughes1 and Richard Nibbs1 1 Swinburne University, BPsyC, Australia 2 Monash Alfred Psychiatric Research Centre, Australia The use of the Frequentist statistics in fMRI analysis has been the mainstay of the field for the last 25 years. Several other methods have been developed as alternatives, including those based on Bayesian statistics. Bayesian analysis methods have the benefit of allowing interrelation of data through effect size and confidence thresholds, can be more robust to outlier data and may negate the need for stringent multiple comparison correction. When examining functional differences in those with a mental illness , this can lead to detection of more subtle activation that may be of importance. Depression is a disorder that despite a common theme of symptoms is also characterised by functional heterogeneities between individuals, making inferences using Frequentist methods sometimes difficult. Utilising both Frequentist and Bayesian 2nd level analysis methods offered by SPM8 , we examined differences in activation between a healthy control sample and those with major depressive disorder during a novel emotional processing n-back task. Activation using classical methods showed small differences in more posterior visual regions however this was only detectable with liberal thresholding (p = .001 uncorrected, k = 0). In contrast Bayesian analysis (y = 0, 95% confidence) uncovered widespread differences (including overlap with those areas found with the Frequentist method) in multiple regions implicated with the disorder. This suggests that using Bayesian methods in fMRI analysis with a clinical population could be extremely useful in detecting responses that may otherwise go unnoticed or under-represented in more traditional methods, however determination of effect size importance is paramount. Keywords: Depression, fMRI, working memory, Bayesian, Frequentist Conference: XII International Conference on Cognitive Neuroscience (ICON-XII), Brisbane, Queensland, Australia, 27 Jul - 31 Jul, 2014. Presentation Type: Poster Topic: Methods Development Citation: Goodin P, Ciorciari J, Rossell S, Hughes M and Nibbs R (2015). 2nd level modelling in fMRI analysis with a clinically depressed sample - Comparisons between classical and Bayesian methods. Conference Abstract: XII International Conference on Cognitive Neuroscience (ICON-XII). doi: 10.3389/conf.fnhum.2015.217.00203 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 19 Feb 2015; Published Online: 24 Apr 2015. * Correspondence: Mr. Peter Goodin, Swinburne University, BPsyC, Hawthorn, Australia, peter@hitiq.com Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Peter Goodin Joseph Ciorciari Susan Rossell Matt Hughes Richard Nibbs Google Peter Goodin Joseph Ciorciari Susan Rossell Matt Hughes Richard Nibbs Google Scholar Peter Goodin Joseph Ciorciari Susan Rossell Matt Hughes Richard Nibbs PubMed Peter Goodin Joseph Ciorciari Susan Rossell Matt Hughes Richard Nibbs Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.

Random effects regression models are routinely used for clustered data in etiological and intervention research. However, in prediction models, the random effects are either neglected or conventionally substituted with zero for new clusters after model development. In this study, we applied a Bayesian prediction modelling method to the subclinical ketosis data previously collected by Van der Drift et al. (2012). Using a dataset of 118 randomly selected Dutch dairy farms participating in a regular milk recording system, the authors proposed a prediction model with milk measures as well as available test-day information as predictors for the diagnosis of subclinical ketosis in dairy cows. While their original model included random effects to correct for the clustering, the random effect term was removed for their final prediction model. With the Bayesian prediction modelling approach, we first used non-informative priors for the random effects for model development as well as for prediction. This approach was evaluated by comparing it to the original frequentist model. In addition, herd level expert opinion was elicited from a bovine health specialist using three different scales of precision and incorporated in the prediction as informative priors for the random effects, resulting in three more Bayesian prediction models. Results showed that the Bayesian approach could naturally take the clustering structure of clusters into account by keeping the random effects in the prediction model. Expert opinion could be explicitly combined with individual level data for prediction. However in this dataset, when elicited expert opinion was incorporated, little improvement was seen at the individual level as well as at the herd level. When the prediction models were applied to the 118 herds, at the individual cow level, with the original frequentist approach we obtained a sensitivity of 82.4% and a specificity of 83.8% at the optimal cutoff, while with the three Bayesian models with elicited expert opinion, we obtained sensitivities ranged from 78.7% to 84.6% and specificities ranged from 75.0% to 83.6%. At the herd level, 30 out of 118 within herd prevalences were correctly predicted by the original frequentist approach, and 31 to 44 herds were correctly predicted by the three Bayesian models with elicited expert opinion. Further investigation in expert opinion and distributional assumption for the random effects was carried out and discussed.

ABSTRACTWe consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian standpoint, we investigate the MAP (maximum a posteriori) estimator from a penalized likelihood perspective that gives rise to a new nonconvex penalty approximating the ℓ0 penalty. Optimal error rates for estimation consistency in terms of various matrix norms along with selection consistency for sparse structure recovery are shown for the unique MAP estimator under mild conditions. For fast and efficient computation, an EM algorithm is proposed to compute the MAP estimator of the precision matrix and (approximate) posterior probabilities on the edges of the underlying sparse structure. Through extensive simulation studies and a real application to a call center data, we have demonstrated the fine performance of our method compared with existing alternatives. Supplementary materials for this article are available online.

In this paper, a novel method is proposed for human segmentation in the presence of occlusion or shadows. We utilize human body shape model to interpret the foreground in a Bayesian framework. In order to reduce process time, we use head-torso model instead of full-body human shape models in the solution space of Bayesian model. We obtain MAP (Maximum a posteriori) by using MCMC (Markov chain Monte Carlo). The choice of proposal density also can avoid miss-detections caused by mistaking small targets as image noises. In our method, we firstly detect head candidates; then, we construct Bayesian model and calculate MAP of it; finally, we select optimum human models for the candidates and segment human objects precisely. In a number of human segmentation experiments, our method not only achieves good performance in occlusion situations, but also is resistant to background noises.

Objective The Bayesian model plays an important role in diagnostic test evaluation in the absence of the gold standard, which used the external prior distribution of a parameter combined with sample data to yield the posterior distribution of the test characteristics. However, the correlation between diagnostic tests has always been a problem that cannot be ignored in the Bayesian model evaluation. This study will discuss how different Bayesian model, correlation scenarios, and prior distribution affect the outcome. MethodsThe data analyzed in this study was gathered during studies of patients presenting to the Nanjing Chest Hospital with suspected tuberculosis. The diagnostic character of T-SPOT.Tb and KD38 tuberculosis antibody test were evaluated in different Bayesian model, and discharge diagnosis as a gold standard was used to verify the model results in the end. Result The comparison of four models under the conditional independence situation found that Bayesian probabilistic constraint model was consistent with the Conditional Covariance Bayesian model. The results were mainly affected by prior information. The sensitivity and specificity of the two tests in Conditional Covariance Bayesian model in prior constraint situation were considerably higher than the Bayesian probabilistic constraint model in prior constraint situation. The results of the four models under the conditional dependence situation were similar to the conditional independence situation; pD was also negative with no prior constraint situation in both model Bayesian probabilistic constraint model and Conditional Covariance Bayesian model. The Deviance Information Criterion of Bayesian probabilistic constraint model was close to model Conditional Covariance Bayesian model, but pD of Conditional Covariance Bayesian model in Prior constraint situation (pD=2.40) was higher than the Bayesian probabilistic constraint model in Prior constraint situation (pD=1.66). Conclusion The result of Conditional Covariance Bayesian model in prior constraint with conditional independence situation was closest to the result of gold standard evaluation in our data. Both of the two Bayesian methods are the feasible way for the evaluation of diagnostic test in the absence of the gold standard diagnostic. Prior source, priority number, and conditional dependencies should be considered in the method selection, the accuracy of posterior estimation mainly depending on the prior distribution.

Motivated by the many applications associated with estimation of sparse multivariate models, the estimation of sparse directional connectivity between the imperfectly measured nodes of a network is studied. Node dynamics and interactions are assumed to follow a multivariate autoregressive model driven by noise, and the observations are a noisy linear combination of the underlying node activities. The corresponding maximum a posteriori (MAP) problem is derived to estimate system parameters. Due to the intractability of the MAP problem, the expectation maximization (EM) framework is used to iteratively implement the MAP estimation. To impose sparsity, the EM algorithm is augmented with an $\ell _1$ regularization of the connectivity matrix. Multiple techniques have been used to lower the computational complexity. Importantly, an efficient coordinate descent algorithm utilizing a closed-form solution is designed to solve the $\ell _1$ -regularized sub-problem of the EM. Cholesky factors of the unknown covariance matrices are used directly in the optimization process in order to impose positive definiteness and guarantee the functionality of the $\ell _1$ optimization. The algorithm is first applied to synthetic data to evaluate the estimation accuracy. A comparison with the previous work over an extensive set of configurations shows that our method is superior under moderate to high sparsity. Finally, the algorithm is applied to real temperature data obtained from 98 stations across the U.S. mainland to identify the predictive interactions between the time series.

Objective: The paper aims to model Health-and-Social-Care (H&Sc) services as Cause–Effect (CE) groups within a Bayesian framework, using cross- and self-causation dynamics. The contribution is that the data used are open and never studied before and are posted online by National Health Services Scotland (NHSS). Method and Material: The paper contributes to the ongoing discourse on how Machine Learning(ML), and Bayesian inference, can inform the purposes of policymaking. Cause–effect relationships and Bayesian methods can associate public services as causes-effects, through suitable likelihood functions and priors that binomial and normal distributions can imlplement. The study identified the optimal predictive distribution using the Maximum-a-Posteriori (MAP) estimation method. Moreover, the CE-matrix approach, enables the representation of multiple causes linked to a single effect-target in a tabular format, that facilitates interpretability and prediction. Results: The findings indicate that services related to 'Alcohol' can be predictors of other effect-services, while home-based services were identified as causes of subsequent hospital admissions. Moreover, low-demand services were observed in earlier years, particularly those with no records after 1997, whereas higher-demand services were newly introduced in later years. These findings may offer insights into latent inter-service relationships, and inform policy development. The cross- and self-causation in a Bayesian framework, determined that the posterior can be predicted by 5 to 10 previous observations and this is significantly affected by the level of zero-padding (percentage of past no-records). In later years, the CE models yield more probable demand patterns. Cause–effect relationships were identified between smoking-related services, mental-health support, and the epidemiological index of Primary-1-Education children's Body-Mass-Index (BMI). Conclusions: The conclusions drawn from this analysis may be particularly relevant for insurance providers and public policymakers, who can leverage Bayesian CE-linked service models for long-term care planning, especially for elderly and low-income populations. The validation of ser-vice interlinkages further enhances the potential for precise and efficient resource allocation.

Bayesian models of cognition provide a powerful way to understand the behavior and goals of individuals from a computational point of view. Much of the focus in the Bayesian cognitive modeling approach has been on qualitative model evaluations, where predictions from the models are compared to data that is often averaged over individuals. In many cognitive tasks, however, there are pervasive individual differences. We introduce an approach to directly infer individual differences related to subjective mental representations within the framework of Bayesian models of cognition. In this approach, Bayesian data analysis methods are used to estimate cognitive parameters and motivate the inference process within a Bayesian cognitive model. We illustrate this integrative Bayesian approach on a model of memory. We apply the model to behavioral data from a memory experiment involving the recall of heights of people. A cross-validation analysis shows that the Bayesian memory model with inferred subjective priors predicts withheld data better than a Bayesian model where the priors are based on environmental statistics. In addition, the model with inferred priors at the individual subject level led to the best overall generalization performance, suggesting that individual differences are important to consider in Bayesian models of cognition.

This paper presents a new two-step pseudo maximum a posteriori (MAP) segmentation method for the Markov random field (MRF)-modeled image because the exact MAP estimation is hard to implement due to intractable complexity. The expectation maximization (EM) and Markov Chain Monte Carlo (MCMC) methods are adopted to estimate the parameters for the MRF model due to their comparatively good performance. Although the image segmentation algorithms via graph cuts have become very popular nowadays, our proposed algorithm still performs significantly better in automatic identification and segmentation of fuzzy images than them, which is shown by the quantitative results on synthesized images. In practical applications, the proposed two-step pseudo MAP method is superior in segmenting the fuzzy laser images reflected from the weld pool surfaces during the P-GMAW welding process.

In this paper, we present two finite-dimensional iterative algorithms for maximum a posteriori (MAP) state sequence estimation of bilinear systems. Bilinear models are appealing in their ability to represent or approximate a broad class of nonlinear systems. Our iterative algorithms for state estimation are based on the expectation-maximization (EM) algorithm and outperform the widely used extended Kalman smoother (EKS). Unlike the EKS, these EM algorithms are optimal (in the MAP sense) finite-dimensional solutions to the state sequence estimation problem for bilinear models. We also present recursive (on-line) versions of the two algorithms and show that they outperform the extended Kalman filter (EKF). Our main conclusion is that the EM-based algorithms presented in this paper are novel nonlinear filtering methods that perform better than traditional methods such as the EKF.

What to believe: Bayesian methods for data analysis

In this paper, we develop a Bayesian inference model for the degree of human trust in multiple mobile robots. A linear model for robot performance in navigation and perception is first devised. We then propose a computational trust model for the human multi-robot team based on a dynamic Bayesian network (DBN). In the trust DBN, the robot performance is the network input, the human trust feedback to each individual robot and the human intervention are the outputs (observations). The categorical Boltzmann machine is used to capture the multinomial distributions that model the conditional dependencies of the DBN. We introduce the expectation maximization (EM) algorithm for the model learning and personalization. A factorial form of the EM algorithm is adopted for the multi-robot system where each robot has its corresponding latent trust state in the human mind. Bayesian inference is conducted to find the trust states, i.e., the trust belief. Based on the inferred trust states, we further derive the formulation to predict human interventions for model validation. A simulated human-UAV collaborative search mission is conducted with humans-in-the-loop. The experiment results show the Bayesian trust inference model can infer the degrees of human trust in multiple mobile robots and also predict human interactions with relatively high accuracy (72.2 $$\%$$ ). These findings confirm the effectiveness of DBNs in modeling human trust towards multi-robot systems.