Algorithm Study of Infrared Image MMSE Filtering

The problem of distributed parameter estimation from binary quantized observations is studied when the unquantized observations are corrupted by combined multiplicative and additive Gaussian noise. These results are applicable to sensor networks where the sensors observe a parameter in combined additive and nonadditive noise and to a case where dispersed receivers are employed with analog communication over fading channels where the receivers employ binary quantization before noise-free digital communications to a fusion center. We first discuss the case in which all the quantizers use an identical threshold. The parameter identifiability condition is given, and, surprisingly, it is shown that unless the common threshold is chosen properly and the parameter lies in an open interval, the parameter will not generally be identifiable, in contrast to the additive noise case. The best achievable mean square error (MSE) performance is characterized by deriving the corresponding Cramer-Rao Lower Bound (CRLB). A closed-form expression describing the corresponding maximum likelihood (ML) estimator is presented. The stability of the performance of the ML estimators is improved when a nonidentical threshold strategy is utilized to estimate the unknown parameter. The thresholds are designed by maximizing the minimum asymptotic relative efficiency (ARE) between quantized and unquantized ML estimators. Although the ML estimation problem is nonconvex, it is shown that one can relax the optimization to make it convex. The solution to the relaxed problem is used as an initial solution in a gradient algorithm to solve the original problem. Next, the case where both the variances of the additive noise and multiplicative noise are unknown is studied. The corresponding CRLB is obtained, and the ML estimation problem is transformed to a convex optimization, which can be solved efficiently. Finally, numerical simulations are performed to substantiate the theoretical analysis.

Minimum mean square error estimation in linear regression

We consider the problem of localizing a source by means of a sensor array when the received signal is corrupted by multiplicative noise. This scenario is encountered, for example, in communications, owing to the presence of local scatterers in the vicinity of the mobile or due to wavefronts that propagate through random inhomogeneous media. Since the exact maximum likelihood (ML) estimator is computationally intensive, two approximate solutions are proposed, originating from the analysis of the high and low signal to-noise ratio (SNR) cases, respectively. First, starting with the no additive noise case, a very simple approximate ML (AML/sub 1/) estimator is derived. The performance of the AML/sub 1/ estimator in the presence of additive noise is studied, and a theoretical expression for its asymptotic variance is derived. Its performance is shown to be close to the Cramer-Rao bound (CRB) for moderate to high SNR. Next, the low SNR case is considered, and the corresponding AML/sub 2/ solution is derived. It is shown that the approximate ML criterion can be concentrated with respect to both the multiplicative and additive noise powers, leaving out a two-dimensional (2-D) minimization problem instead of a four-dimensional (4-D) problem required by the exact ML. Numerical results illustrate the performance of the estimators and confirm the validity of the theoretical analysis.

A unified treatment for performance evaluation of various array signal processors is presented. Detection performance is expressed in terms of the parameter of the power-type receiver operating characteristic (ROC) for optimum, beamformer, and null-steerer detectors. Estimation performance is analyzed in terms of the normalized mean-square error (MSE) for minimum mean-square error (MMSE) and maximum likelihood estimators (MLE's) under a varying noise environment. Sensitivity of the detection/estimation performance to the varying internal and directional noise sources is investigated. An interesting inverse relationship is presented between the normalized MSE of the MMSE estimator and the power-type ROC parameter for the optimum detector.

A Bayesian estimation approach for enhancing speech signals which have been degraded by statistically independent additive noise is motivated and developed. In particular, minimum mean square error (MMSE) and maximum a posteriori (MAP) signal estimators are developed using hidden Markov models (HMMs) for the clean signal and the noise process. It is shown that the MMSE estimator comprises a weighted sum of conditional mean estimators for the composite states of the noisy signal, where the weights equal the posterior probabilities of the composite states given the noisy signal. The estimation of several spectral functionals of the clean signal such as the sample spectrum and the complex exponential of the phase is also considered. A gain-adapted MAP estimator is developed using the expectation-maximization algorithm. The theoretical performance of the MMSE estimator is discussed, and convergence of the MAP estimator is proved. Both the MMSE and MAP estimators are tested in enhancing speech signals degraded by white Gaussian noise at input signal-to-noise ratios of from 5 to 20 dB. >

We derive an optimum filter function to detect a target degraded by multiplicative noise and additive overlapping noise and placed in background noise. The filter is designed to maximize the metric peak-to-output energy, which is the ratio of the expected value squared of the output peak at the target position to the expected value of the average output energy. The optimum filter provides improved discrimination as well as robustness to input noise. One advantage of the filter described here over the homomorphic filters is that the additional preprocess on the input image, that is, the input logarithmic operation, is not required for reducing the effects of multiplicative noise. The performance of the filter is examined in terms of discrimination against background noise and robustness to multiplicative and additive input noise. Both multiplicative amplitude noise and multiplicative complex noise are considered.

Orthogonal frequency division multiplexing (OFDM) systems may experience significant intercarrier interference (ICI) when used in time- and frequency-selective, or doubly-selective, channels. In such cases, the classical symbol estimation schemes, e.g., minimum mean-squared error (MMSE) and zero-forcing (ZF) estimation, require matrix inversion that is prohibitively complex for large symbol lengths. An analysis of the ICI generation mechanism leads us to propose a novel two-stage equalizer whose complexity (apart from the FFT) is linear in the OFDM symbol length. The first stage applies optimal linear preprocessing to restrict ICI support and the second stage uses iterative MMSE estimation to estimate finite-alphabet frequency-domain symbols. Simulation results indicate that our equalizer has significant performance and complexity advantages over the classical linear MMSE estimator in doubly-selective channels.

Analysis of noise-induced transitions for Hopf system with additive and multiplicative random disturbances

This paper proposes a new precoding approach that utilizes two-dimension (2D) Angle of Arrival (AOA) based precoding (beamforming) approach for multi-cell massive Multiple Input Multiple Output (m-MIMO) systems. The proposed approach enhances the performance of m-MIMO systems by overcoming pilot contamination that is caused by corrupted Channel State Information. It exploits the spatial properties of the propagated signals to distinguish between various users in the multi-cell m-MIMO system and selects the partial space for beamforming based on AOA information to suppress inter-cell and intra-cell interference. We mathematically analyze the impact of pilot contamination in the uplink training and determine the closed-form approximation of uplink Minimum Mean Square Error (MMSE) estimator. By using MMSE estimator as well as 2D AOA and channel estimation, a corresponding MMSE precoding which minimizes the effect of pilot contamination and improves the downlink achievable rate of the system is proposed. Furthermore, a comparison is made of the resolution between the various 2D AOA estimations for an m-MIMO and the optimum values closest bound for the proposed precoding was chosen to reduce pilot contamination. The performance of the proposed MMSE precoding based on 2D AOA estimation methods: 2D Unitary Estimation of Signal Parameters via Rotational Invariance Techniques (2D UESPRIT), 2D Fourier Domain Line Search MUSIC (2D FDLSM), and 2D Propagator Method (2D PM)) were evaluated and compared with pilot contaminated system and deterministic MMSE precoding in terms of their respective achievable rate. Simulation results reveal that the achievable sum rate gains of 2D UESPRIT, 2D FDLSM, and 2D PM based precoding which achieved 97.6%, 92.4%, 86.3% of the desired deterministic performance, respectively, compared to pilot contaminated system, which achieved only 90% even when in the best case of having only one contaminated user out of all users within the activated cell. Findings from our research indicate the feasibility of utilizing the AOA based beamforming to reduce pilot contamination effect that is inherent in a larger order m-MIMO system for the Fifth Generation (5G) wireless transmissions.

This paper considers multi-cell massive multiple-input multiple-output systems, where the channels are spatially correlated Rician fading. The channel model is composed of a deterministic line-of-sight path and a stochastic non-line-of-sight component describing a practical spatially correlated multipath environment. We derive the statistical properties of the minimum mean squared error (MMSE), element-wise MMSE, and least-square channel estimates for this model. Using these estimates for maximum ratio combining and precoding, rigorous closed-form uplink (UL) and downlink (DL) achievable spectral efficiency (SE) expressions are derived and analyzed. The asymptotic SE behavior, when using the different channel estimators, are also analyzed. The numerical results show that the SE is higher when using the MMSE estimator than that of the other estimators, and the performance gap increases with the number of antennas.

In this paper we investigate the block- type pilot channel estimation for orthogonal frequency division multiplexing (OFDM) systems. The estimation is based on the minimum mean square error (MMSE) estimator and the least square (LS) estimator. We derive the MMSE and LS estimators’ architecture and investigate their performances. We prove that the MMSE estimator performance is better but computational complexity is high, contrary the LS estimator has low complexity but poor performance. For reducing complexity we proposed two different solutions which are the Simplified Least Square (SLS) estimator and the modified MMSE estimator. In the SLS estimator, we apply an auto-correlation function with the LS estimator to remove the noise. In the modified MMSE estimator, we consider only the significant energy samples and ignore the remaining noisy samples. Based on this idea we introduce the modified MMSE estimator. We evaluate estimator’s performance on basis of mean square error and symbol error rate for 16 QAM systems using MATLAB.

Current reversal in a continuously periodic system driven by an additive noise and a multiplicative noise

The issues are considered, associated with the estimation of the measurement accuracy of the information parameters of the useful signal in the conditions of simultaneous action of multiplicative and additive noise, which in general have non-Gaussian character of the distribution. Two approaches to representation of the multiplicative noise are analyzed. It is shown that when considering of multiplicative noise in the form of deterministic or quasideterministic process the measurement accuracy is affected as non-Gaussian nature of the additive noise and average power of the multiplicative noise. It is shown that with the increase of the average power of the multiplicative noise effect of non-Gaussian nature of the additive noise on the measurement accuracy is reduced. It is shown that if the multiplicative noise is a random process, then the potential measurement accuracy under its influence can be reduced by more than an order of magnitude. Accounting non-Gaussian character of equivalent noise formed by additive noise and a multiplicative part, leads to a significant reduction in the potential loss of measurement accuracy.

In many cases, one needs to estimate a target that is obscured by the sidelobes of a very large, adjacent scatterer. For example, the Earth's surface can ruin nearsurface rain-rate measurements obtained from an airborne platform, or it can prevent a ground-penetrating radar from detecting land mines located at shallow depth. In these cases, the range sidelobes of the ground are larger than the targets near the surface. The range sidelobes cannot be optimally controlled because target information is not used. However, in most situations the location and magnitude of such a large scatterer can be predicted. In this paper, a minimum meansquared error (MMSE) estimator is proposed to improve the range sidelobe problem. The MMSE estimator uses information about the scenario to find the optimum processing filter. Simulated results are provided to demonstrate the effectiveness of this process.

Accurate orientation estimation is a crucial component of 3D molecular structure reconstruction, both in single-particle cryo-electron microscopy (cryo-EM) and in the increasingly popular field of cryo-electron tomography (cryo-ET). The dominant approach, which involves searching for the orientation that maximizes cross-correlation relative to given templates, is sub-optimal, particularly under low signal-to-noise conditions. In this work, we propose a Bayesian framework for more accurate and flexible orientation estimation, with the minimum mean square error (MMSE) estimator serving as a key example. Through simulations, we demonstrate that the MMSE estimator consistently outperforms the cross-correlation-based method, especially in challenging low signal-to-noise scenarios, and we provide a theoretical framework that supports these improvements.When incorporated into iterative refinement algorithms in the 3D reconstruction pipeline, the MMSE estimator markedly improves reconstruction accuracy, reduces model bias, and enhances robustness to the “Einstein from Noise” artifact. Crucially, we demonstrate that orientation estimation accuracy has a decisive effect on downstream structural heterogeneity analysis. In particular, integrating the MMSE-based pose estimator into frameworks for continuous heterogeneity recovery yields accuracy improvements approaching those obtained with ground-truth poses, establishing MMSE-based pose estimation as a key enabler of high-fidelity conformational landscape reconstruction. These findings indicate that the proposed Bayesian framework could substantially advance cryo-EM and cryo-ET by enhancing the accuracy, robustness, and reliability of 3D molecular structure reconstruction, thereby facilitating deeper insights into complex biological systems.