Bayesian and Maximum Likelihood Estimation of the Weibull-Power Function Scale Parameter: A Loss-Function Comparison Study

To analyze the performance of various estimators, this paper compares Bayesian and classical estimate approaches across a variety of loss functions. The work focuses on informative versus non-informative priors in Bayesian estimation. The calculations are based on a number of loss functions, including the Square Error Loss Function (SELF), Quadratic Loss Function (QLF), Precautionary Loss Function (PLF), and Entropy Loss Function (ELF). The methodology uses simulation techniques as well as real-world datasets to test the performance and robustness of the proposed estimators. The Bayesian estimators, classical estimators, and related Bayes hazards using empirical analysis and extensive simulations to computed. The findings show that the Minimum Mean Square Error estimator (MiniMSE) is more accurate and reliable than other estimators in a variety of settings. Furthermore, for both types of priors, it is demonstrated that the Bayes risk under the Quadratic Loss Function (QLF) is the lowest among all loss functions considered, including SELF, PLF, and ELF. This suggests that, when compared to other loss functions, QLF is a more effective and balanced criterion for making estimation decisions. The study’s findings provide vital new insights into how to choose the optimum estimate techniques and loss functions for statistical decision theory and practical data processing.

ABSTRACTBayesian analysis of 3-component mixture model, of exponentiated Weibull distribution under type-I right censoring scheme, is explored in this study. With the help of non-informative (uniform and Jeffreys) priors and loss functions (e.g. squared error loss function, quadratic loss function, precautionary loss function and DeGroot loss function), Bayes estimators and posterior risks are derived. The Bayes estimators and posterior risks are observed as a function of the test termination time. Simulation study as well as a practical example is given in this study.

In this paper, Bayes estimators of the unknown shape and scale parameters of the Exponentiated Inverse Rayleigh Distribution (EIRD) have been derived using both the frequentist and bayesian methods. The Bayes theorem was adopted to obtain the posterior distribution of the shape and scale parameters of an Exponentiated Inverse Rayleigh Distribution (EIRD) using both conjugate and non-conjugate prior distribution under different loss functions (such as Entropy Loss Function, Linex Loss Function and Scale Invariant Squared Error Loss Function). The posterior distribution derived for both shape and scale parameters are intractable and a Lindley approximation was adopted to obtain the parameters of interest. The loss function were employed to obtain the estimates for both scale and shape parameters with an assumption that the both scale and shape parameters are unknown and independent. Also the Bayes estimate for the simulated datasets and real life datasets were obtained. The Bayes estimates obtained under dierent loss functions are close to the true parameter value of the shape and scale parameters. The estimators are then compared in terms of their Mean Square Error (MSE) using R programming language. We deduce that the MSE reduces as the sample size (n) increases.

In this paper, we developed linear exponential (LINEX) loss function by emerging weights to produce weighted linear exponential (WLINEX) loss function. Then we utilized WLINEX to derive scale parameter and reliability function of the Weibull distribution based on record values when the shape parameter is known. After, we estimated scale parameter and reliability function of Weibull distribution by using maximum likelihood (ML) estimation and by several Bayes estimations. The Bayes estimates were obtained with respect to symmetric loss function (squared error loss (SEL)), asymmetric loss function (LINEX) and asymmetric loss function (WLINEX). The ML and the different Bayes estimates are compared via a Monte Carlo simulation study. The result of simulation mentioned that the proposed WLINEX loss function is promising and can be used in real environment especially at the case of underestimate where it revealed better performance than LINEX loss function for estimating scale parameter.

In this paper, Bayes estimators of the parameter of Maxwell distribution have been derived along with maximum likelihood estimator. The non-informative priors; Jeffreys and the extension of Jeffreys prior information has been considered under two different loss functions, the squared error loss function and the modified squared error loss function for comparison purpose. A simulation study has been developed in order to gain an insight into the performance on small, moderate and large samples. The performance of these estimators has been explored numerically under different conditions. The efficiency for the estimators was compared according to the mean square error MSE. The results of comparison by MSE show that the efficiency of Bayes estimators of the shape parameter of the Maxwell distribution decreases with the increase of Jeffreys prior constants. The results also show that values of Bayes estimators are almost close to the maximum likelihood estimator when the Jeffreys prior constants are small, yet they are identical in some certain cases. Comparison with respect to loss functions show that Bayes estimators under the modified squared error loss function has greater MSE than the squared error loss function especially with the increase of r.

The Gompertz-Lindley distribution is an extension of the Lindley distribution with three parameters. It was found to be more flexible for modeling real life events. The distribution contains two shape parameters and a scale parameter. Despite the necessity of parameter estimation theory in modeling, it has not been shown that a method of estimation method is better for any of these three parameters of the Gompertz-Lindley distribution. This paper identifies the best estimation method for the shape parameter of the Gompertz-Lindley distribution by deriving Bayesian estimators for the shape parameter of the distribution using two non-informative prior distributions (Uniform and Jeffery) and an informative prior (gamma) under squared error loss function (SELF), quadratic loss function (QLF) and precautionary loss function (PLF). These estimators were evaluated and the results compared with the maximum likelihood estimation method using Monte Carlo simulations with the mean square error (MSE) as a criterion for choosing the best estimator.

This paper investigates the problem of entropy estimation for the generalized Rayleigh distribution under progressively type-II censored samples. Based on progressively type-II censored samples, we first discuss the maximum likelihood estimation and interval estimation of Shannon entropy for the generalized Rayleigh distribution. Then, we explore the Bayesian estimation problem of entropy under three types of loss functions: K-loss function, weighted squared error loss function, and precautionary loss function. Due to the complexity of Bayesian estimation computation, we use the Lindley approximation and MCMC method for calculating Bayesian estimates. Finally, using a Monte Carlo statistical simulation, we compare the mean square errors to examine the superiority of maximum likelihood estimation and Bayesian estimation under different loss functions. An actual example is provided to verify the feasibility and practicality of various estimations.

This paper studies estimation of the parameters of the generalized Gompertz distribution based on ranked-set sample (RSS). Maximum likelihood (ML) and Bayesian approaches are considered. Approximate confidence intervals for the unknown parameters are constructed using both the normal approximation to the asymptotic distribution of the ML estimators and bootstrapping methods. Bayes estimates and credible intervals of the unknown parameters are obtained using differential evolution Markov chain Monte Carlo and Lindley’s methods. The proposed methods are compared via Monte Carlo simulations studies and an example employing real data. The performance of both ML and Bayes estimates is improved under RSS compared with simple random sample (SRS) regardless of the sample size. Bayes estimates outperform the ML estimates for small samples, while it is the other way around for moderate and large samples.

This paper is concerned with problem of comparing different estimators of the scale parameter of two parameters weibull distribution where is shape parameter and is scale parameter and then comparing the efficiency of the estimators which are maximum likelihood and minimax estimator with (quadratic loss function) ,median method and moment method. the comparison was done using simulation procedure with different sample size and values of parameters ,on the bases of simulation experiment we conclude that minimax method with quadratic loss function was the best method at all sample size and values of parameters.

Bayesian analysis of the 3-component mixture of an Exponential distribution under type-I right censoring scheme is considered in this paper. The Bayes estimators and posterior risks for the unknown parameters are derived under squared error loss function, precautionary loss function and DeGroot loss function assuming the non-informative (uniform and Jeffreys') priors. The Bayes estimators and posterior risks are viewed as a function of the test termination time. A simulation study is given to highlight and compare the properties of the Bayes estimates.

Reliability analysis is the key to evaluate software’s quality. Since the early 1970s, the Power Law Process, among others, has been used to assess the rate of change of software reliability as time-varying function by using its intensity function. The Bayesian analysis applicability to the Power Law Process is justified using real software failure times. The choice of a loss function is an important entity of the Bayesian settings. The analytical estimate of likelihood-based Bayesian reliability estimates of the Power Law Process under the squared error and Higgins-Tsokos loss functions were obtained for different prior knowledge of its key parameter. As a result of a simulation analysis and using real data, the Bayesian reliability estimate under the Higgins-Tsokos loss function not only is robust as the Bayesian reliability estimate under the squared error loss function but also performed better, where both are superior to the maximum likelihood reliability estimate. A sensitivity analysis resulted in the Bayesian estimate of the reliability function being sensitive to the prior, whether parametric or non-parametric, and to the loss function. An interactive user interface application was additionally developed using Wolfram language to compute and visualize the Bayesian and maximum likelihood estimates of the intensity and reliability functions of the Power Law Process for a given data.

Empirical Bayes analysis of record statistics based on linex and quadratic loss functions

The maximum likelihood and Bayesian approaches for parameter estimations and prediction of future record values have been considered for the two-parameter Burr Type XII distribution based on record values with the number of trials following the record values (inter-record times). Firstly, the Bayes estimates are obtained based on a joint bivariate prior for the shape parameters. In this case, the Bayes estimates of the parameters have been developed by using Lindley's approximation and the Markov Chain Monte Carlo (MCMC) method due to the lack of explicit forms under the squared error and the linear-exponential loss functions. The MCMC method has been also used to construct the highest posterior density credible intervals. Secondly, the Bayes estimates are obtained with respect to a discrete prior for the first shape parameter and a conjugate prior for other shape parameter. The Bayes and the maximum likelihood estimates are compared in terms of the estimated risk by the Monte Carlo simulations. We further consider the non-Bayesian and Bayesian prediction for future lower record arising from the Burr Type XII distribution based on record data. The comparison of the derived predictors is carried out by using Monte Carlo simulations. A real data are analysed for illustration purposes.

Latent growth models (LGMs) are an application of structural equation modeling and frequently used in developmental and clinical research to analyze change over time in longitudinal outcomes. Maximum likelihood (ML), the most common approach for estimating LGMs, can fail to converge or may produce biased estimates in complex LGMs especially in studies with modest samples. Bayesian estimation is a logical alternative to ML for LGMs, but there is a lack of research providing guidance on when Bayesian estimation may be preferable to ML or vice versa. This study compared the performance of Bayesian versus ML estimators for LGMs by evaluating their accuracy via Monte Carlo (MC) simulations. For the MC study, longitudinal data sets were generated and estimated using LGM via both ML and Bayesian estimation with three different priors, and parameter recovery across the two estimators was evaluated to determine their relative performance. The findings suggest that ML estimation is a reasonable choice for most LGMs, unless it fails to converge, which can occur with limiting data situations (i.e., just a few time points, no covariate or outcome, modest sample sizes). When models do not converge using ML, we recommend Bayesian estimation with one caveat that the influence of the priors on estimation may have to be carefully examined, per recent recommendations on Bayesian modeling for applied researchers.

This study presents a comprehensive analysis of Bayesian estimation techniques for the parameters of the power Rayleigh (PR) distribution under a unified hybrid censoring scheme (UHCS). The research employs both Bayesian and Frequentist approaches, utilizing maximum likelihood estimation (MLE) alongside Bayesian estimates derived through Markov Chain Monte Carlo (MCMC) methods. The study incorporates symmetric and asymmetric loss functions, specifically general entropy (GE), linear expoential (LINEX), and squared error (SE), to evaluate the performance of the estimators. A Monte Carlo simulation study is conducted to assess the effectiveness of the proposed methods, revealing that Bayesian estimators generally outperform Frequentist estimators in terms of mean squared error (MSE). Additionally, the paper includes a real-world application involving ball bearing lifetimes, demonstrating the practical utility of the proposed estimation techniques. The findings indicate that both point and interval estimates exhibit strong properties for parameter estimation, with Bayesian estimates being particularly favored for their accuracy and reliability.