Quantile and Expectile Regression

Quantile regression is a regression method that modelling a relationship between quantile of variable response and one or more variable predictors. Quantile regression has advantages that linear regression does not have; it is robust against outliers and can model heteroscedasticity data. The parameters of quantile regression can be estimated using the Bayesian method. The Bayesian method is a data analysis tool derived based on the Bayesian inference principle. Bayesian inference is the process of studying data analysis inductively with the Bayes theorem. To estimate regression parameters with Bayesian inference, it is necessary to find the posterior distribution of the regression parameters where the posterior distribution is proportional to the product of the prior distribution and its likelihood function. Since the calculation of the posterior distribution analytically is difficult to do if more parameters are estimated, the Markov Chain Monte Carlo (MCMC) method is proposed. The use of the Bayesian method in quantile regression has advantages, namely the use of MCMC has the advantages of obtaining sample parameter values from an unknown posterior distribution, using computationally efficient, and easy to implement. Yu and Moyeed (2001) introduced Bayesian quantile regression using the likelihood function of errors with an Asymmetric Laplace Distribution (ALD) and found that minimizing parameter estimates in quantile regression is the same as maximizing the likelihood function of errors with an Asymmetric Laplace Distribution (ALD). The method used to estimate quantile regression parameters is Gibbs sampling from the ALD, which is a combination of the exponential and normal distributions. To find the parameters of the regression model by sampling the posterior distribution found in this thesis. The results obtained from Gibbs sampling are a sample sequence of estimated parameters. After obtaining the sample sequences, the sample lines are averaged to obtain an estimated regression parameter. The case study in this thesis discusses the effect of risk factors from motor vehicle insurance customers on the size of claims submitted by customers.

This study aims to construct the model for the length of hospital stay for patients with COVID-19 using quantile regression and Bayesian quantile approaches. The quantile regression models the relationship at any point of the conditional distribution of the dependent variable on several independent variables. The Bayesian quantile regression combines the concept of quantile analysis into the Bayesian approach. In the Bayesian approach, the Asymmetric Laplace Distribution (ALD) distribution is used to form the likelihood function as the basis for formulating the posterior distribution. All 688 patients with COVID-19 treated in M. Djamil Hospital and Universitas Andalas Hospital in Padang City between March-July 2020 were used in this study. This study found that the Bayesian quantile regression method results in a smaller 95% confidence interval and higher value than the quantile regression method. It is concluded that the Bayesian quantile regression method tends to yield a better model than the quantile method. Based on the Bayesian quantile regression method, it investigates that the length of hospital stay for patients with COVID-19 in West Sumatra is significantly influenced by Age, Diagnoses status, and Discharge status.

In this paper, portfolio selection problem is studied under Asymmetric Laplace Distribution(ALD) framework. Asymmetric Laplace distribution is able to capture tail-heaviness, skewness, andleptokurtosis observed in empirical financial data that cannot be explained by traditional Gaussiandistribution. Under Asymmetric Laplace distribution framework, portfolio selection methods basedon di erent risk measures are discussed. Moreover, we derived the Expectation-Maximization (EM)procedure for parameter estimation of Asymmetric Laplace distribution. Performance of the proposedmethod is illustrated via extensive simulation studies. Two real data examples are complemented toconfirm that the Asymmetric Laplace distribution based portfolio selection models are effcient.

Variational Bayesian inference for interval regression with an asymmetric Laplace distribution

This paper studies a quantile regression under asymmetric Laplace distribution (semi-parametric model) with interval valued data. Generally, the center point of the interval data has been used to represent the sample data for estimated parameter of the model. This paper uses the convex combination method to find the best point to estimate parameter in the quantile regression model. We apply the quantile capital asset pricing model (quantile CAPM) to present the result.

This paper proposes a new approach to analyze stock return asymmetry and quantiles. We also present a new scale mixture of uniform (SMU) representation for the asymmetric Laplace distribution (ALD). The use of the SMU for a probability distribution is a data augmentation technique that simplifies the Gibbs sampler of the Bayesian Markov chain Monte Carlo algorithms. We consider a stochastic volatility (SV) model with an ALD error distribution. With the SMU representation, the full conditional distribution for some parameters is shown to have closed form. It is also known that the ALD can be used to obtain the coefficients of quantile regression models. This paper also considers a quantile SV model by fixing the skew parameter of the ALD at specific quantile level. Simulation study shows that the proposed methodology works well in both SV and quantile SV models using Bayesian approach. In the empirical study, we analyze index returns of the stock markets in Australia, Japan, Hong Kong, Thailand, and the UK and study the effect of S&P 500 on these returns. The results show the significant return asymmetry in some markets and the influence by S&P 500 in all markets at all quantile levels. Copyright © 2014 John Wiley & Sons, Ltd.

This paper studies the connections among quantile regression, the asymmetric Laplace distribution, maximum likelihood and maximum entropy. We show that the maximum likelihood problem is equivalent to the solution of a maximum entropy problem where we impose moment constraints given by the joint consideration of the mean and median. Using the resulting score functions we propose an estimator based on the joint estimating equations. This approach delivers estimates for the slope parameters together with the associated “most probable” quantile. Similarly, this method can be seen as a penalized quantile regression estimator, where the penalty is given by deviations from the median regression. We derive the asymptotic properties of this estimator by showing consistency and asymptotic normality under certain regularity conditions. Finally, we illustrate the use of the estimator with a simple application to the U.S. wage data to evaluate the effect of training on wages.

Bayesian analysis of a Tobit quantile regression model

Varying coefficient model (VCM) is extensively used in various scientific fields due to its capability of capturing the changing structure of predictors. Classical mean regression analysis is often complicated in the existence of skewed, heterogeneous and heavy-tailed data. For this purpose, this work employs the idea of model averaging and introduces a novel comprehensive approach by incorporating quantile-adaptive weights across different quantile levels to further improve both least square (LS) and quantile regression (QR) methods. The proposed procedure that adaptively takes advantage of the heterogeneous and sparse nature of input data can gain more efficiency and be well adapted to extreme event case and high-dimensional setting. Motivated by its nice properties, we develop several robust methods to reveal the dynamic close-to-truth structure for VCM and consistently uncover the zero and nonzero patterns in high-dimensional scientific discoveries. We provide a new iterative algorithm that is proven to be asymptotic consistent and can attain the optimal nonparametric convergence rate given regular conditions. These introduced procedures are highlighted with extensive simulation examples and several real data analyses to further show their stronger predictive power compared with LS, composite quantile regression (CQR) and QR methods.

Linear mixed-effects models are powerful tools for analyzing complex datasets with longitudinal data, but any violation of model assumptions, such as heteroscedasticity, implies invalidity of the model. We develop a new estimator based on the asymmetric Laplace distribution, which explains the heteroscedasticity between different groups of data, establishing its asymptotic properties. Our model focuses on the determination of the data dispersion. Using the permissive formalism of the asymmetric Laplace distribution, we demonstrate the asymptotic properties of a class of estimators defined by a generalized optimization problem inspired by maximum likelihood. More generally, this article highlights the theoretical opportunities offered by the asymmetric Laplace distribution in the framework of linear mixed models and longitudinal data.

We used a quantile regression under asymmetric Laplace distribution for predicting stock returns. Specifically, we apply this method to the classical capital asset pricing model (CAPM) to estimate the beta coefficient which measure risk in the portfolios management analysis at given levels of quantile. Quantile regression estimation is equivalent to the parametric case where the error term is asymmetrically Laplace distributed. Finally, we use the method to measures the volatility of a portfolio relative to the market.

The ‐quantile regression generalizes both quantile regression and expectile regression, and has become popular for its robustness and effectiveness especially when . In this paper, we consider the data that are inherently distributed and propose two distributed ‐quantile regression estimators for a preconceived low‐dimensional parameter in the presence of high‐dimensional extraneous covariates. To handle the impact of high‐dimensional nuisance parameters, we first investigate regularized projection score for estimating low‐dimensional parameter of main interest in ‐quantile regression. To deal with the distributed data, we further propose two communication‐efficient surrogate projection score estimators and establish their theoretical properties. The finite‐sample performance of the proposed estimators is studied through simulations and an application to Communities and Crime data set is also presented.

Mixture of linear regression models provide a popular treatment for modeling nonlinear regression relationship. The traditional estimation of mixture of regression models is based on Gaussian error assumption. It is well known that such assumption is sensitive to outliers and extreme values. To overcome this issue, a new class of finite mixture of quantile regressions (FMQR) is proposed in this article. Compared with the existing Gaussian mixture regression models, the proposed FMQR model can provide a complete specification on the conditional distribution of response variable for each component. From the likelihood point of view, the FMQR model is equivalent to the finite mixture of regression models based on errors following asymmetric Laplace distribution (ALD), which can be regarded as an extension to the traditional mixture of regression models with normal error terms. An EM algorithm is proposed to obtain the parameter estimates of the FMQR model by combining a hierarchical representation of the ALD. Finally, the iterated weighted least square estimation for each mixture component of the FMQR model is derived. Simulation studies are conducted to illustrate the finite sample performance of the estimation procedure. Analysis of an aphid data set is used to illustrate our methodologies.

This paper focuses on the Least Square (LS) regression using the mean and Quantile (M) regression analysis using median which is based on “well-Known” parametric estimation methodologies. Data from Oregon and California highway bridges were used for the comparison of the two methods. Relationships were developed to predict the unit cost of FRP repair work and FRP cost was found to have a high degree of correlation with FRP area for both Oregon and California. It was observed that the Cost Estimating Relationships (CERs) obtained by Quantile (M) regression method had the smaller Mean Absolute Deviation (MAD) values and lower Mean Absolute Percentage Error (MAPE) values than Least Square (LS) regression. The stuudy showed that Quantile Regression is much less sensitive to outliers than Least Squares Regression.

This paper presents two probabilistic approaches based on bootstrap method and quantile regression (QR) method to estimate the uncertainty associated with solar photovoltaic (PV) power point forecasts. Solar PV output power forecasts are obtained using a hybrid intelligent model, which is composed of a data filtering technique based on wavelet transform (WT) and a soft computing model (SCM) based on radial basis function neural network (RBFNN) that is optimized by particle swarm optimization (PSO) algorithm. The point forecast capability of the proposed hybrid WT + RBFNN + PSO intelligent model is examined and compared with other hybrid models as well as individual SCM. The performance of the proposed bootstrap method in the form of probabilistic forecasts is compared with the QR method by generating different prediction intervals (PIs). Numerical tests using real data demonstrate that the point forecasts obtained from the proposed hybrid intelligent model can be effectively used to quantify PV power uncertainty. The performance of these two uncertainty quantification methods is assessed through reliability.