Improved Ensemble Learning Model by Swarm Intelligence for Mobile Subscribers’ Churn Prediction
In today's competitive world, companies need to analyze, identify and predict the behavior of their customers and respond to their demands earlier than their competitors.Moreover, in many industries such as mobile telecommunications, the cost of maintaining existing customers (customer retention) is much lower than the cost of attracting a new customer.Therefore, the problem of identifying customers who are going to leave the company, so-called Customer Churn Prediction (CCP), and preventing them by offering Incentives is essential in these industries.In this direction, researchers have presented competent methods using data mining and artificial intelligence tools to identify potential churners.Machine learning (ML) methods are one of the most powerful and widely used techniques to deal with the CCP problem, since they can properly extract and learn complex relationships between the customers' attributes and their churn intention.Artificial Neural Networks (ANNs), Support Vector Machines (SVMs), Decision Trees (DTs), Logistic Regression (LR), and Nave Bayes (NB) are among the well-known ML models utilized in numerous studies to tackle the CCP problem.Also, ensemble learning techniques such as Adaboost, Gradient Boost, and Extreme Gradient Boost (XG_boost) have been widely used to solve the CCP problem since they can aggregate the capabilities of multiple ML models.Hence, in order to improve the process of predicting customer churn, in this paper we propose a novel ensemble learning based approach, which is designed based on the two-level stacking technique.We employ six prominent ML models in each level of our proposed ensemble model including MLP, SVM- 4 58 46 RBF, DT, NB, KNN, and LR.We also benefit from the Gray Wolf Optimization (GWO) algorithm as an efficient swarm intelligence based search algorithm to select the most effective features and also adjust the hyper-parameters in the proposed model.We have implemented our proposed model using Python and simulated it on two well-known customer churn datasets in the telecom market (IBM_Telco and Duke_Cell2Cell) to evaluate its performance.In this direction, we first demonstrated the optimal features' subset and the parameter values obtained from applying the GWO algorithm on each dataset.Next, we compared the performance of the proposed ensemble model with each of the base learners using common evaluation criteria including accuracy, precision, recall, F1 score and AUC.The results show that the proposed ensemble model can collect the capabilities of all the base learners and it works better than each of the basic ML models.Afterward, we compared the obtained results from the suggested model with the common ensemble models (Adaboost, Gradient_boost, XG_boost, and Cat_boost) The experimental results show the superiority of the proposed method over other evaluated ensemble models in all the evaluation criteria.Eventually, our method is compared with two recent CCP approaches introduced in the literature.This analysis reveals that, except for the recall criterion in the Duke_Cell2Cell dataset, our introduced method achieves superior results compared to the considered approaches in both datasets.
Read more