Code Multiview Hypergraph Representation Learning for Software Defect Prediction

In order to improve software reliability, software defect prediction is applied to the process of software maintenance to identify potential bugs. Traditional methods of software defect prediction mainly focus on designing static code metrics, which are input into machine learning classifiers to predict defect probabilities of the code. However, the characteristics of these artificial metrics do not contain the syntactic structures and semantic information of programs. Such information is more significant than manual metrics and can provide a more accurate predictive model. In this paper, we propose a framework called defect prediction via attention-based recurrent neural network (DP-ARNN). More specifically, DP-ARNN first parses abstract syntax trees (ASTs) of programs and extracts them as vectors. Then it encodes vectors which are used as inputs of DP-ARNN by dictionary mapping and word embedding. After that, it can automatically learn syntactic and semantic features. Furthermore, it employs the attention mechanism to further generate significant features for accurate defect prediction. To validate our method, we choose seven open-source Java projects in Apache, using F1-measure and area under the curve (AUC) as evaluation criteria. The experimental results show that, in average, DP-ARNN improves the F1-measure by 14% and AUC by 7% compared with the state-of-the-art methods, respectively.

Software Defect Prediction (SDP) plays an active area in many research domain of Software Quality of Assurance (SQA). Many existing research studies are based on software traditional metric sets and defect prediction models are built in machine language to detect the bug for limited source code line. Inspired by the above existing system. In this paper, defect prediction is focused on predicting defects in source code. The objective of this thesis is to improve the software quality for accurate defect prediction is source code for file level. So, that it helps the developer to find the bug and fix the issue, to make better use of a resource which reduces the test effort, minimize the cost and improve the quality of software. A new approach is introduced to improve the prediction performance of Bidirectional RNNLM in Deep Neural Network. To build the defect prediction model a defect learner framework is proposed and first it need to build a Neural Language Model. Using this Language Model it helps to learn to deep semantic features in source code and it train & test the model. Based on language model it combined with software traditional metric sets to measure the code and find the defect. The probability of language model and metric set Cross-Entropy with Abstract Syntax Tree (CE-AST) metric is used to evaluate the defect proneness and set as a metric label. For classification the metric label K-NN classifier is used. BPTT algorithm for learning RNN will provide additional improvement, it improves the predictions performance to find the dynamic error.

Software defects and quality assurance are crucial aspects of software development that should be considered during the software development cycle. To ensure high-quality software, it is essential to have a robust quality assurance process in place. System reliability and quality are very key components that must be considered during software development, and this can only be achieved when software undergoes a thorough test process for errors, anomalies, defects, omissions, and bugs. Early software defect prediction and detection play an essential role in ensuring the reliability and quality of software systems, ensuring that software companies discover errors or defects early enough and allocate more resources to defect-prone modules. This study proposes the development of an enhanced classifier model for software defect prediction and detection. The aim is to harness the collective intelligence of selected base classifiers like Support Vector Machine, Logistic regression, Decision Trees, Random Forest, AdaBoost, Gradient Boosting, K-Nearest Neighbor, GaussianNB, and Multi-Layer Perception to improve accuracy, robustness, and generalization in identifying potential defects using a soft voting ensemble technique. The ensemble model leveraged the confidence probability of the soft voting technique and the generalization advantage of cross-validation leading to a more robust and dynamic model. The performance of the model with existing classifiers was evaluated using accuracy, F1 score, Precision, and area under the ROC curve (ROC- AUC) as the evaluation metrics. The results of the experiment revealed that the Proposed Classifier produced an overall Accuracy rate of 93%, and ROC AUC of 98%. The results demonstrate the effectiveness of our enhanced ensemble classifier in software defect detection and prediction. By harnessing the strengths of diverse base classifiers, our approach provides a robust and adaptive solution to the challenges of early detection and mitigating defects in software systems. This research contributes to the advancement of reliable software development practices and lays the foundation for future enhancements in ensemble-based defect detection methodologies.

Assessment of socioeconomic and demographic risk factors for low birth weight using model-agnostic explainable ensembles.

Newer analytic approaches for developing predictive models provide a method of creating decision support to translate findings into practice. The aim of this study was to develop and validate a clinically interpretable predictive model for 12-month mortality risk among community-dwelling older adults. This is done by using routinely collected nursing assessment data to aide homecare nurses in identifying older adults who are at risk for decline, providing an opportunity to develop care plans that support patient and family goals for care. A retrospective secondary analysis of Medicare and Medicaid data of 635,590 Outcome and Assessment Information Set (OASIS-C) start-of-care assessments from January 1, 2012, to December 31, 2012, was linked to the Master Beneficiary Summary File (2012-2013) for date of death. The decision tree was benchmarked against gold standards for predictive modeling, logistic regression, and artificial neural network (ANN). The models underwent k-fold cross-validation and were compared using area under the curve (AUC) and other data science metrics, including Matthews correlation coefficient (MCC). Decision tree variables associated with 12-month mortality risk included OASIS items: age, (M1034) overall status, (M1800-M1890) activities of daily living total score, cancer, frailty, (M1410) oxygen, and (M2020) oral medication management. The final models had good discrimination: decision tree, AUC = .71, 95% confidence interval (CI) [.705, .712], sensitivity = .73, specificity = .58, MCC = .31; ANN, AUC = .74, 95% CI [.74, .74], sensitivity = .68, specificity = .68, MCC = .35; and logistic regression, AUC = .74, 95% CI [.735, .742], sensitivity = .64, specificity = .70, MCC = .35. The AUC and 95% CI for the decision tree are slightly less accurate than logistic regression and ANN; however, the decision tree was more accurate in detecting mortality. The OASIS data set was useful to predict 12-month mortality risk. The decision tree is an interpretable predictive model developed from routinely collected nursing data that may be incorporated into a decision support tool to identify older adults at risk for death.

To evaluate the feasibility of using deep learning models applied to digital breast tomosynthesis (DBT) images for non-invasive prediction of breast cancer biomarkers, including estrogen receptor (ER), progesterone receptor (PR), human epithelial growth factor receptor 2 (HER2), Ki-67 proliferation index, and triple-negative breast cancer (TNBC). In this retrospective study, patients with histopathologically-confirmed, invasive breast cancer were included. Furthermore, all included patients had complete, immunohistochemically-assessed biomarker data available. For each case, a representative DBT slice showing the tumor was selected and preprocessed using histogram equalization. Two pretrained convolutional neural networks (VGG19 and ResNet50) were fine-tuned for binary classification of each biomarker. Model performance was evaluated using accuracy, area under the curve (AUC), F1 score, and Matthews correlation coefficient. The study sample included 43 anonymized female patients. Deep learning models achieved strong predictive performance for ER (AUC = 0.81) and TNBC (AUC = 0.93). HER2 (AUC = 0.74) and Ki-67 index (AUC = 0.70) were predicted with moderate accuracy. PR results varied, with VGG19 reaching AUC = 0.76 while ResNet50 performed poorly (AUC = 0.24). Deep learning models applied to DBT images enabled non-invasive prediction of some key breast cancer biomarkers, especially ER status and TNBC type. This approach may function as a virtual biopsy to complement histopathology, guide biopsy targeting, and support treatment planning. Although preliminary, the findings highlight the potential of artificial intelligence-enhanced DBT assessment and warrant validation in larger, multi-center prospective studies.

Imbalanced data are a major factor for degrading the performance of software defect models. Software defect dataset is imbalanced in nature, i.e., the number of non-defect-prone modules is far more than that of defect-prone ones, which results in the bias of classifiers on the majority class samples. In this paper, we propose a novel credibility-based imbalance boosting (CIB) method in order to address the class-imbalance problem in software defect proneness prediction. The method measures the credibility of synthetic samples based on their distribution by introducing a credit factor to every synthetic sample, and proposes a weight updating scheme to make the base classifiers focus on synthetic samples with high credibility and real samples. Experiments are performed on 11 NASA datasets and nine PROMISE datasets by comparing CIB with MAHAKIL, AdaC2, AdaBoost, SMOTE, RUS, No sampling method in terms of four performance measures, i.e., area under the curve (AUC), F1, AGF, and Matthews correlation coefficient (MCC). Wilcoxon sign-ranked test and Cliff’s δ are separately used to perform statistical test and calculate effect size. The experimental results show that CIB is a more promising alternative for addressing the class-imbalance problem in software defect-prone prediction as compared with previous methods.

Recent studies of software defect prediction typically produce datasets, methods and frameworks which allow software engineers to focus on development activities in terms of defect-prone code, thereby improving software quality and making better use of resources. Many software defect prediction datasets, methods and frameworks are published disparate and complex, thus a comprehensive picture of the current state of defect prediction research that exists is missing. This literature review aims to identify and analyze the research trends, datasets, methods and frameworks used in software defect prediction research betweeen 2000 and 2013. Based on the defined inclusion and exclusion criteria, 71 software defect prediction studies published between January 2000 and December 2013 were remained and selected to be investigated further. This literature review has been undertaken as a systematic literature review. Systematic literature review is defined as a process of identifying, assessing, and interpreting all available research evidence with the purpose to provide answers for specific research questions. Analysis of the selected primary studies revealed that current software defect prediction research focuses on five topics and trends: estimation, association, classification, clustering and dataset analysis. The total distribution of defect prediction methods is as follows. 77.46% of the research studies are related to classification methods, 14.08% of the studies focused on estimation methods, and 1.41% of the studies concerned on clustering and association methods. In addition, 64.79% of the research studies used public datasets and 35.21% of the research studies used private datasets. Nineteen different methods have been applied to predict software defects. From the nineteen methods, seven most applied methods in software defect prediction are identified. Researchers proposed some techniques for improving the accuracy of machine learning classifier for software defect prediction by ensembling some machine learning methods, by using boosting algorithm, by adding feature selection and by using parameter optimization for some classifiers. The results of this research also identified three frameworks that are highly cited and therefore influential in the software defect prediction field. They are Menzies et al. Framework, Lessmann et al. Framework, and Song et al. Framework.

The main aim of software fault prediction is the identification of such classes and methods where faults are expecting at an early stage using some properties of the project. Early-stage prediction of software faults supports software quality assurance activities. Evaluation of code smells for anticipating software faults is basic to ensure its importance in the field of software quality. In this paper, we investigate the impact of code smells on software fault prediction at the class level and method level. Previous studies show the impact of code smells on fault prediction. However, using code smells for class level faults prediction and method level fault prediction need more concern. We use defects4j repository for the creation of datasets used in building software fault prediction model-based. We use pseudo labeling for class level prediction and bagging for method level prediction. We extract code smells from different classes and methods and then used these extracted code smells for fault prediction. We compare our prediction results with actual results and see if our prediction is correct in order to do validation.

In the traditional software defect prediction methodology, the historical record (dataset) of the same project is partitioned into training and testing data. In a practical situation where the project to be predicted is new, traditional software defect prediction cannot be employed. An alternative method is cross-project defect prediction, where the historical record of one project (source) is used to predict the defect status of another project (target). The cross-project defect prediction method solves the limitations of the historical records in the traditional software defect prediction method. However, the performance of cross-project defect prediction is relatively low because of the distribution differences between the source and target projects. Furthermore, the software defect dataset used for cross-project defect prediction is characterized by high-dimensional features, some of which are irrelevant and contribute to low performance. To resolve these two issues, this study proposes a transformation and feature selection approach to reduce the distribution difference and high-dimensional features in cross-project defect prediction. A comparative experiment was conducted on publicly available datasets from the AEEEM. Analysis of the results obtained shows that the proposed approach in conjugation with random forest as the classification model outperformed the other four state-of-the-art cross-project defect prediction methods based on the commonly used performance evaluation metric F1_score.

WITHDRAWN: Software bug prediction and classification by global pooling of different activation of convolution layers

Software defect prediction is an important part to ensure software quality and increase cost-efficiency. The core aspect prior to software defect prediction is software metrics. More research of process metrics existed and rapidly developed as the fact that process metrics can outperform code metrics. The development of process metrics is diverse aligning with various process metrics generated in the different publication using different dataset and granularity level, thus the development state of process metrics need to be further tracked. Recent research on software defect prediction using process metrics has been carried which complements or argues another studied related to the implementation of process metrics, dataset, and granularity level. This literature review has collected 17 literature studies that aim to depict the current research used of software defect prediction applying software process metrics, dataset, and granularity. Seven commonly used process metrics are identified such as NDC, NML, ADEV, EXP, LA, LD, and COMM. Process metrics development has been implemented in the previous research such as the application of aggregated process metrics and commits detailed information metrics. The selected research shows that 87% of research are using a public dataset while the rest are using a combined dataset. This result depicts the limited accessibility of private and industrial dataset for defect prediction. Following analysis of software granularity presents 4 levels of granularity used in selected research such as a functional, class, file, and features level. File-level defect predictions are mostly used for defect prediction in selected research and prove good defect prediction performance. The results of this literature review also identify the proposed studies which is software defect prediction using developed process metrics in the different datasets and features-level granularity to strengthen the previous research.

Development without any defect is unsubstantial. Timely detection of software defects favors the proper resource utilization saving time, effort and money. With the increasing size and complexity of software, demand for accurate and efficient prediction models is increasing. Recently, search-based techniques (SBTs) have fascinated many researchers for Software Defect Prediction (SDP). The goal of this study is to conduct an empirical evaluation to assess the applicability of SBTs for predicting software defects in object-oriented (OO) softwares. In this study, 16 SBTs are exploited to build defect prediction models for 13 OO software projects. Stable performance measures — GMean, Balance and Receiver Operating Characteristic-Area Under Curve (ROC-AUC) are employed to probe into the predictive capability of developed models, taking into consideration the imbalanced nature of software datasets. Proper measures are taken to handle the stochastic behavior of SBTs. The significance of results is statistically validated using the Friedman test complied with Wilcoxon post hoc analysis. The results confirm that software defects can be detected in the early phases of software development with help of SBTs. This paper identifies the effective subset of SBTs that will aid software practitioners to timely detect the probable software defects, therefore, saving resources and bringing up good quality softwares. Eight SBTs — sUpervised Classification System (UCS), Bioinformatics-oriented hierarchical evolutionary learning (BIOHEL), CHC, Genetic Algorithm-based Classifier System with Adaptive Discretization Intervals (GA_ADI), Genetic Algorithm-based Classifier System with Intervalar Rule (GA_INT), Memetic Pittsburgh Learning Classifier System (MPLCS), Population-Based Incremental Learning (PBIL) and Steady-State Genetic Algorithm for Instance Selection (SGA) are found to be statistically good defect predictors.

Software defect detection is a critical research topic in the field of software engineering, aiming to identify potential defects during the development process to improve software quality and reduce maintenance costs. This study proposes a novel feature selection and defect prediction classification algorithm based on a multi-strategy enhanced Parrot Optimization (PO) algorithm. Firstly, to address the limitations of the original Parrot Optimization algorithm, such as strong dependence on the initial population, premature convergence, and insufficient global search capability, this article develops a multi-strategy enhanced Parrot Optimization algorithm (MEPO). Experiments conducted on eight benchmark test functions validate the superior performance of MEPO in terms of convergence speed and solution accuracy. Secondly, to mitigate the adverse impact of irrelevant features on model performance in traditional software defect prediction methods, this study introduces a binary multi-strategy enhanced Parrot Optimization algorithm (BMEPO) for optimizing feature selection. Comparative experiments demonstrate that BMEPO exhibits stronger competitiveness in feature selection quality and classification performance compared to advanced feature selection algorithms. Finally, to further enhance the classification performance of defect prediction, a heterogeneous data stacking ensemble learning algorithm (HEDSE) based on feature selection is proposed. Experimental evaluations on 16 open-source software defect datasets indicate that the proposed HEDSE outperforms existing methods, providing a novel and effective solution for software defect prediction. The proposed approaches in this study hold significant practical value, particularly in improving software quality, optimizing testing resource allocation, and reducing maintenance costs, offering broad potential for application in real-world software engineering scenarios.

Objectives: To create a novel preoperative prediction model based on a deep learning algorithm to predict neoplasm T staging and grading in patients with upper tract urothelial carcinoma (UTUC). Methods: We performed a retrospective cohort study of patients diagnosed with UTUC between 2001 and 2012 at our institution. Five deep learning algorithms (CGRU, BiGRU, CNN-BiGRU, CBiLSTM, and CNN-BiLSTM) were used to develop a preoperative prediction model for neoplasm T staging and grading. The Matthews correlation coefficient (MMC) and the receiver-operating characteristic curve with the area under the curve (AUC) were used to evaluate the performance of each prediction model. Results: The clinical data of a total of 884 patients with pathologically confirmed UTUC were collected. The T-staging prediction model based on CNN-BiGRU achieved the best performance, and the MMC and AUC were 0.598 (0.592–0.604) and 0.760 (0.755–0.765), respectively. The grading prediction model [1973 World Health Organization (WHO) grading system] based on CNN-BiGRU achieved the best performance, and the MMC and AUC were 0.612 (0.609–0.615) and 0.804 (0.801–0.807), respectively. The grading prediction model [2004 WHO grading system] based on BiGRU achieved the best performance, and the MMC and AUC were 0.621 (0.616–0.626) and 0.824 (0.819–0.829), respectively. Conclusions: We developed an accurate UTUC preoperative prediction model to predict neoplasm T staging and grading based on deep learning algorithms, which will help urologists to make appropriate treatment decisions in the early stage.