Software Reliability Modeling and Evaluation under Incomplete Knowledge on Fault Distribution

In reality, the fault detection (or correction) phenomenon and software reliability estimation in the operational phase are different from that in the testing phase. The fault removal continues at a slower rate during the operational phase. In this paper, we will investigate some techniques for software reliability prediction and measurement in the operational phase. We first review how some software reliability growth models (SRGMs) based on non-homogeneous Poisson processes (NHPPs) can be readily derived based on a unified theory for NHPP models. Under this general framework, we can not only verify some conventional SRGMs but also derive some new SRGMs that can be used for software reliability measurement in the operational phase. That is, based on the unified theory, we can incorporate the concept of multiple changepoints into software reliability modeling. We can formularize and simulate the fault detection process in the operational phase. Some numerical illustrations based on real software failure data are also presented. The experimental results show that the proposed models can easily reflect the possible changes of fault detection process and offer quantitative analysis on software failure behavior in field operation.

Non-homogeneous Poisson process (NHPP) model with typical reliability growth patterns is an important technology about evaluating software reliability. Two parameters which affect software reliability are original failures number and failure-detected rate. The paper firstly defines the software failure distributed and discusses a few kinds' software reliability models. Non-homogeneous Poisson process model is presented. The models with different parameters are discussed and analyzed. The model's restrict condition and some of parameters, original failures number and failure-detected ratio, are extrapolated. Assessment methodology about key parameters is given.

Software has become a vital factor in the fourth industrial revolution. Owing to the increase in demand for software products in various fields (big data, artificial intelligence, the Internet of Things, etc.), the software industry has expanded more than ever before. Therefore, software reliability has become very important, and efforts are being made to increase it. One of these efforts is the development of software reliability models (SRMs). SRMs have been studied for a long time as a model that predicts software reliability by using the number of software faults. Software failures can occur for several reasons, including independent software faults such as code errors and software hangs, as well as dependent cases where code errors lead to other software faults. Recently, due to the diversity of software operating environments, software faults are more likely to occur in a dependent manner, and, for this reason, they are likely to increase rapidly from the beginning and progress slowly to the maximum number thereafter. In addition, many large companies have focused on open-source software (OSS) development, and OSS is being developed by many users. In this study, we propose a new SRM that considers the number of finite faults and dependent faults, and examine the goodness-of-fit of a new SRM and other existing non-homogeneous Poisson process models based on the OSS datasets. Through numerical examples, the proposed model demonstrated a significantly better goodness-of-fit when compared to other existing models, and it also exhibited better results on the newly proposed integrated criteria.

The development of a user-oriented procedure for software reliability prediction of telecommunications systems is proposed. The procedure is based on software reliability data that encapsulate the characteristics of the software decomposed into comparable units, as well as the more traditional failure data used in most of the current models. The state-of-the-art in software reliability prediction is reviewed. The software characteristics and the software reliability models that could form the backbone of a procedure are described together with some of the software reliability issues that have to be resolved for a useful prediction procedure for telecommunications.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

The importance of software has increased significantly over time, and software failures have become a critical concern. As software systems have diversified in functionality, their structure has become more complex, and the types of failures that can occur in software have also diversified, stimulating the development of diverse software reliability models. In this study, we make certain assumptions regarding complex software, thereby proposing a new type of non-homogeneous Poisson process (NHPP) software reliability model that considers both dependent cases of software failure and cases that originate from the differences between the developed and actual operating environments. In addition, a new multi-criteria decision method (MCDM) that uses the maximum value for a comprehensive evaluation was proposed to demonstrate the effectiveness of the developed model. This improves the judgment of model excellence through multiple criteria and is suitable for multiple interpretations. To demonstrate the effectiveness of the proposed model, 15 NHPP software reliability models were compared using 13 evaluation criteria and three MCDM methods across two datasets. The results showed that one dataset performed well for all the criteria, whereas the other dataset performed well for the newly proposed a multi-criteria decision method using maximum (MCDMM). The sensitivity analysis also showed a change in the mean value function with a change in the parameters. These results demonstrate that an extended structure for complex software can lead to improved software reliability.

In this paper, software reliability measurement is studied from the perspective of usage profile. Reliability parameters on each usage profile are expressed with unascertained rational numbers. Since failure process of each usage profile can be affected by multiple factors such as software attributes and users imports etc., GEP (gene expression programming) is introduced into software reliability modeling, to study comprehensive force among the factors. Finally, a software reliability GEP model based on usage profile is constructed. With the new model, users can confirm software reliability according to its usage, thus enabling software reliability to a more objective assessment. The new model is experimented to measure reliability of SYS in Musa data, and proved with a satisfactory performance. DOI: http://dx.doi.org/10.11591/telkomnika.v10i7.1572 Full Text: PDF

In the software industry, two software engineering development best practices coexist: open-source and closed-source software. The former has a shared code that anyone can contribute, whereas the latter has a proprietary code that only the owner can access. Software reliability is crucial in the industry when a new product or update is released. Applying meta-heuristic optimization algorithms for closed-source software reliability prediction has produced significant and accurate results. Now, open-source software dominates the landscape of cloud-based systems. Therefore, providing results on open- source software reliability - as a quality indicator - would greatly help solve the open-source software reliability growth- modelling problem. The reliability is predicted by estimating the parameters of the software reliability models. As software reliability models are inherently nonlinear, traditional approaches make estimating the appropriate parameters difficult and ineffective. Consequently, software reliability models necessitate a high- quality parameter estimation technique. These objectives dictate the exploration of potential applications of meta- heuristic swarm intelligence optimization algorithms for optimizing the parameter estimation of nonhomogeneous Poisson process-based open-source software reliability modelling. The optimization algorithms are firefly, social spider, artificial bee colony, grey wolf, particle swarm, moth flame, and whale. The applicability and performance evaluation of the optimization modelling approach is demonstrated through two real open-source software reliability datasets. The results are promising

Size, complexity, and human dependency on software--based products have grown dramatically during past decades. Software developers are struggling to deliver reliable software with acceptable level of quality, within given budget and schedule. One measure of software quality and reliability is the number of residual faults. Therefore, researchers are focusing on the identification of the number of fault presents in the software or identification of program modules that are most likely to contain faults. A lot of models have been developed using various techniques. A common approach is followed for software reliability prediction utilizing failure data. Software reliability and quality prediction is highly desired by the stakeholders, developers, managers, and end users. Detecting software faults early during development will definitely improve the reliability and quality in cost-effective way.KeywordsSoftware ReliabilityFault PredictionSoftware MetricsCapability Maturity ModelTest Case PrioritizationThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

In this paper, we propose an artificial neural- network-based approach for software reliability estimation and modeling. We first explain the network networks from the mathematical viewpoints of software reliability modeling. That is, we will show how to apply neural network to predict software reliability by designing different elements of neural networks. Furthermore, we will use the neural network approach to build a dynamic weighted combinational model. The applicability of proposed model is demonstrated through four real software failure data sets. From experimental results, we can see that the proposed model significantly outperforms the traditional software reliability models.

Improving software reliability prediction through multi-criteria based dynamic model selection and combination

Software reliability is a statistical measure of how well software operates with respect to its requirements. There are two related software engineering research issues about reliability requirements. The first issue is achieving the necessary reliability, i.e., choosing and employing appropriate software engineering techniques in system design and implementation. The second issue is the assessment of reliability as a method of assurance that precedes system deployment. In past few years, various software reliability models have been introduced. These models have been developed in response to the need of software engineers, system engineers and managers to quantify the concept of software reliability. This chapter on software reliability prediction using ANNs addresses three main issues: (1) analyze, manage, and improve the reliability of software products; (2) satisfy the customer needs for competitive price, on time delivery, and reliable software product; (3) determine the software release instance that is, when the software is good enough to release to the customer.

Software reliability growth models based on a nonhomogeneous Poisson process (NHPP) have been considered as one of the most effective among various models since they integrate the information regarding testing and debugging activities observed in the testing phase into the software reliability model. Although most of the existing NHPP models have progressed successfully in their estimation/prediction accuracies by modifying the assumptions with regard to the testing process, these models were developed based on the instantaneous fault-removal assumption. In this paper, we develop a generalized NHPP software reliability model considering quasi-renewal time-delay fault removal. The quasi-renewal process is employed to estimate the time delay due to identifying and prioritizing the detected faults before actual code change in the software reliability assessment. Model formulation based on the quasi-renewal time-delay assumption is provided, and the generalized mean value function (MVF) for the proposed model is derived by using the method of steps. The general solution of the MVFs for the proposed model is also obtained for some specific existing models. The numerical examples, based on a software failure data set, show that the consideration of quasi-renewal time-delay fault-removal assumption improves the descriptive properties of the model, which means that the length of time delay is getting decreased since testers and programmers adapt themselves to the working environment as testing and debugging activities are in progress.

PurposeThe aim of this paper is to propose a software reliability growth model based on stochastic differential equations for the integration testing phase of distributed development environment.Design/methodology/approachA client/server system (CSS), which is a new development method, has come into existence as a result of the progress of networking technology by UNIX systems. On the other hand, the effective testing method for distributed development environment has only a few presented. The method of software reliability assessment considering the interaction among software components in a distributed one is discussed.FindingsConventional software reliability growth models for system testing phase in distributed development environment have included many unknown parameters. Especially, the effective estimation method in terms of these unknown parameters, which means the proportion of the total testing‐load for the software component, has never been presented. This software reliability growth model can be easily applied in distributed software development, because the model has a simple structure.Practical implicationsThis model is very useful for software developers in terms of practical reliability assessment in the actual distributed development environment.Originality/valueThe method of software reliability assessment considering the interaction among software components in distributed development environment is proposed. Additionally, several numerical examples for the actual data are presented.

SREPT: software reliability estimation and prediction tool

Performance analysis of software reliability growth models with testing-effort and change-point