An Efficient Method for Parameter Estimation of Software Reliability Growth Model Using Artificial Bee Colony Optimization

In reality, the fault detection (or correction) phenomenon and software reliability estimation in the operational phase are different from that in the testing phase. The fault removal continues at a slower rate during the operational phase. In this paper, we will investigate some techniques for software reliability prediction and measurement in the operational phase. We first review how some software reliability growth models (SRGMs) based on non-homogeneous Poisson processes (NHPPs) can be readily derived based on a unified theory for NHPP models. Under this general framework, we can not only verify some conventional SRGMs but also derive some new SRGMs that can be used for software reliability measurement in the operational phase. That is, based on the unified theory, we can incorporate the concept of multiple changepoints into software reliability modeling. We can formularize and simulate the fault detection process in the operational phase. Some numerical illustrations based on real software failure data are also presented. The experimental results show that the proposed models can easily reflect the possible changes of fault detection process and offer quantitative analysis on software failure behavior in field operation.

Management technologies for improving software reliability are very important for software TQM (Total Quality Management). The quality characteristics of software reliability is that computer systems can continue to operate regularly without the occurrence of failures on software systems. In this chapter, we describe several recent developments in software reliability modeling and its applications as quantitative techniques for software quality/reliability measurement and assessment. That is, a quality engineering analysis of human factors affecting software reliability during the design-review phase, which is the upper stream of software development, and software reliability growth models based on stochastic differential equations and discrete calculus during the testing phase, which is the lower one, are discussed. And, we discuss quality-oriented software management analysis by applying the multivariate analysis method and the existing software reliability growth models to actual process monitoring data. Finally, we investigate an operational performability evaluation model for the software-based system, introducing the concept of systemability which is defined as the reliability characteristic subject to the uncertainty of the field environment.KeywordsHuman factor analysisDesign-review experimentOSS reliabilityStochastic differential equationDiscrete modelingDifference equationSoftware managementSoftware project assessmentSoftware performability modelingSystemability assessment

In order to overcome the limitations of debugging process, insufficient consideration of imperfect debugging and testing-effort (TE) in software reliability modeling and analysis, a software reliability growth model (SRGM) explicitly incorporating imperfect debugging and TE is developed. From the point of view of incomplete debugging and introduction of new fault, software testing process is described and a relatively unified SRGM framework is presented considering TE. The proposed framework models are fairly general models that cover a variety of the previous works on SRGM with ID and TE. Furthermore, a special SRGM incorporating an improved Logistic testing-effort function (TEF) into imperfect debugging modeling is proposed. The effectiveness and reasonableness of the proposed model are verified by published failure data set. The proposed model closer to real software testing has better descriptive and predictive power than other models

PurposeThe aim of this paper is to propose a software reliability growth model based on stochastic differential equations for the integration testing phase of distributed development environment.Design/methodology/approachA client/server system (CSS), which is a new development method, has come into existence as a result of the progress of networking technology by UNIX systems. On the other hand, the effective testing method for distributed development environment has only a few presented. The method of software reliability assessment considering the interaction among software components in a distributed one is discussed.FindingsConventional software reliability growth models for system testing phase in distributed development environment have included many unknown parameters. Especially, the effective estimation method in terms of these unknown parameters, which means the proportion of the total testing‐load for the software component, has never been presented. This software reliability growth model can be easily applied in distributed software development, because the model has a simple structure.Practical implicationsThis model is very useful for software developers in terms of practical reliability assessment in the actual distributed development environment.Originality/valueThe method of software reliability assessment considering the interaction among software components in distributed development environment is proposed. Additionally, several numerical examples for the actual data are presented.

Failure of a safety critical system can lead to big losses. Very high software reliability is required for automating the working of systems such as aircraft controller and nuclear reactor controller software systems. Fault-tolerant softwares are used to increase the overall reliability of software systems. Fault tolerance is achieved using the fault-tolerant schemes such as fault recovery (recovery block scheme), fault masking (N-version programming (NVP)) or a combination of both (Hybrid scheme). These softwares incorporate the ability of system survival even on a failure. Many researchers in the field of software engineering have done excellent work to study the reliability of fault-tolerant systems. Most of them consider the stable system reliability. Few attempts have been made in reliability modeling to study the reliability growth for an NVP system. Recently, a model was proposed to analyze the reliability growth of an NVP system incorporating the effect of fault removal efficiency. In this model, a proportion of the number of failures is assumed to be a measure of fault generation while an appropriate measure of fault generation should be the proportion of faults removed. In this paper, we first propose a testing efficiency model incorporating the effect of imperfect fault debugging and error generation. Using this model, a software reliability growth model (SRGM) is developed to model the reliability growth of an NVP system. The proposed model is useful for practical applications and can provide the measures of debugging effectiveness and additional workload or skilled professional required. It is very important for a developer to determine the optimal release time of the software to improve its performance in terms of competition and cost. In this paper, we also formulate the optimal software release time problem for a 3VP system under fuzzy environment and discuss a the fuzzy optimization technique for solving the problem with a numerical illustration.

A large number of software reliability growth models (SRGMs) have been proposed during the past 30 years to estimate software reliability measures such as the number of remaining faults, software failure rate, and software reliability. Selection of an optimal SRGM for use in a particular case has been an area of interest for researchers in the field of software reliability. Tools and techniques for software reliability model selection found in the literature cannot be used with high confidence as they use a limited number of model selection criteria. For the first time, we developed a deterministic quantitative model based on a distance based approach (DBA) method, then applied it for evaluation, optimal selection, and ranking of SRGMs. DBA recognizes the need for relative importance of criteria for a given application, without which inter-criterion comparison could not be accomplished. It requires a set of model selection criteria, along with a set of SRGMs, and their level of criteria for optimal selection; and it successfully presents the results in terms of a merit value which is used to rank the SRGMs. We use two distinct, real data sets for demonstration of the DBA method. The result of this study will be a ranking of SRGMs based on the Euclidean composite distance of each alternative to the designated optimal SRGM.

In order to incorporate the effect of test coverage, two novel software reliability growth models (SRGMs) are proposed in this paper using failure data and test coverage simultaneously. One is continuous using testing time, and the other is discrete with respect to the number of executed test cases instead of testing time. Since one of the most important factors of the coverage-based SRGMs is the test coverage function (TCF), we first discuss a discrete TCF based on Beta function. Then we develop mean value functions (MVF) of the two models integrating test coverage and imperfect debugging. Finally the proposed TCF and MVFs are evaluated and validated on actual software reliability data collected from real software development projects. The results demonstrate clearly that both the proposed TCF and SRGMs provide better estimation and fitting for the data sets under comparisons.

There are many models of software reliability growth, but none of them is able to model the varied patterns observed in practice. A previous paper (R.E. Mullen, 1998), suggested that since event rates in software systems are generated by multiplicative processes, the distribution of rates of events, including failure rates, is lognormal. It also showed that many previously published empirical failure rate distributions are well fit by the lognormal. The theoretical roots and experimental confirmation of the lognormal distribution of failure rates in software systems provide a unique and potentially fruitful basis for constructing a new software reliability model. The paper derives a Lognormal Execution Time Software Reliability Growth Model, a member of the family of Doubly Stochastic Exponential Order Statistic Models, by developing a numerical approximation for the Laplace transform of the lognormal. The model is used to analyze two series of failure data as an example of its use. The likelihood of that data arising from the lognormal and log-Poisson models is computed and shown to be highly favorable to the lognormal in one case and slightly favorable in the other. A preliminary comparison of the lognormal, the LPET, and the BET models using ten Musa data sets further demonstrates the ability of the lognormal model to fit a wide variety of reliability growth scenarios. Of particular novelty is the use of a software failure rate model which has both plausible theoretical justification and solid support from prior studies of software failure rate distributions. Also novel is the application of the Laplace Transform of the Lognormal to the problem of software reliability growth.

In the software industry, two software engineering development best practices coexist: open-source and closed-source software. The former has a shared code that anyone can contribute, whereas the latter has a proprietary code that only the owner can access. Software reliability is crucial in the industry when a new product or update is released. Applying meta-heuristic optimization algorithms for closed-source software reliability prediction has produced significant and accurate results. Now, open-source software dominates the landscape of cloud-based systems. Therefore, providing results on open- source software reliability - as a quality indicator - would greatly help solve the open-source software reliability growth- modelling problem. The reliability is predicted by estimating the parameters of the software reliability models. As software reliability models are inherently nonlinear, traditional approaches make estimating the appropriate parameters difficult and ineffective. Consequently, software reliability models necessitate a high- quality parameter estimation technique. These objectives dictate the exploration of potential applications of meta- heuristic swarm intelligence optimization algorithms for optimizing the parameter estimation of nonhomogeneous Poisson process-based open-source software reliability modelling. The optimization algorithms are firefly, social spider, artificial bee colony, grey wolf, particle swarm, moth flame, and whale. The applicability and performance evaluation of the optimization modelling approach is demonstrated through two real open-source software reliability datasets. The results are promising

Many software reliability growth models have been proposed in the past decade. Those models tacitly assume that testing-effort expenditures are constant throughout software testing. This paper develops realistic software reliability growth models incorporating the effect of testing-effort. The software error detection phenomenon in software testing is modeled by a nonhomogeneous Poisson process. The software reliability assessment measures and the estimation methods of parameters are investigated. Testing-effort expenditures are described by exponential and Rayleigh curves. Least-squares estimators and maximum likelihood estimators are used for the reliability growth parameters. The software reliability data analyses use actual data. The software reliability growth models with testing-effort can consider the relationship between the software reliability growth and the effect of testing-effort. Thus, the proposed models will enable us to evaluate software reliability more realistically.

In current software reliability modeling research, the main concern is how to develop general prediction models. In this paper, we propose several improvements on the conventional software reliability growth models (SRGMs) to describe actual software development process by eliminating some unrealistic assumptions. Most of these models have focused on the failure detection process and not given equal priority to modeling the fault correction process. But, most latent software errors may remain uncorrected for a long time even after they are detected, which increases their impact. The remaining software faults are often one of the most unreliable reasons for software quality. Therefore, we develop a general framework of the modeling of the failure detection and fault correction processes. Furthermore, we apply neural network with back-propagation to match the histories of software failure data. We will also illustrate how to construct the neural networks from the mathematical viewpoints of software reliability modeling in detail. Finally, numerical examples are shown to illustrate the results of the integration of the detection and correction process in terms of predictive ability and some other standard criteria.

Performance analysis of software reliability growth models with testing-effort and change-point

This paper deals with the effect of interfailure time variability on the modelling of software reliability growth. Some, primarily mathematical arguments, are outlined that cast a doubt on the commonly adopted concept of failures ' occurrence as a Poisson (either homogeneous or non-homogeneous) process. On a contrived (but plausible for the software practice) example the consequences of this assumption, in some cases inappropriate for the software reliability predictions, are illustrated. The idea of “tuning” the reliability growth models based on measurements of the distribution of a single execution time is advocated.Keywordsurn modelsoftware reliability growthPoisson processsoftware execution timeoperational profile

The safety-critical software of Reactor Protection System (RPS) plays a significant role for the safe operation of the nuclear power plant (NPP). However, it also brings challenges both to the reliability analysis of the RPS and to the Probabilistic Risk Assessment of the NPPs. The reliability analysis of safety-critical software is also expected by the nuclear regulation agencies and the software development groups for test evaluation and optimization. The detected faults during the software test process are regarded to have close connection with the software reliability and there have been hundreds of test-based software reliability models. Due to the particularity of its function, the safety-critical software of an NPP is especially sensitive to the faults with higher severity levels which should be paid special attention to. Severity levels of faults are commonly taken into account during software reliability modelling. In this paper, a novel software reliability growth model considering actual severity data was built based on a non-homogeneous Poisson process. Ratio of fatal faults with highest severity level to all accumulated faults was modelled with logistic curve. Then the mean value functions of both fatal and general faults were derived. A belief factor was employed to describe the trend of severity classification. In the end, the test data of a practical project was used to verify this model. The analysis results showed that this model had better prediction effect than Goel-Okumoto model and Inflection S-shaped model even when limited test data were collected. This novel model can be used as a helpful tool to evaluate both the reliability and the release time of the safety-critical software of an NPP.

Software reliability assessment for an exponential-S-shaped reliability growth phenomenon