Using Evolutionary Computation to Improve Mutation Testing

Genetic algorithms are a kind of global meta-heuristic search technique that searches intelligently for optimal solutions to a problem. Evolutionary testing is a promise testing technique, which utilises genetic algorithms to generate test data for various testing objectives. It has been researched and applied in many testing areas, including structural testing, temporal performance testing, safety testing, specification-based testing, and so forth. Experimental studies have shown that compared with the traditional techniques, evolutionary testing can greatly improve the testing efficiency.

A genetic algorithm for online-scheduling of a multiproduct polymer batch plant

Fault in a software program can be detected by mutation testing. However, mutation testing is an expensive process in a software testing domain. In this paper, we have introduced a method based on genetic algorithm and mutation analysis for unit testing process. Software industry produces high quality software in which software testing has an important role. First, we make a program/software and intent some mutant in this program/software, find most critical path and optimise test cases using genetic algorithm for the unit testing. Initially generated test cases are refined using genetic algorithm. We use a mutant function for measuring the adequacy of the test case set. The given mutant function is used to calculate a mutant score. We have achieved 100% path coverage and boundary coverage using mutation testing. The objective is to produce a set of good test cases for killing one or more undesired mutants and produces different mutant from original software/program. Unlike simple algorithms, genetic algorithms provide suitability for reducing the data generation at a comparable cost. An optimised test case has been generated by proposed approach for cost reduction and revealing or killing undesired test cases.

Fault in a software program can be detected by mutation testing. However, mutation testing is an expensive process in a software testing domain. In this paper, we have introduced a method based on genetic algorithm and mutation analysis for unit testing process. Software industry produces high quality software in which software testing has an important role. First, we make a program/software and intent some mutant in this program/software, find most critical path and optimise test cases using genetic algorithm for the unit testing. Initially generated test cases are refined using genetic algorithm. We use a mutant function for measuring the adequacy of the test case set. The given mutant function is used to calculate a mutant score. We have achieved 100% path coverage and boundary coverage using mutation testing. The objective is to produce a set of good test cases for killing one or more undesired mutants and produces different mutant from original software/program. Unlike simple algorithms, genetic algorithms provide suitability for reducing the data generation at a comparable cost. An optimised test case has been generated by proposed approach for cost reduction and revealing or killing undesired test cases.

Mutation testing is a very effective testing technique that creates mutants (copies of the original system with small syntactic changes) in order to design test cases that kill the mutants (identifying the syntactic changes). The main disadvantage of mutation testing is its high costs: creating mutants, executing mutants and calculating the mutation score. This paper describes the MUSIC technique, an improvement of the cost reduction technique Mutant Schema, which is meant to reduce the number of required executions and identify infinite loops at a reduced cost. Besides, an experiment was performed to evaluate the advantages and disadvantages of MUSIC and identify possible ways to improved it. As a result, we conclude that MUSIC reduces the execution cost of mutation testing and its application is therefore recommended.

One approach widely adopted for software testing rely on mutation to use as their comparison criteria. However, in mutation testing, the number of useless mutants generated during the mutation process can reach up to 90% of the total number of mutants created, making the process costly and time-consuming. The concept of subsumption has been empirically used in mutation testing to establish fault hierarchies in which tests that detect certain failures guarantee the detection of others, drastically reducing the generation of these useless mutants during mutation analysis. The tools used for mutation testing do not yet present automated solutions for checking for dominance and, consequently, selection of mutants to be considered in the tests. Hence, in this paper we present a model of automatic identification of subsumption in mutation testing based on evolutionary algorithms, demonstrating evidence of the efficiency of the use of artificial computational approaches for automatic generation of graphs of dynamic dominances in complex problems. We consider in our approach the dynamic subsumption method and a visualization model from the generation of graphs.We show that our approach is feasible and useful.

This paper innovates, within the context of preventive maintenance planning, the application of Genetic Algorithm, as a modern powerful optimization tool, in minimum downtime strategies, for optimal part replacement. Therefore, a brief account of Genetic Algorithm is given and a computer program is written to aid the solution of such problems by Genetic Algorithm. Then, the program is used to solve a numerical example, concerning an equipment with Gaussian failure characteristics. The results obtained by Genetic Algorithm and the ordinary methods are compared to show that exactly the same results can be approached by the application of Genetic Algorithm. Genetic Algorithm and maintenance planning, both being subjects of statistical nature, can be combined to provide a vast area of interesting research work and, hence, some guidelines are suggested for further research.

Manual test case generation is an exhaustive and time-consuming process. However, automated test data generation may reduce the efforts and assist in creating an adequate test suite embracing predefined goals. The quality of a test suite depends on its fault-finding behavior. Mutants have been widely accepted for simulating the artificial faults that behave similarly to realistic ones for test data generation. In prior studies, the use of search-based techniques has been extensively reported to enhance the quality of test suites. Symmetry, however, can have a detrimental impact on the dynamics of a search-based algorithm, whose performance strongly depends on breaking the “symmetry” of search space by the evolving population. This study implements an elitist Genetic Algorithm (GA) with an improved fitness function to expose maximum faults while also minimizing the cost of testing by generating less complex and asymmetric test cases. It uses the selective mutation strategy to create low-cost artificial faults that result in a lesser number of redundant and equivalent mutants. For evolution, reproduction operator selection is repeatedly guided by the traces of test execution and mutant detection that decides whether to diversify or intensify the previous population of test cases. An iterative elimination of redundant test cases further minimizes the size of the test suite. This study uses 14 Java programs of significant sizes to validate the efficacy of the proposed approach in comparison to Initial Random tests and a widely used evolutionary framework in academia, namely Evosuite. Empirically, our approach is found to be more stable with significant improvement in the test case efficiency of the optimized test suite.

The Meta heuristic algorithms are the higher level technique which helps to find the best feasible solution out of all possible solution of an optimization problem. There are various different types of meta heuristic algorithms like Ant Colony Optimization (ACO), Genetic Algorithm, Simulated Annealing, Particle Swarm Optimization, etc. Genetic Algorithm is a search-based optimization technique based on the biological principle of Genetics and adaptation. It is a meta-heuristic approach which is used to solve complex combinatorial problem. The integration of Genetic algorithm with machine learning will be helpful in solving unconstrained and constrained optimization problem. The various genetic operator like selection operator, mutation and cross-over are discussed which will be helpful in knowing how these operators significantly improves State Space search. In this paper the various applications of Genetic algorithms which can be used in machine learning has been discussed. In this paper the author discussed how the significance of Genetic algorithm will be improved while solving complex optimization problem in machine learning. In this paper, flow diagram of Genetic Algorithms has been discussed which will ease the understanding of complex optimization problem like 0–1 Knapsack, Traveling Salesman Problem, etc. In this paper a comparative analysis between traditional algorithm and genetic algorithm has been done on the basis of parameters like flow of control, state space search, Complication, Preconditions, CPU utilization etc. The various limitations of Genetic Algorithms in solving problems with optimal solutions has also been discussed.

We review the recent work done by our group on theoretically analyzing the behavior of genetic algorithms(GAs) and searching for new ideas and strategies to design more efficient GAs. By introducing the concept of degree of population diversity and using the tools from finite Markov chain, we presented fairly clear characterizations of premature convergence in GAs and proved some results on the relationships between premature convergence and GA’s control parameters such as the population size, the mutation and crossover probabilities, and some population statistics. In the mean time, we have also obtained a result that depicts the search ability of the crossover operators in GAs. An upper bound on the convergence rate for the GAs has been established. Based on the theoretical analyses, we have proposed a novel GA called Genetic Algorithm with No Genetic Operators (GANGO), which needs neither to maintain a population nor to use the conventional genetic operators, and yet has the same search mechanisms as the classical GAs. As another development in improving the performance of GAs, a new concept called Dual Fitness Function was proposed which, when incorporated into the classical GAs will enable the algorithms to judge whether the current population is in the local or global attractive basins. And in this way, the control parameters of GAs can be adjusted adaptively. Some applications of our results to fields such as fuzzy systems, multi-destination routing problem (MDR) are briefly

A probabilistic framework for mutation testing in deep neural networks

This chapter builds the foundation of software testing techniques by classifying the various testing approaches and testing coverage criteria. It gradually advances in the concepts and process of Mutation Testing and its application areas. Mutation testing has been applied at both the source code level and specification level of the software under test. Mutation testing, when applied to the source code, is named as Program Mutation. Similarly, when applied to the specifications, it is named as Specification Mutation. The relevant Mutation Testing tools available for different programming languages for both program and Specification Mutations are hereby listed. Owing to the high cost incurred in applying Mutation Testing to industrial needs, the on-going endeavors of the researchers in the area are elaborated here. Applying nature-inspired algorithms along with Mutation Testing for data generation/selection/minimization is an upcoming area of research. Search based Mutation Testing (SBMT) applies evolutionary techniques like Genetic Algorithms or other metaheuristic approaches for automating the tasks associated with mutation testing, which otherwise requires a lot of human effort, thus, making it a practical approach. This chapter concludes by giving the seminal recent advancements in the area.

Genetic algorithm is one of the optimization techniques, successfully applied in nuclear reactor environment for a variety of applications. Nuclear fuel management optimization is a classical nuclear engineering problem, which has been studied extensively and several techniques, including genetic algorithms, have been used for its solution. The study presented in this paper addresses the overall procedures and methods developed for the application of genetic algorithms in the optimization studies of nuclear fuel management. The result obtained from a study that explores a typical application of genetic algorithm in nuclear fuel management is also presented. Finding out of optimal number of fuel subassemblies in the core of a nuclear reactor (having power generating capacity of 500 MWe) is taken up for the study. The results demonstrate the suitability and efficiency of the algorithm in generating feasible solutions for the selected optimization problem.

Traditionally, mutation testing is used as test set generation and/or test evaluation criteria once it is considered a good fault model. This paper uses mutation testing for evaluating an automated static analyzer. Since static analyzers, in general, report a substantial number of false positive warnings, the intention of this study is to define a prioritization approach of static warnings based on their correspondence with mutations. On the other hand, knowing that Mutation Test has a high application cost, another possibility is to try to identify mutations of some specific mutation operators, which an automatic static analyzer is not adequate to detect. Therefore, this information can be used to prioritize the order of incrementally applying mutation operators considering, firstly, those with no correspondence with static warnings. In both cases, contributing to the establishment of incremental strategies on using automatic static analysis or mutation testing or even a combination of them. We used mutation operators as a fault model to evaluate the direct correspondence between mutations and static warnings. The main advantage of using mutation operators is that they generate a large number of programs containing faults of different types, which can be used to decide the ones most probable to be detected by static analyzers. We provide evidences on the correspondence between mutations and some types of static warnings. The results obtained for a set of 19 open-source programs indicate that: 1) static warnings may be prioritized based on their correspondence level with mutations; 2) specific set of mutation operators and their mutations may be prioritized based on their correspondence level with warnings. It is possible to provide an incremental testing strategy aiming at reducing the cost of both static analysis and mutation testing using the correspondence information between these activities/artifacts.

The application of genetic algorithms in behavioural ecology, illustrated with a model of anti-predator vigilance