Fuzuli: Automatic Test Data Generation for Software Structural Testing using Grey Wolf Optimization Algorithm and Genetic Algorithm

Chapter 10 - Constraint-based heuristic algorithms for software test generation

Software industry produces high quality software, in that software testing plays a vital role. In software testing automatic generation can reduce the process time and cost. Automatic generation of object-oriented unit tests in software testing is a challenging task especially in white box testing. In software engineering Software testing becomes challenging issue with the development of software tools. Using Genetic Algorithm will provide best results in the software testing toolkit. This paper suggests an upgrading of automated search-based test generation of test cases in order to obtain high branch coverage in white box testing. The proposed technique outperforms providing greater efficiency in testing technique which combines Genetic Algorithm and Symbolic Execution named GASE. GASE automatically generates test data in order to obtain high branch coverage in white box testing aiming effective testing process which can be extended for software testing in cloud computing where it becomes necessity.

Test data generation is one of the most technically challenging steps of testing software, but most commercial systems currently incorporate very little automation for this step. This paper presents results from a project that is trying to find ways to incorporate test data generation into practical test processes. The results include a new procedure for automatically generating test data that incorporates ideas from symbolic evaluation, constraint-based testing, and dynamic test data generation. It takes an initial set of values for each input, and dynamically ‘pushes’ the values through the control-flow graph of the program, modifying the sets of values as branches in the program are taken. The result is usually a set of values for each input parameter that has the property that any choice from the sets will cause the path to be traversed. This procedure uses new analysis techniques, offers improvements over previous research results in constraint-based testing, and combines several steps into one coherent process. The dynamic nature of this procedure yields several benefits. Moving through the control flow graph dynamically allows path constraints to be resolved immediately, which is more efficient both in space and time, and more often successful than constraint-based testing. This new procedure also incorporates an intelligent search technique based on bisection. The dynamic nature of this procedure also allows certain improvements to be made in the handling of arrays, loops, and expressions; language features that are traditionally difficult to handle in test data generation systems. The paper presents the test data generation procedure, examples to explain the working of the procedure, and results from a proof-of-concept implementation. Copyright © 1999 John Wiley & Sons, Ltd.

SummaryConcurrent programming is increasingly present in modern applications. Although it provides higher performance and better use of available resources, the mechanisms of interaction between processes/threads result in a greater challenge for software testing activity. The nondeterminism present in those applications is one of the main issues during the test activity since the same test input can produce different possible execution paths, which may or not contain defects. The test data automatic generation can alleviate this problem, ensuring higher speed and reliability in software testing activity. This paper explores the automatic test data generation for concurrent programs through Genetic Algorithm, a bioinspired optimization technique, and proposes a test data generation approach for concurrent programs, called BioConcST, and a new operator for the selection of test subjects, called FuzzyST, which uses fuzzy logic. The approaches were evaluated in an experimental study towards their validation. The results showed that BioConcST is more promising than the other approaches at all analyzed levels. FuzzyST, together with Elitism and Tournament operators, provided the best results; however, it proved more suitable for concurrent programs of higher complexity.

Structural test data generation using a memetic ant colony optimization based on evolution strategies

Automatic Programming Assessment (APA) is one of the vital methods that has been applied around Computer Science education in realizing automated marking and grading on students’ programming exercises or assignments. APA is fundamentally relying upon a test data generation process to perform a dynamic testing. Recently in Software Testing (ST) research, it has been proven that the adoption of any Meta-Heuristic Search Techniques (MHSTs) is able to improve the efficiency of generating adequate and optimal test data. Unfortunately, current studies on APA have not yet usefully incorporated the techniques to include a better quality program testing coverage by considering the optimal size of generated test data. Thus, our study propose a method of generating and locating an adequate test data with optimal in size by adapting a MHST to satisfy the dynamic-functional testing in APA (or is called DyFunFPA-TDG method). In this paper, we merely focus on revealing the design of the method with a sample of the generated test cases to be used in APA. This method able to assist educators of elementary programming courses to provide the means of deriving and generating adequate test data with optimal in size regardless of having the expertise in specific knowledge of test cases design.KeywordsAutomatic programming assessmentTest data generationDynamic testingFlower pollination algorithm

In search-based structural testing, metaheuristic search techniques have been frequently used to automate the test data generation. In Genetic Algorithms (GAs) for example, test data are rewarded on the basis of an objective function that represents generally the number of statements or branches covered. However, owing to the wide diversity of possible test data values, it is hard to find the set of test data that can satisfy a specific coverage criterion. In this paper, we introduce the use of Novelty Search (NS) algorithm to the test data generation problem based on statement-covered criteria. We believe that such approach to test data generation is attractive because it allows the exploration of the huge space of test data within the input domain. In this approach, we seek to explore the search space without regard to any objectives. In fact, instead of having a fitness-based selection, we select test cases based on a novelty score showing how different they are compared to all other solutions evaluated so far.

Automatic test data generation from a software specification prepares test cases for software developers before their code development phase. Having test cases before coding, helps the developers to control their code to conform to the specification. In state-based specifications, paths from the initial state to the final state may be varied, this is called parallel paths. In order to generate test data which cover all behaviors in the specification, test data for each parallel path should be generated. This paper proposes an enhanced genetic algorithm(GA)-based approach to resolve the parallel paths from the UML state machine diagram. The proposed approach is improved from our previous study which uses a GA based test data generation method for only one path. The approach identifies parallel paths to cover all transitions. GA evolves a number of suitable test data sets - one test data set for each parallel path. The best test data for each parallel path are picked and used for calculating the overall coverage test data. The experimental results show improved coverage results with the enhanced approach for a number of case studies with parallel paths.

Software testing is the primary phase, which is performed during software development and it is carried by a sequence of instructions of test inputs followed by expected output.The Harmony Search (HS) algorithm is based on the improvisation process of music.In comparison to other algorithms, the HSA has gain popularity and superiority in the field of evolutionary computation.When musicians compose the harmony through different possible combinations of the music, at that time the pitches are stored in the harmony memory and the optimization can be done by adjusting the input pitches and generate the perfect harmony.The test case generation process is used to identify test cases with resources and also identifies critical domain requirements.In this paper, the role of Harmony search meta-heuristic search technique is analyzed in generating random test data and optimized those test data.Test data are generated and optimized by applying in a case study i.e. a withdrawal task in Bank ATM through Harmony search.It is observed that this algorithm generates suitable test cases as well as test data and gives brief details about the Harmony search method.It is used for test data generation and optimization.

Comparisons of metaheuristic algorithms and fitness functions on software test data generation

Application of Negative Selection Algorithm (NSA) for test data generation of path testing

Unit testing has a significant role in software development and its impacts depend on the quality of test cases and test data used. To reduce time and effort, unit test generator systems can help automatically generate test cases and test data. However, there is currently no unit test generator for Kotlin programming language even though this language is popularly used for android application developments. In this study, we propose and develop a test generator system that utilizes genetic algorithm (GA) and ANTLR4 parser. GA is used to obtain the most optimal test cases and data for a given Kotlin code. ANTLR4 parser is used to optimize the mutation process in GA so that the mutation process is not totally random. Our model results showed that the average value of code coverage in generated unit tests against instruction coverage is 95.64%, with branch coverage of 76.19% and line coverage of 96.87%. In addition, only two out of eight generated classes produced duplicate test cases with a maximum of one duplication in each class. Therefore, it can be concluded that our optimization with GA on the unit test generator is able to produce unit tests with high code coverage and low duplication.

Software test-data generation is the process of identifying a set of data, which satisfies a given testing criterion. For solving this difficult problem there were a lot of research works, which have been done in the past. The most commonly encountered are random test-data generation, symbolic test-data generation, dynamic test-data generation, and recently, test-data generation based on genetic algorithms. This paper gives a survey of the majority of software test-data generation techniques based on genetic algorithms. It compares and classifies the surveyed techniques according to the genetic algorithms features and parameters. Also, this paper shows and classifies the limitations of these techniques.

The main task of software testing is the generation of test data with high quality in restricted time. But for software with uncertainties, such as randomness, existing methods of generating test data often lose their effectiveness. For software with randomness, a test datum might cover the test target in one run, but obtains different results in the next run. Therefore, special testing methods must be exploited for this kind of software. In order to test software with randomness, we first propose a novel test adequacy criterion, and then build a mathematical model for generating test data according to the new criterion. Finally, we present a method of solving the optimization model using a set-based genetic algorithm. We apply the proposed method to test 12 programs, and compare with traditional genetic algorithm and the random method. From the experimental results we can see that, the proposed adequacy criterion is available for the software with randomness and the proposed algorithm can effectively generate test data.

Conventional software testing is time consuming and expensive task. The techniques for automated test case generation of software is very important as it can reduce the time and cost of this process. Search based test data generation received lot of attention in last two decades for solving this problem. The well known metaheuristic search technique genetic algorithm is used to obtain a specific coverage in software testing. This technique automatically generates test data in order to obtain branch coverage in software testing. The authors first use a technique to identify the unique paths from a control flow graph and then apply genetic algorithm for test case generation. This paper defines the basic research issues of genetic algorithm like chromosome, fitness function, crossing over, mutation in this problem domain and uses a case study to illustrate it.