A binary moth search algorithm based on self-learning for multidimensional knapsack problems

The multi-dimensional knapsack problem (MDKP) is a well-known NP-hard problem in combinatorial optimization. As it has various real-life applications, the MDKP has been intensively studied in the literature. On the other hand, far too little attention has been paid to the multi-objective version of the MDKP. In this chapter, we consider the bi-objective multi-dimensional knapsack problem (BOMDKP). We propose a Binary Genetic Algorithm (BGA) with an external archive for the problem. Our proposed BGA algorithm also employs a binary local search. The non-dominated solution sets are obtained for various bi-objective benchmark instances with 100, 250, 500 and 750 items, by employing the proposed BGA. Then, the performance of the BGA is compared with other multi-objective algorithms from the literature, i.e., MOEA/D and MOFPA. Furthermore, it is observed that the Pareto-optimal solution set provided by Zitzler and Laumans for 500 items and 2 knapsacks includes 30 dominated solutions. Also, the Pareto-optimal solutions for the scenario with 750 items are not reported in Zitzler and Thiele [43]. Hence, the true Pareto-optimal solution sets are found for all benchmark problem instances using Improved Augmented Epsilon Constraint (AUGMECON2) method. The non-dominated solution sets of the BGA, MOEA/D and MOFPA are compared with the Pareto-optimal solution sets for all test instances. The computational results indicate that the proposed BGA is more effective to solve the BOMDKP than the best-performing algorithms from the literature.

Magnetic target state estimation is a widely applied technology, but it also faces many challenges in practical applications. One of the most critical challenges is the issue of estimation accuracy. The Grey Wolf Optimizer (GWO) is one of the more successful swarm intelligence algorithms in recent years, but its shortcomings have also been exposed when facing increasingly complex problems. Therefore, a Multi-Strategy Improved Grey Wolf Optimizer (MSIGWO) algorithm has been proposed to enhance the accuracy of magnetic target state estimation. In the initialization phase, Tent chaos mapping is introduced to enhance population diversity, prevent falling into local optima, and improve convergence speed. Multi-population fusion evolution strategies enhance population diversity, convergence accuracy, and global search ability. Nonlinear convergence factors better balance exploration and exploitation behaviors. Dynamic weight strategies increase the diversity of search samples and reduce the likelihood of falling into local optima. Adaptive dimensional learning better balances local and global searches, enhancing population diversity. Adaptive Levy flight enhances the ability to jump out of local optima and ensures convergence speed. In the CEC2018 benchmark function set of 29 benchmark function problems and magnetic target state estimation problems, the proposed MSIGWO was tested, and statistical indicators and Friedman test results show that compared with GWO and its advanced variants, the MSIGWO algorithm has superior performance. The application of this algorithm in magnetic target state estimation problems has proven its effectiveness and applicability.

A two-phase tabu-evolutionary algorithm for the 0–1 multidimensional knapsack problem

This paper introduces solutions to deal with the Multidimensional Knapsack Problem (MKP), which is a NP-hard combinatorial optimisation problem. Two hybrid heuristics based on Genetic Algorithms (GA) are proposed: the Memetic Search Algorithm (MSA) and the Genetic Algorithm Guided by Pretreatment information (GAGP). MSA combines sequentially GA with the Stochastic Local Search-Simulated Annealing algorithm (SLSA). GAGP is composed of two steps, in the first, a ratio-based greedy algorithm extracts useful information and the core concept is utilised to decompose items according to their ratios; In the second, these information are integrated to the operators of a GA allowing to reach the best solutions faster. An operator is added to the GA to dynamically update the ratio values of the items. Two groups of data were used to examine the proposed approaches. A group of simple instances of MKP has been used to examine MSA and a group of complex MKP has been used to examine GAGP. The obtained results indicate that MSA and GAGP have the capability to give solutions of high quality.

Binary metaheuristic algorithms for 0–1 knapsack problems: Performance analysis, hybrid variants, and real-world application

Focusing on the problem of premature convergence existed in genetic algorithm for assembly sequence planning, the reasons were analyzed from genetic operations. It was pointed out that keeping population diversity and gene schema were the keys to avoid premature convergence. Checking up chromosomes and regulating them with the same mechanism will alter genetic information or destroy schema structure. They will also aggravate premature convergence. The influences of variation probability on population diversity and evolution progress were discussed in detail. To alleviate premature convergence, an extend operator was presented. It can enhance population diversity and local search ability by replacing the bad individuals with the son individuals produced by good individuals dithering. Supplantation operator was adopted to improve the evolution ability. It will check up difference between chromosomes of individuals and add a punish term to the little difference individual at initial evolutions. In order to prevent loss of available gene, gene repair strategy was presented to ill genes. Simulation results for an assembly sequence planning show validity of the presented algorithm.

The pigeon-inspired optimization algorithm is a category of a newly proposed swarm intelligence-based algorithm that belongs to the population-based solution technique. The MKP is a class of complex optimization problems that have many practical applications in the fields of engineering and sciences. Due to the practical applications of MKP, numerous algorithmic-based methods like local search and population-based search algorithms have been proposed to solve the MKP in the past few decades. This paper proposes a modified binary pigeon-inspired optimization algorithm named (Modified-BPIO) for the 0 - 1 multidimensional knapsack problem (MKP). The utilization of the binary pigeon-inspired optimization (BPIO) for solving the multidimensional knapsack problem came with huge success. However, it can be observed that the BPIO converges prematurely due to lost diversity during the search activities. Given the above, the crossover operator is integrated with the landmark component of the BPIO to improve the diversity of the solution space. The MKP benchmarks from the Operations Research (OR) library are utilized to test the performance of the proposed binary method. Experimentally, it is concluded that the proposed Modified-BPIO has a better performance when compared with the BPIO and existing state-of-the-arts that worked on the same MKP benchmarks.

The multidimensional knapsack problem (MKP) is an NP-hard combinatorial optimization problem whose solution consists of determining a subset of items of the maximum total profit that does not violate capacity constraints. Due to its hardness, large-scale MKP instances are usually a target for metaheuristics, a context in which effective feasibility maintenance strategies are crucial. In 1998, Chu and Beasley proposed an effective heuristic repair that is still relevant for recent metaheuristics. However, due to its deterministic nature, the diversity of solutions such heuristic provides is not sufficient for long runs. As a result, the search ceases to find new solutions after a while. This paper evaluates the use of efficiency groups to define a randomization strategy for the heuristic repair that increases the variability of the repaired solutions, without deteriorating quality and improves the overall results. We compared our randomized heuristic repair against the original one in 270 or-library instances, with improvements at the running time and solution quality found for many of them.

In this paper, we presented a New Hybrid Binary Particle Swarm Optimization (NHBPSO). This hybridization consists at combining some principles of Particle Swarm Optimization (PSO) and Crossover Operation of the Genetic Algorithm (GA). The proposed algorithm is used to solving the NP-hard combinatorial optimization problem of Multidimensional Knapsack Problem (MKP). In the aim to access the efficiency and performance of our NHBPSO algorithm we have tested it on some benchmarks from OR-Library and we have compared our results with the obtained results by the standard binary Particle Swarm Optimization with penalty function technique (PSO-P) algorithm and the quantum version (QICSA) of the new metaheuristic Cuckoo Search. The experimental results show a good and promise solution quality obtained by the proposed algorithm which outperforms the PSO-P and QICSA algorithms.

Knapsack problems are among the most common problems in literature tackled with evolutionary algorithms (EA). Their major advantage lies in the fact that they are relatively simple to implement while they allow generalizations for a wide range of real world problems. The multi-dimensional knapsack problem (MKP), which belongs to the class of NP-complete combinatorial optimization problems, is one of the variations of the knapsack problem. The MKP has a wide range of real world applications such as cargo loading, selecting projects to fund, budget management, cutting stock, etc. The MKP has been studied quite extensively in the EA community. Due to the constrained nature of the problem, constraint handling techniques gain great importance in the performance of the proposed EA approaches. In this study, the applicability of a generational EA that uses a penalty-based constraint handling technique and a gene locus based, asymmetric, adaptive mutation scheme is explored for the MKP. The effects of the parameters of the explored approach is determined through tests. Further experiments, using large MKP instances from commonly used benchmarks available through the Internet are performed. Comparison tables are given for the performance of the explored approach and other good performing EAs found in literature for the MKP. Results show that performance improves greatly when compared with other penalty-based techniques, but the explored approach is still not the best performer among all. However, unlike the explored technique, the EAs using the other constraint handling techniques require a great amount of extra computational effort and need heuristic information specific to the optimization problem. Based on these observations, and the fact that the performance difference between the explored scheme and the better performers is not too high, research on improving the explored approach is still in progress.

This paper proposes a novel approach for the multidimensional knapsack problem (MDKP) using differential evolution. Firstly, the principle and the pseudo-code of binary differential evolution with hybrid encoding (HBDE) are presented. On the basis of the existing repair operator 2 (RO2), an improved repair operator 3 (RO3) for handling the infeasible solutions of MDKP is developed. Then, combine HBDE with RO3, an efficient algorithm (HBDE-RO3) for MDKP is proposed. Finally, the experiment results of the 138 well-known MDKP benchmarks show that RO3 is advantageous to deal with the infeasible solutions than RO2, and the proposed algorithm HBDE-RO3 has superior performance for solving MDKP than the state-of-the-art algorithms.

Many-objective optimization is a critical research topic in the evolutionary computing community. Many algorithms have been proposed to tackle this problem, with evolutionary algorithms based on the hypervolume being among the most effective ones. However, calculating the hypervolume indicator in high-dimensional objective spaces remains time-consuming. To address this issue, we propose a two-stage hypervolume-based evolutionary algorithm (ToSHV) that separates global search and local search to ensure both convergence and diversity. ToSHV performs a global search in the first stage by generating multiple offspring per generation. We modified the R2HCA method to estimate the overall hypervolume contribution, avoiding the time-consuming nature of updating the hypervolume contribution with the greedy method. In the second stage, only one offspring is produced per generation to emphasize local exploration and enhance population diversity. Furthermore, a stage-switching mechanism is designed to dynamically select the appropriate search mode based on the prevailing population distribution. We evaluate our algorithm on WFG and DTLZ test suites, comparing it with three hypervolume-based algorithms and four state-of-the-art algorithms. Experimental results show that our approach is competitive in most cases.

In this paper, we have proposed a novel algorithm based on Ant Colony Optimization (ACO) for finding near-optimal solutions for the Multi-dimensional Multi-choice Knapsack Problem (MMKP). MMKP is a discrete optimization problem, which is a variant of the classical 0-1 Knapsack Problem and is also an NP-hard problem. Due to its high computational complexity, exact solutions of MMKP are not suitable for most real-time decision-making applications e.g. QoS and Admission Control for Adaptive Multimedia Systems, Service Level Agreement (SLA) etc. Although ACO algorithms are known to have scalability and slow convergence issues, here we have augmented the traditional ACO algorithm with a unique random local search, which not only produces near-optimal solutions but also greatly enhances convergence speed. A comparative analysis with other state-of-the-art heuristic algorithms based on public MMKP dataset shows that, in all cases our approaches outperform others. We have also shown that our algorithms find near optimal (within 3% of the optimal value) solutions within milliseconds, which makes our approach very attractive for large scale real time systems.

We study the multidimensional knapsack problem, present some theoretical and empirical results about its structure, and evaluate different integer linear programming (ILP)-based, metaheuristic, and collaborative approaches for it. We start by considering the distances between optimal solutions to the LP relaxation and the original problem and then introduce a new core concept for the multidimensional knapsack problem (MKP), which we study extensively. The empirical analysis is then used to develop new concepts for solving the MKP using ILP-based and memetic algorithms. Different collaborative combinations of the presented methods are discussed and evaluated. Further computational experiments with longer run times are also performed to compare the solutions of our approaches to the best-known solutions of another so-far leading approach for common MKP benchmark instances. The extensive computational experiments show the effectiveness of the proposed methods, which yield highly competitive results in significantly shorter run times than do previously described approaches.

Solving the bi-objective multi-dimensional knapsack problem exploiting the concept of core