A randomized heuristic repair for the multidimensional knapsack problem

This paper introduces solutions to deal with the Multidimensional Knapsack Problem (MKP), which is a NP-hard combinatorial optimisation problem. Two hybrid heuristics based on Genetic Algorithms (GA) are proposed: the Memetic Search Algorithm (MSA) and the Genetic Algorithm Guided by Pretreatment information (GAGP). MSA combines sequentially GA with the Stochastic Local Search-Simulated Annealing algorithm (SLSA). GAGP is composed of two steps, in the first, a ratio-based greedy algorithm extracts useful information and the core concept is utilised to decompose items according to their ratios; In the second, these information are integrated to the operators of a GA allowing to reach the best solutions faster. An operator is added to the GA to dynamically update the ratio values of the items. Two groups of data were used to examine the proposed approaches. A group of simple instances of MKP has been used to examine MSA and a group of complex MKP has been used to examine GAGP. The obtained results indicate that MSA and GAGP have the capability to give solutions of high quality.

A two-phase tabu-evolutionary algorithm for the 0–1 multidimensional knapsack problem

The multi-dimensional knapsack problem (MDKP) is a well-known NP-hard problem in combinatorial optimization. As it has various real-life applications, the MDKP has been intensively studied in the literature. On the other hand, far too little attention has been paid to the multi-objective version of the MDKP. In this chapter, we consider the bi-objective multi-dimensional knapsack problem (BOMDKP). We propose a Binary Genetic Algorithm (BGA) with an external archive for the problem. Our proposed BGA algorithm also employs a binary local search. The non-dominated solution sets are obtained for various bi-objective benchmark instances with 100, 250, 500 and 750 items, by employing the proposed BGA. Then, the performance of the BGA is compared with other multi-objective algorithms from the literature, i.e., MOEA/D and MOFPA. Furthermore, it is observed that the Pareto-optimal solution set provided by Zitzler and Laumans for 500 items and 2 knapsacks includes 30 dominated solutions. Also, the Pareto-optimal solutions for the scenario with 750 items are not reported in Zitzler and Thiele [43]. Hence, the true Pareto-optimal solution sets are found for all benchmark problem instances using Improved Augmented Epsilon Constraint (AUGMECON2) method. The non-dominated solution sets of the BGA, MOEA/D and MOFPA are compared with the Pareto-optimal solution sets for all test instances. The computational results indicate that the proposed BGA is more effective to solve the BOMDKP than the best-performing algorithms from the literature.

We study the multidimensional knapsack problem, present some theoretical and empirical results about its structure, and evaluate different integer linear programming (ILP)-based, metaheuristic, and collaborative approaches for it. We start by considering the distances between optimal solutions to the LP relaxation and the original problem and then introduce a new core concept for the multidimensional knapsack problem (MKP), which we study extensively. The empirical analysis is then used to develop new concepts for solving the MKP using ILP-based and memetic algorithms. Different collaborative combinations of the presented methods are discussed and evaluated. Further computational experiments with longer run times are also performed to compare the solutions of our approaches to the best-known solutions of another so-far leading approach for common MKP benchmark instances. The extensive computational experiments show the effectiveness of the proposed methods, which yield highly competitive results in significantly shorter run times than do previously described approaches.

The pigeon-inspired optimization algorithm is a category of a newly proposed swarm intelligence-based algorithm that belongs to the population-based solution technique. The MKP is a class of complex optimization problems that have many practical applications in the fields of engineering and sciences. Due to the practical applications of MKP, numerous algorithmic-based methods like local search and population-based search algorithms have been proposed to solve the MKP in the past few decades. This paper proposes a modified binary pigeon-inspired optimization algorithm named (Modified-BPIO) for the 0 - 1 multidimensional knapsack problem (MKP). The utilization of the binary pigeon-inspired optimization (BPIO) for solving the multidimensional knapsack problem came with huge success. However, it can be observed that the BPIO converges prematurely due to lost diversity during the search activities. Given the above, the crossover operator is integrated with the landmark component of the BPIO to improve the diversity of the solution space. The MKP benchmarks from the Operations Research (OR) library are utilized to test the performance of the proposed binary method. Experimentally, it is concluded that the proposed Modified-BPIO has a better performance when compared with the BPIO and existing state-of-the-arts that worked on the same MKP benchmarks.

A binary moth search algorithm based on self-learning for multidimensional knapsack problems

In this paper, we presented a New Hybrid Binary Particle Swarm Optimization (NHBPSO). This hybridization consists at combining some principles of Particle Swarm Optimization (PSO) and Crossover Operation of the Genetic Algorithm (GA). The proposed algorithm is used to solving the NP-hard combinatorial optimization problem of Multidimensional Knapsack Problem (MKP). In the aim to access the efficiency and performance of our NHBPSO algorithm we have tested it on some benchmarks from OR-Library and we have compared our results with the obtained results by the standard binary Particle Swarm Optimization with penalty function technique (PSO-P) algorithm and the quantum version (QICSA) of the new metaheuristic Cuckoo Search. The experimental results show a good and promise solution quality obtained by the proposed algorithm which outperforms the PSO-P and QICSA algorithms.

Knapsack problems are among the most common problems in literature tackled with evolutionary algorithms (EA). Their major advantage lies in the fact that they are relatively simple to implement while they allow generalizations for a wide range of real world problems. The multi-dimensional knapsack problem (MKP), which belongs to the class of NP-complete combinatorial optimization problems, is one of the variations of the knapsack problem. The MKP has a wide range of real world applications such as cargo loading, selecting projects to fund, budget management, cutting stock, etc. The MKP has been studied quite extensively in the EA community. Due to the constrained nature of the problem, constraint handling techniques gain great importance in the performance of the proposed EA approaches. In this study, the applicability of a generational EA that uses a penalty-based constraint handling technique and a gene locus based, asymmetric, adaptive mutation scheme is explored for the MKP. The effects of the parameters of the explored approach is determined through tests. Further experiments, using large MKP instances from commonly used benchmarks available through the Internet are performed. Comparison tables are given for the performance of the explored approach and other good performing EAs found in literature for the MKP. Results show that performance improves greatly when compared with other penalty-based techniques, but the explored approach is still not the best performer among all. However, unlike the explored technique, the EAs using the other constraint handling techniques require a great amount of extra computational effort and need heuristic information specific to the optimization problem. Based on these observations, and the fact that the performance difference between the explored scheme and the better performers is not too high, research on improving the explored approach is still in progress.

This paper proposes a novel approach for the multidimensional knapsack problem (MDKP) using differential evolution. Firstly, the principle and the pseudo-code of binary differential evolution with hybrid encoding (HBDE) are presented. On the basis of the existing repair operator 2 (RO2), an improved repair operator 3 (RO3) for handling the infeasible solutions of MDKP is developed. Then, combine HBDE with RO3, an efficient algorithm (HBDE-RO3) for MDKP is proposed. Finally, the experiment results of the 138 well-known MDKP benchmarks show that RO3 is advantageous to deal with the infeasible solutions than RO2, and the proposed algorithm HBDE-RO3 has superior performance for solving MDKP than the state-of-the-art algorithms.

Local and global lifted cover inequalities for the 0–1 multidimensional knapsack problem

In this paper, we have proposed a novel algorithm based on Ant Colony Optimization (ACO) for finding near-optimal solutions for the Multi-dimensional Multi-choice Knapsack Problem (MMKP). MMKP is a discrete optimization problem, which is a variant of the classical 0-1 Knapsack Problem and is also an NP-hard problem. Due to its high computational complexity, exact solutions of MMKP are not suitable for most real-time decision-making applications e.g. QoS and Admission Control for Adaptive Multimedia Systems, Service Level Agreement (SLA) etc. Although ACO algorithms are known to have scalability and slow convergence issues, here we have augmented the traditional ACO algorithm with a unique random local search, which not only produces near-optimal solutions but also greatly enhances convergence speed. A comparative analysis with other state-of-the-art heuristic algorithms based on public MMKP dataset shows that, in all cases our approaches outperform others. We have also shown that our algorithms find near optimal (within 3% of the optimal value) solutions within milliseconds, which makes our approach very attractive for large scale real time systems.

Solving the bi-objective multi-dimensional knapsack problem exploiting the concept of core

Finding and exploring promising search space for The 0–1 Multidimensional Knapsack Problem

Binary metaheuristic algorithms for 0–1 knapsack problems: Performance analysis, hybrid variants, and real-world application

Empirical orthogonal constraint generation for Multidimensional 0/1 Knapsack Problems