A co-evolutionary decomposition-based algorithm for the bi-level knapsack optimisation problem

The bilevel optimisation problem (BLP) is a subclass of optimisation problems in which one of the constraints of an optimisation problem is another optimisation problem. BLP is widely used to model hierarchical decision making where the leader and the follower correspond to the upper level and lower level optimisation problem, respectively. In BLP, the optimal solutions to the lower level optimisation problem are the feasible solutions to the upper level problem, which makes it particularly difficult to solve. This paper proposes a novel hardware architecture known as Recursive Pipelined Genetic Propagation (RPGP), to solve BLP efficiently on FPGA. RPGP features a graph of genetic operation nodes which can be scaled to exploit hardware resources. In addition, the topology of the RPGP graph can be changed at run-time to escape from local optima. We evaluate the proposed architecture on an Altera Stratix-V FPGA, using a benchmark bilevel optimisation problem set. Our experimental results show that RPGP can achieve a significant speed-up against previous work.

Bilevel optimization problems require every feasible upper-level solution to satisfy optimality of a lower-level optimization problem. These problems commonly appear in many practical problem solving tasks including optimal control, process optimization, game-playing strategy development, transportation problems, and others. In the context of a bilevel single objective problem, there exists a number of theoretical, numerical, and evolutionary optimization results. However, there does not exist too many studies in the context of having multiple objectives in each level of a bilevel optimization problem. In this paper, we address bilevel multi-objective optimization issues and propose a viable algorithm based on evolutionary multi-objective optimization (EMO) principles. Proof-of-principle simulation results bring out the challenges in solving such problems and demonstrate the viability of the proposed EMO technique for solving such problems. This paper scratches the surface of EMO-based solution methodologies for bilevel multi-objective optimization problems and should motivate other EMO researchers to engage more into this important optimization task of practical importance.

Combinatorial bi-level optimization remains a challenging topic, especially when the lower-level is an NP-hard problem. In this paper, we tackle large-scale and combinatorial bi-level problems using GP hyper-heuristics, i.e., an approach that permits to train heuristics like a machine learning model. Our contribution aims at targeting the intensive and complex lower-level optimizations that occur when solving a large-scale and combinatorial bi-level problem. For this purpose, we consider hyper-heuristics through heuristic generation. Using a GP hyper-heuristic approach, we train greedy heuristics in order to make them more reliable when encountering unseen lower-level instances that could be generated during bi-level optimization. To validate our approach referred to as GA+AGH, we tackle instances from the bi-level cloud pricing optimization problem (BCPOP) that model the trading interactions between a cloud service provider and cloud service customers. Numerical results demonstrate the abilities of the trained heuristics to cope with the inherent nested structure that makes bi-level optimization problems so hard. Furthermore, it has been shown that training heuristics for lower-level optimization permits to outperform human-based heuristics and metaheuristics which constitute an excellent outcome for bi-level optimization.

Uncertainties in variables and parameters cause optimization problems to move away from globally-optimal and uncertain solutions. Practitioners resort to finding robust and reliable solutions in such situations. Bilevel optimization problems involving a hierarchy of two nested optimization problems have received a growing attention in the recent past due to their relevance in practice. While a number of studies on bilevel solution methodologies and applications are available for a deterministic setup, but studies on uncertainties in bilevel optimization are rare. In this paper, we suggest methodologies for handling uncertainty in both lower and upper level variables that may occur from different practicalities. For the first time, we perform a systematic study demonstrating the effect of uncertainties in each level along with the definition of robustness and reliability in the context of bilevel optimization. The issues and complexities introduced due to such uncertainties are then studied through a number of test cases, for brevity, we only show results on three test cases. Finally, two real-world bilevel problems involving uncertainties in their variables are solved. The study provides foundations and demon- strates viable directions for further research in uncertainty-based bilevel optimization problems.

MotivationWithin Flux Balance Analysis, the investigation of complex subtasks, such as finding the optimal perturbation of the network or finding an optimal combination of drugs, often requires to set up a bilevel optimization problem. In order to keep the linearity and convexity of these nested optimization problems, an ON/OFF description of the effect of the perturbation (i.e. Boolean variable) is normally used. This restriction may not be realistic when one wants, for instance, to describe the partial inhibition of a reaction induced by a drug.ResultsIn this paper we present a formulation of the bilevel optimization which overcomes the oversimplified ON/OFF modeling while preserving the linear nature of the problem. A case study is considered: the search of the best multi-drug treatment which modulates an objective reaction and has the minimal perturbation on the whole network. The drug inhibition is described and modulated through a convex combination of a fixed number of Boolean variables. The results obtained from the application of the algorithm to the core metabolism of E.coli highlight the possibility of finding a broader spectrum of drug combinations compared to a simple ON/OFF modeling.ConclusionsThe method we have presented is capable of treating partial inhibition inside a bilevel optimization, without loosing the linearity property, and with reasonable computational performances also on large metabolic networks. The more fine-graded representation of the perturbation allows to enlarge the repertoire of synergistic combination of drugs for tasks such as selective perturbation of cellular metabolism. This may encourage the use of the approach also for other cases in which a more realistic modeling is required.

Bilevel and multi-objective optimization methods are often useful to spatially target agri-environmental policy throughout a watershed. This type of problem is complex and is comprised of a number of practicalities: (i) a large number of decision variables, (ii) at least two inter-dependent levels of optimization between policy makers and policy followers, and (iii) uncertainty in decision variables and problem parameters. Given agricultural and economic data from the Raccoon watershed in central Iowa, we formulate a bilevel multi-objective optimization problem that accommodates objectives of both policy makers and farmers. The solution procedure then explicitly accounts for the nested nature of farm-level management decisions in response to agri-environmental policy incentives constructed by policy makers. We specifically examine the spatial targeting of a fertilizer-reduction incentive policy while seeking to maximize farm-level productivity while generating mandated water quality improvements using this framework. We test three different evolutionary optimization algorithms - m-BLEAQ, NSGA-II, and SPEA2 - and show that m-BLEAQ is well suited for handling the bilevel optimization problems and the considered practicalities.

We consider the optimistic bilevel optimization problem, known to have a wide range of applications in engineering, that we transform into a single-level optimization problem by means of the lower-level optimal value function reformulation. Subsequently, based on the partial calmness concept, we build an equation system, which is parameterized by the corresponding partial exact penalization parameter. We then design and analyze a Levenberg–Marquardt method to solve this parametric system of equations. Considering the fact that the selection of the partial exact penalization parameter is a critical issue when numerically solving a bilevel optimization problem by means of the value function reformulation, we conduct a careful experimental study to this effect, in the context of the Levenberg–Marquardt method, while using the Bilevel Optimization LIBrary (BOLIB) series of test problems. This study enables the construction of some safeguarding mechanisms for practical robust convergence of the method and can also serve as base for the selection of the penalty parameter for other bilevel optimization algorithms. We also compare the Levenberg–Marquardt method introduced in this paper to other existing algorithms of similar nature.

In this paper, we consider the problem of scheduling N robots interacting with a moving target. Both, the sequence of the robots and their trajectories are unknown and subject to optimization. Such type of problems appear in highly automated production plants and in the simulation of virtual factories. The purpose of the paper is to provide a mathematical model and to suggest a numerical solution approach. Our approach is based on the formulation of the problem as a bilevel optimization problem, where the lower level problem is an optimal control problem, while the upper level problem is a finite dimensional mixed-integer optimization problem. We approach the problem by exploitation of necessary optimality conditions for the lower level problem and by application of a Branch & Bound method for the resulting single level optimization problem. Two settings are taken into account. Firstly, no state constraints are assumed on the lower level problem, thus the local minimum principle applies directly. Secondly, the problem setting is augmented by pure state constraints, which are being handled by virtual controls in order to regularize the problem.

Digital Twin (DT) and mobile edge computing are two promising solutions for achieving latency-sensitive and computing-intensive applications in Industrial Internet of Things (IIoT). However, existing task offloading schemes with DT empowerment are faced with challenges, such as the spatio-temporal heterogeneity of edge server (ES) resources, resource-constrained ESs, and the explosive growth of data in emerging applications. This paper investigates the issues of task offloading and resource allocation under the assistance of DT and multiple ESs parallel collaboration. One novel scheme, abbreviated as Mes-PCORA, is proposed. With comprehensive information within the digital space, the Mes-PCORA scheme dynamically adjusts task allocation ratios across multiple ESs to achieve collaborative task offloading. The offloading request is formulated as a non-convex problem. To make the non-convex problem solvable in polynomial time, the original problem transformed into a bilevel optimization problem. Then, a bilevel iterative optimization approach is proposed. Specifically, the upper-level optimization problem is formulated as a multi-agent Markov Decision Process, and a deep reinforcement learning-based resource allocation algorithm is designed to solve it. Subsequently, for the lower-level optimization problem, it is solved by the interior point method. Numerical results demonstrate that the proposed scheme reduces the average task completion latency by 27.16%–63.44% and decreases the task offloading failure rate by 35.83%–73.95%, compared to state-of-the-art baselines.

A distributionally robust optimization model for batch nonlinear switched time-delay system considering uncertain output measurements

Multilevel optimization problems deals with mathematical programming problems whose feasible set is implicitly determined by a sequence of nested optimization problems. These kind of problems are common in different applications where there is a hierarchy of decision makers exists. Solving such problems has been a challenge especially when they are non linear and non convex. In this paper we introduce a new algorithm, inspired by natural adaptation, using (1+1)-evolutionary strategy iteratively. Suppose there are k level optimization problem. First, the leader’s level will be solved alone for all the variables under all the constraint set. Then that solution will adapt itself according to the objective function in each level going through all the levels down. When a particular level’s optimization problem is solved the solution will be adapted the level’s variable while the other variables remain being a fixed parameter. This updating process of the solution continues until a stopping criterion is met. Bilevel and trilevel optimization problems are used to show how the algorithm works. From the simulation result on the two problems, it is shown that it is promising to uses the proposed metaheuristic algorithm in solving multilevel optimization problems.KeywordsMultilevel optimization(1+1)-Evolutionary strategymetaheuristic algorithmsNatural adaptation

When the lower-level optimal solution set-valued mapping of a bilevel optimization problem is not single-valued, we are faced with an ill-posed problem, which gives rise to the optimistic and pessimistic bilevel optimization problems, as tractable algorithmic frameworks. However, solving the pessimistic bilevel optimization problem is far more challenging than the optimistic one; hence, the literature has mostly been dedicated to the latter class of the problem. The Scholtes relaxation has appeared to be one of the simplest and most efficient ways to solve the optimistic bilevel optimization problem in its Karush-Kuhn-Tucker (KKT) reformulation or the corresponding more general mathematical program with complementarity constraints (MPCC). Inspired by such a success, this paper studies the potential of the Scholtes relaxation in the context of the pessimistic bilevel optimization problem. To proceed, we consider a pessimistic bilevel optimization problem, where all the functions involved are at least continuously differentiable. Then assuming that the lower-level problem is convex, the KKT reformulation of the problem is considered under the Slater constraint qualification. Based on this KKT reformulation, we introduce the corresponding version of the Scholtes relaxation algorithm. We then construct theoretical results ensuring that the limit of a sequence of global/local optimal solutions (resp. stationary points) of the aforementioned Scholtes relaxation is a global/local optimal solution (resp. stationary point) of the KKT reformulation of the pessimistic bilevel program. The results are accompanied by technical constructions ensuring that the Scholtes relaxation algorithm is well-defined or that the corresponding parametric optimization problem is more tractable. Furthermore, we perform some numerical experiments to assess the performance of the Scholtes relaxation algorithm using various examples. In particular, we study the effectiveness of the algorithm in obtaining solutions that can satisfy the corresponding C-stationarity concept.

This paper addresses a bilevel optimization problem with a guaranteed (pessimistic) solution in a rather general form. The problem is reduced to a family of bilevel problems with optimistic solutions and perturbed follower's problems. For the quadratic-linear bilevel optimization problem, a reduction of the bilevel problem to a series of non-convex one-level optimization problems is proposed using the penalty method. Additionally, a solution method based on Global Search Theory (GST) is developed for the obtained problem. The GST consists of two stages: special local search and Global Search Scheme (GSS), which is based on Global Optimality Conditions (GOCs). The computational testing of the developed approach on specially constructed bilevel problems of high dimensions was successfully carried out. Finally, the computational testing on specially constructed bilevel problems of rather high dimensions was successfully carried out, that substantiate the developed approach.

In this paper, we propose a set of six test problems for single-objective bilevel optimization. The test-collection represents various difficulties which are commonly encountered in practical bilevel optimization problems. To support experiments with problems of different size, all of the test problems are scalable in terms of the number of variables. The problem set is also accompanied by a construction procedure, which helps to generate new test problems with controlled difficulties in convergence and interaction patterns between the two optimization levels. To provide a baseline result for easy comparisons, we have solved a 10 variable instance for each of the test problems using a simple bilevel evolutionary algorithm. The results presented may be used as a benchmark while evaluating the performance of any bilevel optimization algorithm.

This paper contributes to a deeper understanding of the link between a now conventional framework in hierarchical optimization called the optimistic bilevel problem and its initial more difficult formulation that we call here the original optimistic bilevel optimization problem. It follows from this research that although the process of deriving necessary optimality conditions for the latter problem is more involved, the conditions themselves do not---to a large extent---differ from those known for the conventional problem. It has already been well recognized in the literature that for optimality conditions of the usual optimistic bilevel program appropriate coderivative constructions for the set-valued solution map of the lower-level problem could be used, while it is shown in this paper that for the original optimistic formulation we have to go a step further to require and justify a certain Lipschitz-like property of this map. This is related to the local Lipschitz continuity of the optimal value funct...