- Research Article
6
- 10.1016/j.suscom.2015.08.002
Energy efficient scheduling strategies in Federated Grids
- Sep 03, 2015
- Sustainable Computing: Informatics and Systems
- Katia Leal
Energy efficient scheduling strategies in Federated Grids
Grid enables resource sharing and dynamic allocation of computational resources. It is a great challenge to make numerous resources available on-demand to guarantee the Quality-of-Service for jobs. This paper presents a two-stage optimization model for resource allocation in grid. Job constraints are classified into mandatory constraints and negotiated constraints. In the first stage, a preprocessing procedure such as resource discovery deals with the mandatory constraints. This has been fulfilled as our previous work. In the second stage, negotiated constraints are treated as Knapsack Problem-based optimization problem. Centralized scheduling and decentralized scheduling have been considered in this paper. This work is fulfilled as part of the Constellation Model for grid resource management. We formulate centralized scheduling as Multi-Constraint Multiple Knapsack Problem (MCMKP). In centralized scheduling, jobs are submitted to a global job queue. A global scheduler assigns each job to a proper grid site according to the scheduling strategy. The scheduling is done periodically (e.g. daily or weekly). We formulate decentralized scheduling as Multi-Dimensional Knapsack Problem (MDKP). In decentralized scheduling, jobs are submitted to local job queues. Allocation decisions are made by local schedulers individually. Jobs that can not be executed immediately are sent to a global waiting queue. When local scheduling is initialized, a local scheduler can select jobs from both the local job queue and the global waiting queue. Objectives of both centralized scheduling and decentralized scheduling are to optimize the utility defined by a grid economy approach. The defined utility makes the trade-offs between user-concerned metrics and system-concerned metrics. Heuristic algorithms such as Very Large-Scale Neighborhood Search proposed by R. K. Ahuja and C. B. Cunha [2005] can be used to solve the combinatorial optimization problem. We implemented a prototype of the Constellation Model. Genetic algorithms for constrained optimization which is proposed by S. Venkatraman and G. G. Yen [2005] have been implemented to solve the above optimization problems. Experimental results show that, performance metrics such as gained utility, response rate, and resource utilization are improved and resources are allocated in an optimal way.
Energy efficient scheduling strategies in Federated Grids
Energy efficient scheduling strategies in Federated Grids
Automatic checkpointing based fault tolerance in computational grid
Although technology changes quick still more sophisticated computational techniques are needed to preserve them. The majority of the computational grids work-load-logs show that node or job failure is the major challenging task to deal with. Since very robust scheduling algorithms are used to handle varied resource allocation in computational grids. However there is a need in previous studies to remedy the failures and delay of executing jobs with respect to resource availability, which can handle both scheduling and efficient failure handling in any large scale high performance computational applications. Consequently the major issues concerned here is fault-tolerance to tolerate failures with regard to job scheduling and efficient failure handling mechanism. So synchronization is needed to embed both techniques. Recurrently using techniques for fault tolerance in the widely held computational applications are periodic job checkpointing and replication. Hence most of the job checkpointing techniques are not merely based on scheduling algorithm. This work presents an automated checkpointing strategy in computational grid based on different scheduling algorithms. Experimental results have shown that the proposed automated checkpointing of jobs based on fault tolerant scheduling strategy has got considerable improvement over conventional adaptive checkpointing algorithms.
Read moreImprovements to penalty-based evolutionary algorithms for the multi-dimensional knapsack problem using a gene-based adaptive mutation approach
Knapsack problems are among the most common problems in literature tackled with evolutionary algorithms (EA). Their major advantage lies in the fact that they are relatively simple to implement while they allow generalizations for a wide range of real world problems. The multi-dimensional knapsack problem (MKP), which belongs to the class of NP-complete combinatorial optimization problems, is one of the variations of the knapsack problem. The MKP has a wide range of real world applications such as cargo loading, selecting projects to fund, budget management, cutting stock, etc. The MKP has been studied quite extensively in the EA community. Due to the constrained nature of the problem, constraint handling techniques gain great importance in the performance of the proposed EA approaches. In this study, the applicability of a generational EA that uses a penalty-based constraint handling technique and a gene locus based, asymmetric, adaptive mutation scheme is explored for the MKP. The effects of the parameters of the explored approach is determined through tests. Further experiments, using large MKP instances from commonly used benchmarks available through the Internet are performed. Comparison tables are given for the performance of the explored approach and other good performing EAs found in literature for the MKP. Results show that performance improves greatly when compared with other penalty-based techniques, but the explored approach is still not the best performer among all. However, unlike the explored technique, the EAs using the other constraint handling techniques require a great amount of extra computational effort and need heuristic information specific to the optimization problem. Based on these observations, and the fact that the performance difference between the explored scheme and the better performers is not too high, research on improving the explored approach is still in progress.
Read moreSolving 0-1 Bi-Objective Multi-dimensional Knapsack Problems Using Binary Genetic Algorithm
The multi-dimensional knapsack problem (MDKP) is a well-known NP-hard problem in combinatorial optimization. As it has various real-life applications, the MDKP has been intensively studied in the literature. On the other hand, far too little attention has been paid to the multi-objective version of the MDKP. In this chapter, we consider the bi-objective multi-dimensional knapsack problem (BOMDKP). We propose a Binary Genetic Algorithm (BGA) with an external archive for the problem. Our proposed BGA algorithm also employs a binary local search. The non-dominated solution sets are obtained for various bi-objective benchmark instances with 100, 250, 500 and 750 items, by employing the proposed BGA. Then, the performance of the BGA is compared with other multi-objective algorithms from the literature, i.e., MOEA/D and MOFPA. Furthermore, it is observed that the Pareto-optimal solution set provided by Zitzler and Laumans for 500 items and 2 knapsacks includes 30 dominated solutions. Also, the Pareto-optimal solutions for the scenario with 750 items are not reported in Zitzler and Thiele [43]. Hence, the true Pareto-optimal solution sets are found for all benchmark problem instances using Improved Augmented Epsilon Constraint (AUGMECON2) method. The non-dominated solution sets of the BGA, MOEA/D and MOFPA are compared with the Pareto-optimal solution sets for all test instances. The computational results indicate that the proposed BGA is more effective to solve the BOMDKP than the best-performing algorithms from the literature.
Read moreBinary metaheuristic algorithms for 0–1 knapsack problems: Performance analysis, hybrid variants, and real-world application
Binary metaheuristic algorithms for 0–1 knapsack problems: Performance analysis, hybrid variants, and real-world application
Read moreLocal and global lifted cover inequalities for the 0–1 multidimensional knapsack problem
Local and global lifted cover inequalities for the 0–1 multidimensional knapsack problem
Hyper-Heuristic Approaches for the Travelling Thief Problem
The Travelling Thief Problem (TTP) is a relatively new combinatorial optimization problem that combines the two well known combinatorial optimization problems: the Travelling Salesman Problem (TSP) and the Knapsack Problem (KP). The two subproblems are combined such that optimal solutions for the individual subproblems do not imply an optimal solution for the overall problem. On the other hand, hyper-heuristic approaches are generic approaches used in optimization problems. They repeatedly select a heuristic from a predefined set of low-level heuristics (operators) and apply it to a solution to generate an improved one. In this paper, four single point selection hyper-heuristic approaches are applied to the Travelling Thief Problem. The applied approaches give comparable results to the state-of-the-art approaches proposed in the literature.
Read moreThe effect of elite pool in hybrid population-based meta-heuristics for solving combinatorial optimization problems
The effect of elite pool in hybrid population-based meta-heuristics for solving combinatorial optimization problems
Parallel skeletons for tabu search method
We present two generic parallel skeletons for the tabu search method-a well known meta-heuristic for approximately solving combinatorial optimization problems. The first skeleton is based on independent runs while the second in the classical master-slave model. Our starting point is the design and implementation of a sequential skeleton that is used later as basis for the two parallel skeletons. Both skeletons provide the user with the following: a permit to obtain parallel implementations of the tabu search method for concrete combinatorial optimization problems from existing sequential implementations; there is no need for the user to know either parallel programming or communication libraries; and the parallel implementation of tabu search for a concrete problem is obtained automatically from a sequential implementation of tabu search for the problem. The skeletons, however, require from the user a sequential instantiation of the tabu search method for the problem at hand. The skeletons are implemented in C++ using MPI as the communication library and offer genericity, flexibility, component reuse, robustness and time savings. We have instantiated the two skeletons for the 0-1 multidimensional knapsack problem, among others, for which we report computational results.
Read moreHybrid Genetic Algorithms to Solve the Multidimensional Knapsack Problem
This paper introduces solutions to deal with the Multidimensional Knapsack Problem (MKP), which is a NP-hard combinatorial optimisation problem. Two hybrid heuristics based on Genetic Algorithms (GA) are proposed: the Memetic Search Algorithm (MSA) and the Genetic Algorithm Guided by Pretreatment information (GAGP). MSA combines sequentially GA with the Stochastic Local Search-Simulated Annealing algorithm (SLSA). GAGP is composed of two steps, in the first, a ratio-based greedy algorithm extracts useful information and the core concept is utilised to decompose items according to their ratios; In the second, these information are integrated to the operators of a GA allowing to reach the best solutions faster. An operator is added to the GA to dynamically update the ratio values of the items. Two groups of data were used to examine the proposed approaches. A group of simple instances of MKP has been used to examine MSA and a group of complex MKP has been used to examine GAGP. The obtained results indicate that MSA and GAGP have the capability to give solutions of high quality.
Read moreA Modified Binary Pigeon-Inspired Algorithm for Solving the Multi-dimensional Knapsack Problem
The pigeon-inspired optimization algorithm is a category of a newly proposed swarm intelligence-based algorithm that belongs to the population-based solution technique. The MKP is a class of complex optimization problems that have many practical applications in the fields of engineering and sciences. Due to the practical applications of MKP, numerous algorithmic-based methods like local search and population-based search algorithms have been proposed to solve the MKP in the past few decades. This paper proposes a modified binary pigeon-inspired optimization algorithm named (Modified-BPIO) for the 0 - 1 multidimensional knapsack problem (MKP). The utilization of the binary pigeon-inspired optimization (BPIO) for solving the multidimensional knapsack problem came with huge success. However, it can be observed that the BPIO converges prematurely due to lost diversity during the search activities. Given the above, the crossover operator is integrated with the landmark component of the BPIO to improve the diversity of the solution space. The MKP benchmarks from the Operations Research (OR) library are utilized to test the performance of the proposed binary method. Experimentally, it is concluded that the proposed Modified-BPIO has a better performance when compared with the BPIO and existing state-of-the-arts that worked on the same MKP benchmarks.
Read moreKnowledge representation of mathematical optimization problems and constructs for modeling
Knowledge representation of mathematical optimization problems and constructs for modeling
A technique based on trade-off maps to visualise and analyse relationships between objectives in optimisation problems
Understanding the relationships between objectives in a multiobjective optimisation problem is important for developing tailored and efficient solving techniques. In particular, when tackling combinatorial optimisation problems with many objectives that arise in real-world logistic scenarios, better support for the decision maker can be achieved through better understanding of the often complex fitness landscape. This paper makes a contribution in this direction by presenting a technique that allows a visualisation and analysis of the local and global relationships between objectives in optimisation problems with many objectives. The proposed technique uses four steps: first the global pairwise relationships are analysed using the Kendall correlation method; then the ranges of the values found on the given Pareto front are estimated and assessed; next these ranges are used to plot a map using Gray code, similar to Karnaugh maps, that has the ability to highlight the trade-offs between multiple objectives; and finally local relationships are identified using scatter-plots. Experiments are presented for three different combinatorial optimisation problems: multiobjective multidimensional knapsack problem, multiobjective nurse scheduling problem and multiobjective vehicle routing problem with time windows. Results show that the proposed technique helps in the gaining of insights into the problem difficulty arising from the relationships between objectives.
Read moreSolving 0–1 Knapsack problem using Genetic Algorithms
This is a research project on using Genetic Algorithm to solve 0-1 Knapsack Problem. Knapsack problem is a combinational optimization problem. Given a set of items, each with a weight & value, it determine the number of each item to include in a collection so that the total weight is less than a given limit & the total value is as large as possible. The paper consists of three parts. In the first section we give brief description of Genetic Algorithms and some of its basic elements. Next, we describe the Knapsack Problem and Implementation of Knapsack problem using Genetic Algorithm. The main purpose of this paper is to implement Knapsack problem by an algorithm that is based on Genetic Algorithm. In this paper I have used Roulette-Wheel, Tournament Selection and Stochastic selection as a selection function and the succeeding populations are analyzed for the fitness value with hope to achieve the correct solution and expected results were observed.
Read moreCombining a Population-Based Approach with Multiple Linear Models for Continuous and Discrete Optimization Problems
Population-based approaches have given us new search strategies and ideas in order to solve optimization problems. Usually, these methods are based on the performance carried out by a finite number of agents, which by the interaction between them they evolve and work all over the search space. Also, it is well-known that the correct employment of parameter values in this kind of method can positively impact their performance and behavior. In this context, the present work focuses on the design of a hybrid architecture which smartly balances the population size on run-time. In order to smartly balance and control the population size, a modular approach, named Linear Modular Population Balancer (LMPB), is proposed. The main ideas behind the designed architecture include the solving strategy behind a population-based metaheuristic, the influence of learning components based on multiple statistical modeling methods which transform the dynamic data generated into knowledge, and the possibilities to tackle both discrete and continuous optimization problems. In this regard, three modules are proposed for LMPB, which concern tasks such as the management of the population-based algorithm, parameter setting, probabilities, learning methods, and selection mechanism for the population size to employ. In order to test the viability and effectiveness of our proposed approach, we solve a set of well-known benchmark functions and the multidimensional knapsack problem (MKP). Additionally, we illustrate promising solving results, compare them against state-of-the-art methods which have proved to be good options for solving optimization problems, and give solid arguments for future work in the necessity to keep evolving this type of proposed architecture.
Read more