AN ADVERSARIAL MODEL FOR DISTRIBUTED DYNAMIC LOAD BALANCING

Routing is a very complex process in the field programmable gate array (FPGA) CAD flow. The increase of both FPGA size and design complexity leads to a long routing time hindering the productivity. In this article, we propose a more effective parallel router that combines static and dynamic load balance in parallel routing for FPGAs. First, we explore hierarchical region partitioning to assign routing tasks to different cores for static load balance. Then, we coordinate message propagation and task migration at runtime so that load balance between cores can be dynamically maintained in parallel routing. Finally, we combine static and dynamic load balance in the parallel routing for a higher degree of parallelism. Our parallel router performs on the multicore distributed-memory systems and the communication between cores is through message passing interface messages. We demonstrate the effectiveness of our parallel router using large-scale Titan designs. On average, our parallel router can scale up to 32 cores to achieve about 17× speedup with slight loss of quality, compared with the latest VTR 8 router.

Dynamic Load Balancing (DLB) is sine qua non in modern distributed systems to ensure the efficient utilization of computing resources therein. This paper proposes a novel framework for hybrid dynamic load balancing. Its framework uses a Genetic Algorithms (GA) based supernode selection approach within. The GA-based approach is useful in choosing optimally loaded nodes as the supernodes directly from data set, thereby essentially improving the speed of load balancing process. Applying the proposed GA-based approach, this work analyzes the performance of hybrid DLB algorithm under different system states such as lightly loaded, moderately loaded, and highly loaded. The performance is measured with respect to three parameters: average response time, average round trip time, and average completion time of the users. Further, it also evaluates the performance of hybrid algorithm utilizing OnLine Transaction Processing (OLTP) benchmark and Sparse Matrix Vector Multiplication (SPMV) benchmark applications to analyze its adaptability to I/O-intensive, memory-intensive, or/and CPU-intensive applications. The experimental results show that the hybrid algorithm significantly improves the performance under different system states and under a wide range of workloads compared to traditional decentralized algorithm.

A multiprocessor system is a computer with two or more central processing units (CPUs) with each one sharing the common main memory as well as the peripherals. Multiprocessor system is either homogeneous or heterogeneous system. A homogeneous system is a cluster of processors joined to a high speed network for accomplishing the required task; also it is defined as parallel computing system. Homogeneous is a technique of parallel computing system. A heterogeneous system can be defined as the interconnection of a number of processors, having dissimilar computational speed. Load balance is a method of distributing work between the processors fairly in order to get optimal response time, resource utilization, and throughput. Load balancing is either static or dynamic. In static load balancing, work is distributed among all processors before the execution of the algorithm. In dynamic load balancing, work is distributed among all processors during execution of the algorithm. So problems arise when it cannot statistically divide the tasks among the processors. To use multiprocessor systems efficiently, several load balancing algorithms have been adopted widely. This paper proposes an efficient load balance algorithm which addresses common overheads that may decrease the efficiency of a multiprocessor system. Such overheads are synchronization, data communication, response time, and throughput.

Resource Virtualization and Load Balancing are main objectives to reduce the power consumption and to improve the performance of large data centers (DC). The management of Cloud Data Centers (CDC) requires an accurate planning and an efficient use of system resources in order to save energy consumption (greening), to provide Quality of Service (QoS), and to meet negotiated Service Level Agreements (SLA). This contribution addresses the question of modeling and the development of generic queuing models for energy-efficient use of resources for dynamic load balancing in virtualized CDCs. Performance models are developed for energy efficiency through automatic Server Consolidation, Dynamic Voltage and Frequency Scaling (DVFS) under Static Load Balancing; Dynamic Load Balancing can be achieved through Virtual Machine (VM) migrations. The analysis of such models provides quantitative performance figures upon which the system operation can be optimized with respect to guaranteed real-time performance and energy efficiency under prescribed SLAs.

In Cloud Computing (CC) environment, load balancing refers to the process of optimizing resources of virtual machines. Load balancing in the CC environment is one of the analytical approaches utilized to ensure indistinguishable workload distribution and effective utilization of resources. This is because only by ensuring effective balance of dynamic workload results in higher user satisfaction and optimal allocation of resource, therefore improve cloud application performance. Moreover, a paramount objective of load balancing is task scheduling because surges in the number of clients utilizing cloud lead to inappropriate job scheduling. Hence, issues encircling task scheduling has to be addressed. In this work a method called, Ford Fulkerson and Newey West Regression-based Dynamic Load Balancing (FF-NWRDLB) in CC environment is proposed. The FF-NWRDLB method is split into two sections, namely, task scheduling and dynamic load balancing. First, Ford Fulkerson-based Task Scheduling is applied to the cloud user requested tasks obtained from Personal Cloud Dataset. Here, employing Ford Fulkerson function based on the flow of tasks, energy-efficient task scheduling is ensured. The execution of asymmetrical scientific applications can be smoothly influenced by an unbalanced workload distribution between computing resources. In this context load balancing signifies as one of the most significant solution to enhance utilization of resources. However, selecting the best accomplishing load balancing technique is not an insignificant piece of work. For example, selecting a load balancing model does not work in circumstances with dynamic behavior. In this context, a machine learning technique called, Newey West Regression-based dynamic load balancer is designed to balance the load in a dynamic manner at run time, therefore ensuring accurate data communication. The FF-NWRDLB method has been compared to recent algorithms that use the markov optimization and the prediction scheme to achieve load balancing. Our experimental results show that our proposed FF-NWRDLB method outperforms other state of the art schemes in terms of energy consumption, throughput, delay, bandwidth and task scheduling efficiency in CC environment.

The fundamental problems in dynamic load balancing and job scheduling in parallel and distributed computers involve moving load between processors. In this paper, we consider a new model for load movement in synchronous parallel and distributed machines. In each step of our model, each processor can transfer load to at most one neighbor; also, any amount of load can be moved along a communication link between two processors in one step. This is a reasonable model for load movement in significant classes of dynamic load balancing problems.We derive efficient algorithms for a number of task reallocation problems under our model of load movement. These include dynamic load balancing on processor networks, adaptive mesh re-partitioning such as those in finite element methods, and progressive job migration under dynamic generation and consumption of load.To obtain the above-mentioned results, we introduce and solve the abstract problem of Incremental Weight Migration (IWM) on arbitrary graphs. Our main result is a simple, randomized, algorithm for this problem which provably results in asymptotically optimal convergence towards the state where weights on the nodes of the graph are all equal. This algorithm utilizes an appropriate random set of edges forming a matching. Our algorithm for the IWM problem is used in deriving efficient algorithms for all the problems mentioned above.Our results are very general. The algorithms we derive are local, and hence, scalable. They work for arbitrary load distributions and for networks of arbitrary topology which can possibly undergo link failures. Of independent interest is our proof technique which we use to lower bound the convergence of our algorithms in terms of the eigenstructure of the underlying graph.Finally, we present preliminary experimental results analyzing issues in load balancing related to our algorithms.

Any micro service-based programme, including alumni management software, must include load balancing. The effective use of resources is made possible by load balancing, which also ensures that application performance is unaffected by unexpected increases in requests or user usage. In an alumni management application, load balancing can be achieved with a combination of techniques such as round-robin scheduling, weighted load balancing, and dynamic scheduling. These techniques help to ensure that the application remains up and running, even during peak usage times. Additionally, load balancing can be used to ensure users get the best possible experience when using the application. By distributing traffic among multiple back-end services, users can expect faster response times and more reliable performance.Load balancing in a micro services-based alumni management application is a way of distributing incoming web traffic across multiple back end servers in order to efficiently manage traffic, reduce latency, and improve overall performance. Load balancing works by distributing incoming requests across a cluster of servers, and can be done either statically or dynamically. Static load balancing assigns each request to a specific server, while dynamic load balancing uses algorithms to decide which server should handle each request. In the alumni management application, load balancing is important for ensuring that requests are handled efficiently and that the system is not overwhelmed by too many requests. This is especially important when multiple users are accessing the application simultaneously. By distributing requests across multiple servers, the application can remain responsive and reliable even under heavy load.

In the era of petascale supercomputing, the importance of load balancing is crucial. Although dynamic load balancing is widespread, it is increasingly difficult to implement effectively with thousands of processors or more, prompting a second look at static load-balancing techniques even though the optimal allocation of tasks to processors is an NP-hard problem. We propose a heuristic static load-balancing algorithm, employing fitted benchmarking data, as an alternative to dynamic load balancing. The problem of allocating CPU cores to tasks is formulated as a mixed-integer nonlinear optimization problem, which is solved by using an optimization solver. On 163,840 cores of Blue Gene/P, we achieved a parallel efficiency of 80% for an execution of the fragment molecular orbital method applied to model protein-ligand complexes quantum-mechanically. The obtained allocation is shown to outperform dynamic load balancing by at least a factor of 2, thus motivating the use of this approach on other coarse-grained applications.

Reduction of the execution time of a job through equitable distribution of work load among the processors in a distributed system is the goal of load balancing. Performance of static and dynamic load balancing algorithms for the extended hypercube, is discussed. Threshold algorithms are very well-known algorithms for dynamic load balancing in distributed systems. An extension of the threshold algorithm, called the multilevel threshold algorithm, has been proposed. The hierarchical interconnection network of the extended hypercube is suitable for implementing the proposed algorithm. The new algorithm has been implemented on a transputer-based system and the performance of the algorithm for an extended hypercube is compared with those for mesh and binary hypercube networks.

Edge computing provides crucial support to next-generation mobile services that demand high data rates, low latency, and high reliability. The development of high data rate communication has lead to the emergence of cell densification as a key enabler for 5G. Unfortunately, the cost of fiber for backhaul and fronthaul poses hindrance to wide-scale adoption of small cells. Free Space Optics (FSO) offers a cost-effective alternative, though its performance is vulnerable to adverse weather, particularly fog. Recent advances in adaptive optics and automatic steering/tracking have improved FSO reliability by reducing pointing errors and enabling dynamic link reconfiguration, which further supports intelligent traffic diversion and load balancing across edge servers. In this paper, we propose a multi-hop mesh optical access network that integrates fiber-based Passive Optical Networks (PONs) with steerable FSO links to provide reliable and scalable backhaul for dense Radio Access Networks (RANs). A joint optimization framework for dynamic routing and edge server load balancing is developed. Extensive simulations demonstrate that the proposed design ensures fairness, reduces the number of required FSO transceivers, and delivers data rates comparable to established benchmarks.

Load balancing is performed to achieve the optimal use of the existing computational resources as much as possible whereby none of the resources remains idle while some other resources are being utilized. Balanced load distribution can be achieved by the immigration of the load from the source nodes which have surplus workload to the comparatively lightly loaded destination nodes. Applying load balancing during run time is called dynamic load balancing (DLB). DLB can be realized both in a direct or iterative manner according to the execution node selection. In iterative methods, the final destination node is determined through several iteration steps, while in direct methods it is selected in one step. This paper presents the randomized hydrodynamic load balancing (RHLB) method which is a hybrid method that takes advantage of both direct and iterative methods. Using random load migration as a direct method, RHLB approach intends to solve the problems derived from the exceptional instantaneous load rises, and diffuse the surplus workload to relatively free resources. Besides, using hydrodynamic approach as an iterative method, RHLB aims to consume minimum possible system resources to balance the common workload distributions. The results of the experiments designate that, RHLB outruns other iterative based methods in terms of both balance quality and the total time of the load balancing process.

This paper reports on the results of a preliminary study in dynamic load balancing on an Intel Hypercube. The purpose of this research is to provide experimental data in how parallel algorithms should be constructed to obtain maximal utilization of a parallel architecture. This study is one aspect of an ongoing research project into the construction of an automated parallelization tool. This tool will take FORTRAN source as input, and construct a parallel algorithm that will produce the same results as the original serial input. The focus of this paper is on the load balancing aspect of that project. The basic idea is to reserve a certain percentage of the computation task, subdivide that percentage into arbitrarily fine tasks, and dole those small tasks out to nodes on request. Ij” the percentage is chosen correctly, then a minority of nodes should be involved in consuming the filler tasks, and the overall throughput of the job should increase as a result of the individual node efJciencies having increased. This paper will outline our approach to performing dynamic load balancing on an Intel iPSC/2. We take the view that the problem of load balancing is really a problem of dividing a “computational task” into smaller components, each of roughly equal complexity, and each an independent event. After this is done, the components of the task can be sent to a node for execution. The key to an optimally balanced load across all computational nodes is the ability to form a statistical profile of the individual components of each computational task. This statistical profile will determine an initial sequence of execution. Our experience indicates that a speedup on the order of 80% is achievable with the judicious use of profiled load balancing. During the process of execution, the initial profile will be altered according to the actual behavior exhibited by the nodes. The difference between the actual and expected performance will be used to determine how much additional time should be devoted to altering the current execution schedule. Currently, our work involves statically setting the load balancing parameters. Our load balancing system determines the execution schedule

The uncertain nature of mapping user tasks to Virtual Machines (VMs) causes system failure or execution delay in Cloud Computing. To maximize cloud resource throughput and decrease user response time, load balancing is needed. Possible load balancing is needed to overcome user task execution delay and system failure. Most swarm intelligent dynamic load balancing solutions that used hybrid metaheuristic algorithms failed to balance exploitation and exploration. Most load balancing methods were insufficient to handle the growing uncertainty in job distribution to VMs. Thus, the Hybrid Spotted Hyena and Whale Optimization Algorithm-based Dynamic Load Balancing Mechanism (HSHWOA) partitions traffic among numerous VMs or servers to guarantee user chores are completed quickly. This load balancing approach improved performance by considering average network latency, dependability, and throughput. This hybridization of SHOA and WOA aims to improve the trade-off between exploration and exploitation, assign jobs to VMs with more solution diversity, and prevent the solution from reaching a local optimality. Pysim-based experimental verification and testing for the proposed HSHWOA showed a 12.38% improvement in minimized makespan, 16.21% increase in mean throughput, and 14.84% increase in network stability compared to baseline load balancing strategies like Fractional Improved Whale Social Optimization Based VM Migration Strategy FIWSOA, HD-WOA, and Binary Bird Swap.

ABSTRACTMesh adaption is a powerful tool for efficient unstructured-grid computations but causes load imbalance among proces-sors on a parallel machine. We present a novel method todynamically balance the processor workloads with a globalview. This paper presents, for the first time, the imple-mentation and integration of all major components withinour dynamic load balancing strategy for adaptive grid cal-culations. Mesh adaption, repartitioning, processor assign-ment, and remapping are critical components of the frame-work that must be accomplished rapidly and efficiently soas not to cause a significant overhead to the numerical sim-ulation. Previous results indicated that mesh repartitioningand data remapping are potential bottlenecks for perform-ing large-scale scientific calculations. We resolve these issuesand demonstrate that our framework remains viable on alarge number of processors.1 INTRODUCTIONDynamic mesh adaption on unstructured grids is a power-ful tool for computing unsteady three-dimensional problemsthat require grid modifications to efficiently resolve solu-tion features. By locally refining and coarsening the meshto capture flowfield phenomena of interest, such proceduresmake standard computational methods more cost effective.Highly refined meshes are required to accurately captureshock waves, contact discontinuities, vortices, and shear lay-ers. Local mesh adaption provides the opportunity to obtainsolutions that are comparable to those obtained on globally-refined grids but at a much lower cost.Unfortunately, the adaptive solution of unsteady prob-lems causes load imbalance among processors on a paral-lel machine. This is because the computational intensity isboth space and time dependent. An efficient parallel imple-mentation of such methods is extremely difficult to achieve,primarily because of the dynamically-changing nonuniformgrid. Various methods on dynamic load balancing have beenreported to date [5-9,11-14,16-18,24-26]; however, most ofthem either lack a global view of loads across processors orProceedings of the 9th ACM Symposium on Parallel Al-gorithms and Architectures, Newport, Rhode Island, June22-25, 1997.do not apply their techniques to realistic large-scale appli-cations.Figure 1 depicts our framework for parallel adaptive flowcomputation. It consists of a flow solver and a mesh adap-tor, with a partitioner and a remapper that load balancesand redistributes the computational mesh when necessary.Our goal is to build a portable system for efficiently per-forming adaptive large-scale flow calculations in a parallelmessage-passing environment. The mesh is first partitionedand mapped among the available processors. The flow solverthen runs for several iterations, updating solution variables.Once an acceptable solution is obtained, the mesh adaptionprocedure is invoked. It first targets edges for coarseningand refinement based on an error indicator computed fromthe flow solution. The old mesh is then coarsened, resultingin a smaller grid. Since edges have already been marked forrefinement, it is possible to exactly predict the new meshbefore actually performing the refinement step. Programcontrol is thus passed to the load balancer at this time. Aquick evaluation step determines if the new mesh will be sounbalanced as to warrant a repartitioning. If the currentpartitions will remain adequately load balanced, control mpassed back to the subdivision phase of the mesh adaptor.Otherwise, a repartitioning procedure is used to divide thenew mesh into subgrids. The new partitions are then reas-signed to the processors in a way that minimizes the costof data movement. If the remapping cost is less than thecomputational gain that would be achieved with balancedpartitions, all necessary data is appropriately redistributed.Otherwise, the new partitioning is discarded. The computa-tional mesh is then actually refined and the flow calculationis restarted.Notice from the framework in Fig. 1 that splitting themesh refinement step into two distinct phases of edge mark-ing and mesh subdivision allows the subdivision phase tooperate in a more load balanced fashion. In addition, sincedata remapping is performed before the mesh grows in sizedue to refinement, a smaller volume of data is moved. Thiscan lead to a potentially significant savings in the redistribu-tion cost. The load balancer also balances the computationalload for the flow solver while reducing the runtime commu-nication. This is important because flow solvers are usuallyseveral times more expensive than mesh adaptors. In anycase, it is obvious that mesh adaption, repartitioning, pro-cessor assignment, and remapping are critical componentsof the framework and must be accomplished rapidly and ef-ficiently so as not to cause a significant overhead to the flowcomputation.

This article introduces a new load balancing algorithm, called diffusive load balancing, and compares its performance with three other load balancing algorithms: static, round robin, and shortest queue load balancing. The comparison of load balancing algorithms is made in three simulated client-server environments: a small-scale, intranet, and Internet environment. Experimental results of performance modeling show that diffusive load balancing is better than round robin and static load balancing in a dynamic environment, which manifest in frequent clients' object creation requests and in short objects' lifetimes. In this research, the diffusive load balancing algorithm is discussed in juxtaposition with the distributed client-server architectures.