Probabilistic Graphical Models for the Medical Industry Developed Using Enhanced Learning Algorithms

Bayesian network (BN) is a probabilistic graphical model which describes the joint probability distribution over a set of random variables. Finding an optimal network structure based on an available training dataset is one of the most important challenges in the field of BNs. Since the problem of searching the optimal BN structure belongs to the class of NP-hard problems, typically greedy algorithms are used to solve it. In this paper two novel learning automata-based algorithms are proposed to solve the BNs’ structure learning problem. In both, there is a learning automaton corresponding with each possible edge to determine the appearance and the direction of that edge in the constructed network; therefore, we have a game of learning automata, at each stage of the proposed algorithms. Two special cases of the game of the learning automata have been discussed, namely, the game with a common payoff and the competitive game. In the former, all the automata in the game receive a unique payoff from the environment, but in the latter, each automaton receives its own payoff. As the algorithms proceed, the learning processes focus on the BN structures with higher scores. The use of learning automata has led to design the algorithms with a guided search scheme, which can avoid getting stuck in local maxima. Experimental results show that the proposed algorithms are capable of finding the optimal structure of BN in an acceptable execution time; and compared with other search-based methods, they outperform them.

The loss minimization problem is one of the most important problems to save the operational cost in distribution systems. Therefore, more efficient approaches are required to handle such a combinatorial problem. This paper presents an efficient meta-heuristic method for reconfiguration of distribution systems. A Tabu Search (TS) algorithm is used to reconfigure distribution systems so that active power losses are globally minimized with turning on / off sectionalizing switches. TS algorithm is introduced with some modifications such as using a tabu list with variable size according to the system size; this should lead to robust algorithm, and prevent cycling. Also, a random multiplicative move is used in the search process to diversify the search toward unexplored regions. A new method to check the radial topology of the system is presented. The proposed method is applied to 32-node and 69-node distribution systems. The obtained results using the proposed TS approach are compared with results obtained using Simulated Annealing (SA) approach and Parallel Tabu Search (PTS) approach in the previous work to examine the performance.

In this paper, we address the flowpath design issue of Automated Guided Vehicle Systems (AGVSs). In particular, we concentrate on the design of unidirectional flowpaths (i.e. vehicles are restricted to travel only in one direction along a given segment of the flowpath). We have developed intelligent heuristics — simulated annealing and tabu search algorithms for the design of unidirectional AGVSs. Different versions of simulated annealing and tabu search algorithms are implemented. Our extensive computational results indicate that both simulated annealing and tabu search yield solutions of adequate quality for all practical purposes. A tabu search implementation with the use of a frequency-based memory structure dominates all tested heuristics in terms of solution quality (i.e. percent deviation from optimality), with an impressive average performance over 45 test problems of less than 0.85% deviation from optimality.

Meta-heuristic Bayesian networks retrieval combined polarization corrected temperature and scattering index for precipitations

When the project is scheduled with a given set of resources, it is difficult to find the optimal solution. Resourceconstrained scheduling problems (RCPSP) are generally NP-hard. In this paper, a high level heuristic procedure “Tabu Search Algorithm (TSA)” is proposed to provide good solutions to resource-constrained, deterministic activity duration project scheduling problems. We present the application results of the computational tabu search and OPL-CPLEX algorithm and compare them with that of earlier applicable researches along with a discussion about further research. Our computational results are presented, which establish the superiority of tabu search over the existing heuristic algorithms. Two different solution strategies are also discussed, namely tabu search and OPLCPLEX exact algorithm approach which can be used with the proposed model. Due to the execution time, we have shown that OPL-CPLEX's algorithm is a valid method with medium scale RCPSPs. For the considered deterministic problems, a good agreement has been obtained between theoretical and experimental results.

2차원 저장소 적재는 NP-hard 문제로서 그 문제의 정확한 해를 구하는 것이 어려운 것으로 알려져 있으며, 이의 더 좋은 해를 얻기 위해 유전자(genetic) 알고리즘, 시뮬레이티드 어닐링(simulated annealing), 타부서치(tabu search)등과 같은 근사적 접근법이 제안되어 왔다. 하지만 분지한계(branch-and-bound)나 타부서치 기법들을 이용한 기존의 대표적인 근사 알고리즘들은 휴리스틱 알고리즘의 해에 기반을 둠으로 효율성이 낮고 반복수행에 의한 계산시간이 길다. 따라서 본 논문에서는 이러한 근사 알고리즘의 복잡성을 간소화하고, 알고리즘의 효율성을 높이기 위해 적재가능성을 판단하는 적합성 함수(fitness function)를 정의하고 이를 이용하여 어떤 특정 개체의 적재영역을 판단하는데 영향을 주는 적재영역의 수를 계산한다. 또한, 이들을 이용한 새로운 휴리스틱 알고리즘을 제안하였다. 끝으로 기존의 휴리스틱 또는 메타휴리스틱 기법과의 비교실험을 통해 기존의 휴리스틱 알고리즘인 FFF와 FBS에 비해 97%의 결과가 같거나 우수하였으며, 타부서치 알고리즘에 비해 86%의 결과가 같거나 우수한 것으로 나타났다. The two-dimensional bin packing problem(2D-BPP) has been known to be NP-hard, and it is difficult to solve the problem exactly. Many approximation methods, such as genetic algorithm, simulated annealing and tabu search etc, have been also proposed to gain better solutions. However, the existing approximation algorithms, such as branch-and-bound and tabu search, have shown the low efficiency and the long execution time due to a large of iterations. To solve these problems, we first define the fitness function to simplify and increase the utility of algorithm. The function decides whether an item is packed into a given area, and as an important information for a packing strategy, the number of subarea that can accommodate a given item is obtained from the variant of the fitness function. Then we present a heuristic algorithm BF for 2D bin packing, constructed by the fitness function and subarea. Finally, the effectiveness of the proposed algorithm will be expressed by the comparison experiments with the heuristic and the metaheuristic of the literatures. As comparing with existing heuristic algorithms and metaheuristic algorithms, it has been found that the packing rate of algorithm BP is the same as 97% as existing heuristic algorithms, FFF and FBS, or better than them. Also, it has been shown the same as 86% as tabu search algorithm or better.

Tabu search with simulated annealing for solving a location–protection–disruption in hub network

In order to solve the problems that the intelligence algorithm falls into the local optimum easily and has a slow convergence in Bayesian networks (BN) structure learning, an algorithm based on adaptive selection operator with simulated annealing is proposed. This chapter conducts the adaptive selection rule in combination with conditional independence tests of BN nodes to guide the generation of neighbor. In order to better compare the adaptive effect, an algorithm based on selection operator with simulated annealing (SOSA) is proposed; at the same time 15 data sets in the three typical networks are accessed as learning samples. The results of the Bayesian Dirichlet (BD) score, Hamming distance (HD), and evolution time of the network after learning show that it has the quicker convergence and it searches the optimal solution more easily compared with simulated annealing (SA) and SOSA.

Recently, the use of the particle swarm optimization (PSO) technique for the reconstruction of microwave images has received increasing interest from the optimization community due to its simplicity in implementation and its inexpensive computational overhead. However, the basic PSO algorithm is easily trapping into local minimum and may lead to the premature convergence. When a local optimal solution is reached with PSO, all particles gather around it, and escaping from this local optima becomes di-cult. To overcome the premature convergence of PSO, we propose a new hybrid algorithm of particle swarm optimization (PSO), simulated annealing (SA) and tabu search algorithm (TS) for solving the scattering inverse problem. The incorporation of tabu search (TS) and simulated annealing (SA) as local improvement approaches enable the hybrid algorithm to overleap local optima and intensify its search ability in local regions. Reconstructions of dielectric scatterers from experimental inverse- scattering data are flnally presented to demonstrate the accuracy and e-ciency of the hybrid technique.

Human β-defensins (HBDs) are an important class of antimicrobial peptides that have immunomodulatory functions; however, the role of HBDs have not been well explored in the pathogenesis of meningitis. A cross-sectional study was performed to explore the levels of HBD1, HBD2, HBD3, and HBD4 in the cerebrospinal fluid (CSF) of 176 suspected meningitis cases. CSF samples were first subjected to PCR analysis using a set of universal primers targeting a portion of the eubacteria 16S rRNA gene. The analysis demonstrated that 66 samples (37.5%) were PCR-positive, whilst 110 samples (62.5%) were PCR-negative. DNA sequence analysis of the PCR-positive products identified two broad categories of bacteria, Gram-negative (68.2%) and Gram-positive (31.8%). A total of 88 PCR-negative CSF samples showed abnormal leukocyte counts, glucose concentrations, and/or protein concentrations, and were considered abnormal (ABN). The remaining 22 CSF samples were considered normal (NOR). HBD1, HBD2, and HBD4 levels did not exhibit significant differences between PCR-positive, ABN, and NOR CSF samples. However, HBD3 levels were significantly higher in the ABN CSF samples than in the NOR CSF samples (P=0.005). HBD3 levels were also elevated in the PCR-positive CSF samples compared with the NOR CSF samples, but the difference was not significant (P=0.151). HBD2, HBD3, and HBD4 were correlated with leukocyte counts, glucose concentration, and protein concentration. In conclusion, HBD3 levels were significantly elevated in the CSF of suspected meningitis cases regardless of the cause of meningitis. The CSF levels of certain HBDs were affected by specific diagnostic laboratory parameters for meningitis, including leukocyte counts, glucose concentration, and protein concentration.

A Bayesian network (BN) is a probabilistic graphical model that can model complex and nonlinear relationships. Its structural learning from data is an NP-hard problem because of its search-space size. One method to perform structural learning is a search and score approach, which uses a search algorithm and structural score. A study comparing 15 algorithms showed that hill climbing (HC) and tabu search (TABU) performed the best overall on the tests. This work performs a deeper analysis of the application of the adaptive genetic algorithm with varying population size (AGAVaPS) on the BN structural learning problem, which a preliminary test showed that it had the potential to perform well on. AGAVaPS is a genetic algorithm that uses the concept of life, where each solution is in the population for a number of iterations. Each individual also has its own mutation rate, and there is a small probability of undergoing mutation twice. Parameter analysis of AGAVaPS in BN structural leaning was performed. Also, AGAVaPS was compared to HC and TABU for six literature datasets considering F1 score, structural Hamming distance (SHD), balanced scoring function (BSF), Bayesian information criterion (BIC), and execution time. HC and TABU performed basically the same for all the tests made. AGAVaPS performed better than the other algorithms for F1 score, SHD, and BIC, showing that it can perform well and is a good choice for BN structural learning.

Performance of simulated annealing-based heuristic for the unconstrained binary quadratic programming problem

Submission of information relating to college scheduling in college is very important and is usually done on a semester by the academic section. One of these universities is Universitas Kompueter Indonesia (Unikom) which became object of case study. In determining the scheduling of many aspects that must be considered include the components of the course, lecturer, class, space, and time. All of these components are considered so that the schedule of lectures that will be formed does not happen clashing with each other. In addition, scheduling problems will be more complex if there are many additional terms or constraints. In this study aims to be able to make lecture class scheduling replacement with a combination of genetic algorithms and tabuo search. The first step is done by separating the hard and soft constraints that exist in the lecture problem, and then the best individual search is done by cross-over or cross-breeding process to produce new individual and perform the process of mutation or exchange of individual position in order to produce the best fitness value of the previous individual. The advantage of using a tabu search algorithm allows for the absence of duplicate individual processes. Therefore, the combination of these two algorithms is capable of producing good scheduling and the clashing rate of a schedule can be handled.

BackgroundProtein structure prediction (PSP) has important applications in different fields, such as drug design, disease prediction, and so on. In protein structure prediction, there are two important issues. The first one is the design of the structure model and the second one is the design of the optimization technology. Because of the complexity of the realistic protein structure, the structure model adopted in this paper is a simplified model, which is called off-lattice AB model. After the structure model is assumed, optimization technology is needed for searching the best conformation of a protein sequence based on the assumed structure model. However, PSP is an NP-hard problem even if the simplest model is assumed. Thus, many algorithms have been developed to solve the global optimization problem. In this paper, a hybrid algorithm, which combines genetic algorithm (GA) and tabu search (TS) algorithm, is developed to complete this task.ResultsIn order to develop an efficient optimization algorithm, several improved strategies are developed for the proposed genetic tabu search algorithm. The combined use of these strategies can improve the efficiency of the algorithm. In these strategies, tabu search introduced into the crossover and mutation operators can improve the local search capability, the adoption of variable population size strategy can maintain the diversity of the population, and the ranking selection strategy can improve the possibility of an individual with low energy value entering into next generation. Experiments are performed with Fibonacci sequences and real protein sequences. Experimental results show that the lowest energy obtained by the proposed GATS algorithm is lower than that obtained by previous methods.ConclusionsThe hybrid algorithm has the advantages from both genetic algorithm and tabu search algorithm. It makes use of the advantage of multiple search points in genetic algorithm, and can overcome poor hill-climbing capability in the conventional genetic algorithm by using the flexible memory functions of TS. Compared with some previous algorithms, GATS algorithm has better performance in global optimization and can predict 3D protein structure more effectively.

This paper presents the application of simulated annealing (SA), Tabu search (TS) and hybrid TS---SA to solve a real-world mining optimisation problem called open pit block sequencing (OPBS). The OPBS seeks the optimum extraction sequences under a variety of geological and technical constraints over short-term horizons. As industry-scale OPBS instances are intractable for standard mixed integer programming (MIP) solvers, SA, TS and hybrid TS---SA are developed to solve the OPBS problem. MIP exact solution is also combined with the proposed metaheuristics to polish solutions in feasible neighbourhood moves. Extensive sensitivity analysis is conducted to analyse the characteristics and determine the optimum sets of values of the proposed metaheuristics algorithms' parameters. Computational experiments show that the proposed algorithms are satisfactory for solving the OPBS problem. Additionally, this comparative study shows that the hybrid TS---SA is superior to SA or TS in solving the OPBS problem in several aspects.