Dynamic Topology-Aware Linear Attention Network for Efficient Traveling Salesman Problem Optimization

The Traveling Salesman Problem (TSP) is a well-known problem in computer science that requires finding the shortest possible route that visits every city exactly once. TSP has broad applications in logistics, routing, and supply chain management, where finding optimal or near-optimal solutions efficiently can lead to substantial cost and time reductions. However, traditional solvers rely on iterative processes that can be computationally expensive and time-consuming for large-scale instances. This research proposes a novel deep learning architecture designed to predict optimal or near-optimal TSP tours directly from the problem’s distance matrix, eliminating the need for extensive iterations to save total solving time. The proposed model leverages the attention mechanism to effectively focus on the most relevant parts of the network, ensuring accurate and efficient tour predictions. It has been tested on the TSPLIB benchmark dataset and observed significant improvements in both solution quality and computational speed compared to traditional solvers such as Gurobi and Genetic Algorithm. This method presents a scalable and efficient solution for large-scale TSP instances, making it a promising approach for real-world traveling salesman applications.

The Traveling Salesman Problem (TSP) is one of the most well-known NP-hard combinatorial optimization problems (COPs). Many social production problems can be effectively represented as instances of TSPs. However, solving large-scale TSPs remains a significant challenge for conventional Von Neumann computers. Many studies have proposed annealing processors to address large-scale COPs, but most of them focus on unconstrained problems, such as the Maxcut problem. In this paper, a scalable decoupled-clustering annealng processor (DCAP) for efficiently handling large-scale TSPs is presented. A decoupled hierarchical clustering algorithm is proposed for higher convergence speed and improved scalability. Several techniques have been developed in hardware to minimize area overhead and processing time, including a modified spin connection topology for the Ising model, an area-efficient random threshold generator, a one-step spin update scheme and a dynamic prediction method. The DCAP prototype is implemented on FPGA with an operating frequency of 125MHz. We tested our design on various TSP instances from the TSPLIB. Results show that our design outperforms the CPU- and GPU-based Neuro-Ising scheme by achieving maximum speedups of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$780\times $ </tex-math></inline-formula> and a 42% improvement in accuracy. With multi-chip interconnection, DCAP is able to handle problems of scale up to 85900 cities.

The search for multiple optimal solutions in the traveling salesman problem (TSP), as a challenging multimodal optimization problem in the combinatorial domain, has received increasing attention in recent years. Nevertheless, the multisolution TSP (MSTSP) still remains extremely difficult for larger-scale TSP instances. In this article, we propose a niching Lin-Kernighan–Helsgaun (LKH)-based ant colony system (ACS), named nLKH-ACS, taking advantage of LKH’s ability to solve large-scale TSPs, ACS’s search efficiency, and the niching technique for diversity preservation. Specifically, first, to address multisolution problems, we design a niching LKH (nLKH) strategy to generate diverse cost-efficient spanning trees, and adopt the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\alpha $ </tex-math></inline-formula>-nearness on each tree to obtain a diverse candidate edge set. The nLKH strategy enhances the ACS by improving pheromone initialization, solution construction, and local search operation using spanning trees and candidate edge sets, thereby strengthening the search capability and diversity. Then, to balance convergence and diversity, an adaptive Gaussian strategy is utilized to update the pheromone matrix. Furthermore, we design an indicator to measure the geometric diversity between pairs of solutions in the MSTSP solution set. The comprehensive experiments on MSTSPs and TSPLIB are conducted to validate the performance of the proposed nLKH-ACS. The experimental results demonstrate the powerful solving capability and excellent diversity of the proposed nLKH-ACS, particularly in finding various optimal solutions in larger-scale TSP instances.

Various neural network models have been proposed to tackle combinatorial optimization problems such as the travelling salesman problem (TSP). Existing learning-based TSP methods adopt a simple setting that the training and testing data are independent and identically distributed. However, the existing literature fails to solve TSP instances when training and testing data have different distributions. Concretely, we find that different training and testing distribution will result in more difficult TSP instances, i.e., the solution obtained by the model has a large gap from the optimal solution. To tackle this problem, in this work, we study learning-based TSP methods when training and testing data have different distributions using adaptive-hardness, i.e., how difficult a TSP instance can be for a solver. This problem is challenging because it is non-trivial to (1) define hardness measurement quantitatively; (2) efficiently and continuously generate sufficiently hard TSP instances upon model training; (3) fully utilize instances with different levels of hardness to learn a more powerful TSP solver. To solve these challenges, we first propose a principled hardness measurement to quantify the hardness of TSP instances. Then, we propose a hardness-adaptive generator to generate instances with different hardness. We further propose a curriculum learner fully utilizing these instances to train the TSP solver. Experiments show that our hardness-adaptive generator can generate instances ten times harder than the existing methods, and our proposed method achieves significant improvement over state-of-the-art models in terms of the optimality gap. The codes are publicly available.

Discrete pigeon-inspired optimization algorithm with Metropolis acceptance criterion for large-scale traveling salesman problem

We propose an end-to-end learning framework based on hierarchical reinforcement learning, called H-TSP, for addressing the large-scale Traveling Salesman Problem (TSP). The proposed H-TSP constructs a solution of a TSP instance starting from the scratch relying on two components: the upper-level policy chooses a small subset of nodes (up to 200 in our experiment) from all nodes that are to be traversed, while the lower-level policy takes the chosen nodes as input and outputs a tour connecting them to the existing partial route (initially only containing the depot). After jointly training the upper-level and lower-level policies, our approach can directly generate solutions for the given TSP instances without relying on any time-consuming search procedures. To demonstrate effectiveness of the proposed approach, we have conducted extensive experiments on randomly generated TSP instances with different numbers of nodes. We show that H-TSP can achieve comparable results (gap 3.42% vs. 7.32%) as SOTA search-based approaches, and more importantly, we reduce the time consumption up to two orders of magnitude (3.32s vs. 395.85s). To the best of our knowledge, H-TSP is the first end-to-end deep reinforcement learning approach that can scale to TSP instances of up to 10000 nodes. Although there are still gaps to SOTA results with respect to solution quality, we believe that H-TSP will be useful for practical applications, particularly those that are time-sensitive e.g., on-call routing and ride hailing service.

Many real-world problems, like microchip design, can be modeled by means of the well-known traveling salesman problem (TSP). Many instances of this problem can be found in the literature. Although several optimization algorithms have been applied to TSP instances, the selection of the more promising algorithm is, in practice, a difficult decision. In this paper, a new meta-learning-based approach is investigated for the selection of optimization algorithms for TSP instances. Essentially, a learning model is trained with TSP instances for which the performance of a set of optimization algorithms is known a priori. Then, the learned model is used to predict the best algorithm for a new TSP instance. Each instance is described by meta-features that capture characteristics of the TSP that affect the performance of the optimization algorithms. Given that the best solution for a given TSP instance can be obtained by several algorithms, the meta-learning problem is considered here to be a multi-label classification problem. Several experiments illustrate the performance of the proposed approach, with promising results.

List-based simulated annealing (LBSA) algorithm is a novel simulated annealing algorithm where list-based cooling scheme is used to control the change of parameter temperature. Aiming to improve the efficiency of the LBSA algorithm for large-scale optimization problems, this paper proposes an enhanced LBSA (ELBSA) algorithm for solving large-scale traveling salesman problem (TSP). The ELBSA algorithm can drive more sampling at more suitable temperatures and from more promising neighborhoods. Specifically, heuristic augmented sampling strategy is used to ensure that more neighbors are from promising neighborhoods, systematic selection strategy is proposed to guarantee that each component of the current solution has a chance to be improved, and variable Markov chain length (VMCL), based on arithmetic sequence, is used to sample more neighbors at more suitable temperatures. Extensive experiments were performed to show the contribution of the heuristic augmented sampling strategy, and to verify the advantage of using systematic selection and VMCL. Comparative experiments, which were conducted on a wide range of large-scale TSP instances, show that the ELBSA algorithm is better than or competitive with most other state-of-the-art metaheuristics.

Traveling salesman problem (TSP) is a well-known NP-hard combinatorial optimization problem. It has been solved by a number of exact and approximate algorithms and serves as a testbed for new heuristic and metaheuristic optimization algorithms. However, it is often not easy to evaluate the hardness (complexity) of a TSP instance. Simple measures such as the number of cities or the minimum (maximum) route length do not capture the internal structure of a TSP instance sufficiently. In this work, we propose a new method for the assessment of TSP instance complexity based on clustering. The new approach is evaluated on a set of randomized TSP instances with different structure and its relation to the performance of a selected metaheuristic TSP solver is studied.

As the amount and scale of cities in Traveling Salesman Problem (TSP) rise, the algorithmic complexity is exponentially increasing. The difficulty is how to design a suitable algorithm to solve large-scale TSPs. A Cooperative Co-evolutionary Ant Colony Optimization algorithm (CC-ACO) is proposed in this paper based on the concept of divide and conquer. The Iterative Self-Organizing Data Analysis (ISODATA) clustering algorithm tackles the problem by dividing it into a set of smaller and simpler sub-components and the ACO algorithms are designed for optimizing them separately. Numerical tests are then conducted to investigate algorithms, analyze results, and compare performances. The simulation findings show a significant efficiency of the suggested algorithm on the TSPLIB data set. Finally, we extend the large-scale TSP problem to the field of art and use the presented algorithm to optimize the path of discrete pixels in the picture, showing the artistic painting of the TSP art project.

The traveling salesman problem (TSP) is an iconic permutation problem with a number of applications in planning, scheduling, and logistics. It has also attracted much attention as a benchmarking problem frequently used to assess the properties of a variety of nature-inspired optimization methods. However, the standard libraries of TSP instances, such as the TSPLIB, are often decades old and might not reflect the requirements of modern real-world applications very well. In this work, we introduce several novel TSP instances representing real-world locations of pharmacies in several major cities of the Czech Republic. We look for the optimum routes between the pharmacies by selected nature-inspired algorithms and compare the results obtained on the real-world instances with their results on standard TSPLIB instances.

Recent work applying deep reinforcement learning (DRL) to solve traveling salesman problems (TSP) has shown that DRL-based solvers can be fast and competitive with TSP heuristics for small instances, but do not generalize well to larger instances. In this work, we propose a novel approach named MAGIC that includes a deep learning architecture and a DRL training method. Our architecture, which integrates a multilayer perceptron, a graph neural network, and an attention model, defines a stochastic policy that sequentially generates a TSP solution. Our training method includes several innovations: (1) we interleave DRL policy gradient updates with local search (using a new local search technique), (2) we use a novel simple baseline, and (3) we apply curriculum learning. Finally, we empirically demonstrate that MAGIC is superior to other DRL-based methods on random TSP instances, both in terms of performance and generalizability. Moreover, our method compares favorably against TSP heuristics and other state-of-the-art approach in terms of performance and computational time.

In this paper, we present some new results obtained for the traveling salesman problem (TSP) by using the iterated tabu search (ITS) meta-heuristic. ITS is a promising extension to the ordinary tabu search scheme. It seeks near-optimal solutions by combining intensification (standard tabu search) and diversification (perturbation of solutions) in a proper way. For the TSP, the main effect is achieved due to decomposition of the solution neighbourhood structure and considerably speeding-up the tabu search process, which is used, namely, in the role of intensification. This fast-iterated tabu search (FITS) technique resulted in quite encouraging solutions for the TSP instances from the TSP instance library TSPLIB. FITS obviously outperformed the other heuristic algorithms used in the experimentation, especially, on the smaller TSP instances.

Vehicle routing problems (VRPs) are a fundamental class of combinatorial optimization problems (COPs) in computer science and operations research, with diverse real-world applications in logistics, transportation, and manufacturing. The intrinsic NP-hard nature makes VRPs exponentially expensive to be solved by exact solvers. As an alternative, heuristic solvers deliver suboptimal solutions within reasonable time but require extensive hand-crafted rules and domain expertise tailored to each specific problem. Recently, neural combinatorial optimization (NCO), which leverages machine learning to learn heuristics in a data-driven manner, has gained significant attention. These neural solvers demonstrate strong performance while reducing computational overhead and reliance on domain expertise compared to traditional solvers. However, they face significant generalization challenges. For example, their performance may degrade substantially when applied to instances with different data distributions, problem scales, or constraints than those encountered during training. This generalization issue severely limits their practical applicability. This thesis aims to systematically address these challenges and advance the development of generalizable neural solvers for VRPs. The thesis begins by enhancing the cross-distribution generalization of neural VRP solvers through an adversarial training approach. We introduce an ensemble-based Collaborative Neural Framework (CNF) that adversarially trains multiple models in a collaborative manner, promoting robustness against adversarial attacks while also boosting performance on clean instances. In this framework, an attacker generates hard instances by perturbing the data distribution, challenging the models to adapt and thereby strengthening cross-distribution generalization. Additionally, a neural router is designed to efficiently distribute training instances among the models, thereby improving load balancing and collaborative efficacy. Extensive experiments on two classic routing problems -- the travelling salesman problem (TSP) and the capacitated vehicle routing problem (CVRP) -- demonstrate the effectiveness and versatility of CNF in enhancing the cross-distribution generalization. Next, the thesis further expands neural solvers to simultaneously address both cross-size and cross-distribution generalization challenges. We propose Omni-VRP, a generic meta-learning framework that enables effective training of an initial model with the capacity for rapid adaptation to new tasks during inference, where each task corresponds to a set of instances with the same problem scale and data distribution. Additionally, we introduce a simple yet efficient approximation method to reduce the training overhead associated with second-order derivative calculations. Extensive experiments on both synthetic and benchmark instances of TSP and CVRP validate the effectiveness of our approach. Finally, the thesis pioneers the study of cross-problem generalization, pushing the boundaries of neural VRP solvers in learning generalizable representations across diverse constraints. We propose MVMoE, a unified neural solver capable of solving 16 VRP variants simultaneously in a zero-shot manner through attribute composition. To efficiently enhance model capacity, we employ a mixture-of-experts architecture with a hierarchical gating mechanism, striking a balance between empirical performance and computational complexity. Experimentally, our method significantly promotes zero-shot generalization on 10 unseen VRP variants, and showcases decent results on the few-shot setting and real-world benchmark instances. Overall, this thesis represents a pioneering exploration and substantial advancement in developing generalizable neural solvers for VRPs. It investigates innovative designs across various components, including model architectures, training algorithms, and problem settings, to enhance the generalization of neural solvers across diverse contexts such as varying data distributions, problem scales, and constraints. These contributions encourage neural solvers to learn more robust and generalizable representations, paving the way for the first generation of foundation models capable of addressing a wide range of COPs. Ultimately, the insights gained here not only propel the field of NCO forward but also enrich the broader landscape of learning-based optimization methods.

The Traveling Salesman Problem (TSP) is a combinatorial optimization problem which has a plethora of real-world applications in various domains. Since large scale TSP problems are difficult to be solved by deterministic algorithms in a reasonable amount of time, heuristic and meta-heuristic algorithms such as swarm intelligence algorithms are usually used for solving TSP. These algorithms provide near-optimal solutions in a feasible amount of time. The Dragonfly Algorithm (DA) is a recent swarm intelligence algorithm and it has shown to have a higher performance as compared to other swarm intelligence algorithms in various applications. Since the original DA algorithm is proposed for solving continuous optimization problems, it cannot be used for solving TSP and although a binary version of the algorithm, called BDA, is also proposed, it is not suitable for solving TSP. Hence, in this paper, a variant of the DA algorithm is proposed. DA is adapted for solving TSP by adapting its equations and making use of the method of swap sequences to update the position of the artificial dragonflies in the search space. The algorithm is employed to solve a TSP problem which consists of four cities and the results show that the proposed algorithm is able to provide the optimal TSP path.