SCALABILITY IMPROVEMENT OF ACTIVE PROBING FOR FAILURE DETECTION IN LARGE-SCALE SOFTWARE DEFINED NETWORKS USING COMMUNITY DETECTION ALGORITHMS

This thesis focuses on the pressing issue of illicit drug trafficking and its impact on public health and safety at a global level. With the advent of digital technologies and social media platforms, combating drug trafficking has become increasingly challenging for law enforcement and researchers alike. Among these platforms, Instagram, a popular photo and video-sharing social networking platform, has emerged as a prominent hub for drug trafficking activities. In this study, we delve into the effectiveness of community and key player detection algorithms in identifying and disrupting illicit drug supply networks on Instagram. To conduct our research, we collected real Instagram data spanning from June to August 2022. We examined several community detection algorithms, including Louvain, Newman-Girvan, Infomap, Label Propagation, and Hierarchical Clustering. Additionally, we explored key player algorithms, namely CDKPE, TopRank, K-core, and KPEI, the latter being a novel algorithm introduced in this study. Our objective was to assess the performance of these algorithms in accurately identifying and targeting drug trafficking networks. Our findings reveal that the Louvain and Newman-Girvan algorithms outperformed others in terms of community detection, demonstrating their effectiveness in identifying cohesive groups involved in drug trafficking on Instagram. In terms of key player detection, the CDKPE and KPEI algorithms emerged as the most effective, highlighting the individuals who play pivotal roles within these networks. These algorithms offer practical applications for law enforcement agencies seeking to disrupt drug trafficking operations on Instagram. By emphasizing the importance of leveraging advanced analytical tools, our study underscores the significance of combating drug trafficking on social media platforms.

Association rules are widely used to extract patterns from a given database. The association rules are capable of finding correlations among items, making it possible for the user to learn which items are present in the transactions and which of them have a significant correlation. One of the major problems with association rules is that the number of extracted rules usually exceeds the number of transactions present in the database, also surpassing the user’s capability to explore the obtained knowledge. To overcome this problem, the post-processing phase was proposed with the objective of directing the user to the rules that potentially have the most interesting knowledge. One of the used approaches is to divide the association rules into groups (or clusters), so that rules behave similarly are on the same group, facilitating the rule set understanding. In the literature, there are some works that uses clustering algorithms to split the rules while some other works use community detection algorithms. As both approaches obtain groups of association rules, but using different premises, different results can be obtained. No study has been done on the differences among clustering and community detection algorithms, which makes the selection of the algorithm hard, once their behavior is not well known in the association rule post-processing phase. This paper presents an analysis on both approaches, aiming to find the differences and the similarities among them, making it easier to select an approach by knowing its behavior.

Incorporating Community Detection and Clustering Techniques into Collaborative Filtering Model

Complex networks represent various real‐world systems. Overlapping community detection is one of the critical tasks in studying these networks and has significance to a wide variety of applications, including the exploration of online social networks because of the natural attitude of persons to participate in multiple communities at the same time. Despite a large number of existing community detection algorithms for detecting disjoint communities, the efficient and fast uncovering of overlapping communities has remained a challenging problem. To provide an efficient solution, on the one hand, the balanced link density label propagation (BLDLP) algorithm, proposed by the authors of the current study, is a fast, stable, and efficient method for disjoint community detection. On the other hand, the fuzzy theory is a worthwhile approach for overlapping community detection since it provides the membership rate of the overlapping nodes as well as the detection of overlapping communities. Hence, in this paper, based on the synergy of the BLDLP algorithm and the fuzzy theory, a novel method, called fuzzy BLDLP, for overlapping community detection is proposed. Fuzzy BLDLP is fast and efficient. The proposed method needs no prior information about the number of network communities to discover them. The experiments on both synthetic and real‐world known networks, including Zachary, Dolphins, and COVID‐19 Co‐authorship, have revealed that the proposed method successfully detects the overlapping nodes and communities and hence is comparable with the state‐of‐the‐art overlapping community detection algorithms in terms of recall, precision, F‐score and overlapping normalized mutual information.

Dividing a network into communities has great benefits in understanding the characteristics of the network. The label propagation algorithm (LPA) is a fast and convenient community detection algorithm. However, the community initialization of LPA does not take advantage of topological information of networks, and its robustness is poor. In this paper, we propose a stable community detection algorithm based on density peak clustering and label propagation (DS-LPA). First, the local density calculation method in density peak clustering algorithm is improved in finding the community center of the network, so as to build a suitable initial community, which can improve the quality of community partition. Then, the label update order is determined reasonably by computing the information transmission power of nodes, and the solutions for multiple candidate labels are provided, which greatly improved the robustness of the algorithm. DS-LPA is compared with other seven algorithms on the synthetic network and real-world networks. NMI, ARI, and modularity are used to evaluate these algorithms. It can be concluded that DS-LPA has a higher performance than most comparison algorithms on synthetic network with ten different mixed parameters by statistical testing. And DS-LPA can quickly calculate the best community partition on different sizes of real-world networks.

Software defined network (SDN) decouples the network control and data planes. Despite various advantages of SDNs, they are vulnerable to various security attacks such anomalies, intrusions, and Denial-of-Service (DoS) attacks and so on. On the other hand, any anomaly and intrusion in SDNs can affect many important domains such as banking system and national security. Therefore, the anomaly detection topic is a broad research domain, and to mitigate these security problems, a great deal of research has been conducted in the literature. In this paper, the state-of-the-art schemes applied in detecting and mitigating anomalies in SDNs are explained, categorized, and compared. This paper categorizes the SDN anomaly detection mechanisms into five categories: (1) flow counting scheme, (2) information-based scheme, (3) entropy-based scheme, (4) deep learning, and (5) hybrid scheme. The research gaps and major existing research issues regarding SDN anomaly detection are highlighted. We hope that the analyses, comparisons, and classifications might provide directions for further research.

The objective of a community detection algorithm is to group similar nodes that are more connected to each other than with the rest of the network. Several methods have been proposed but many are of high complexity and require global knowledge of the network, which makes them less suitable for large-scale networks. The Label Propagation Algorithm initially assigns a distinct label to each node that iteratively updates its label with the one of the majority of its neighbors, until consensus is reached among all nodes in the network. Nodes sharing the same label are then grouped into communities. It runs in near linear time and is decentralized, but it gets easily stuck in local optima and often returns a single giant community. To overcome these problems we propose MemLPA, a variation of the classical Label Propagation Algorithm where each node implements a memory mechanism that allows them to “remember” about past states of the network and uses a decision rule that takes this information into account. We demonstrate through extensive experiments, on the Lancichinetti-Fortunato-Radicchi benchmark and a set of real-world networks, that MemLPA outperforms other existing label propagation algorithms that implement memory and some of the well-known community detection algorithms. We also perform a topological analysis to extend the performance study and compare the topological properties of the communities found to the ground-truth community structure.

Community detection is one of the primary tools to discover useful information that is hidden in complex networks. Some community detection algorithms for bipartite networks have been proposed from various viewpoints. However, the performance of these algorithms deteriorates when the community structure becomes unclear. Enhancing community structure remains a nontrivial task. In this paper, we propose a community detection algorithm, called ECD, that enhances community structure in bipartite networks. In the proposed ECD, the topology of a network is modified by reducing unnecessary edges that are connected to neighboring low-weight communities. Therefore, an ambiguous community structure is converted into a structure that is much clearer than the original structure. The experimental results on both artificial and real-world networks verify the accuracy and reliability of our algorithm. Compared with existing community detection algorithms using state-of-the-art methods, our algorithm has better performance.

Community detection in social networks based on fire propagation

Software Defined Networking (SDN) greatly simplifies network management and introduces unprecedented flexibility by decoupling control functions from the network data plane. However, such a decoupling also opens a box of various open questions, which are not well addressed, e.g., scalability issues and security concerns. This talk firstly describes the background of SDN and the abstraction that SDN is possessing now, and secondly presents scalability/security problems and our on-going research progress. In addition, the promising directions will also be discussed in the talk.

<p dir="ltr">One of the most critical features of real-world networks is their community structure, as it reveals the internal organization of nodes. Finding such partitions is an interesting and essential task from both theoretical and practical perspectives. As a result, there is a growing demand for effective community detection algorithms. However, testing and designing such algorithms is demanding and challenging: one of the biggest problems is the lack of proper datasets and the fact that some have disputable ground-truth labeling, to say the least. One way to avoid this problem is to use artificial benchmarks with a built-in community structure.</p><p dir="ltr">In this work, we propose ABCDe—a multi-threaded implementation of the ABCD (Artificial Benchmark for Community Detection) graph generator. We test its performance and compare it with the previously available sequential version of the ABCD model and the parallel implementation of the standard and widely used LFR generator. We also investigate various theoretical asymptotic properties of the ABCD and ABCDe models. In particular, we analyze the modularity function, arguably the most important graph property in the context of community detection. By doing so, we show that models from the ABCD family are proper tools for designing new algorithms, not only those suited specifically for the community detection task.</p><p dir="ltr">Finally, we introduce a new approach to community detection in graphs. The idea is to initialize one of the popular heuristic-based community detection algorithms, such as Louvain or Leiden, with a partition obtained by embedding the graph nodes into a high-dimensional real vector space and then running a clustering algorithm on this latent representation. This procedure significantly improves the results and reduces the inherent volatility of such algorithms. Proper embedding filters out unnecessary information while retaining the proximity of nodes belonging to the same community.</p>

Community detection is crucial in the analysis of social networks. Its main goal is to find groups of users densely connected among them, and sparsely connected between themselves. There are so many algorithms which makes it difficult for researchers to choose the best one for a specific dataset. In this paper, we provide a thorough comparison between five Community Detection (CD) algorithms- Girman-Newman (GN), Clauset-Newman-Moore (CNM), Label Propagation Algorithm (LPA), Louvain and Leiden. To evaluate in real social network datasets like Zachary's Karate Club, Dolphin networks and bigger ones such as Facebook, Twitter, LinkedIn along with citation networks we used different metrics modularity and NMI. We employed Normalized Mutual Information (NMI) to quantify the agreement of detected communities with their true ground-truth score and modularity for evaluating the overall quality of partitions given by diverse methods. Our experiments show that greedy and modularity-optimization algorithms are particularly well-suited. Notably, the Leiden algorithm had a better modularity value than Louvain (Q = 0.9141 and Q = 0.9051 of LinkedIn Network respectively) in most of the dataset. The NMI plot provided more explanation about Clauset-Newman-Moore (CNM), Louvain and Label Propagation Algorithm (LPA)which are in good agreement on community detection and their NMI score. These results would allow us to choose more rationally among the different community detection algorithms for social network analysis, by providing accurate quantitative benchmarks.

Some of the defects of community detection algorithms in complex networks include pre-parameter limits and redundant labels. Accordingly, we present an improved overlapping community detection algorithm in complex networks that is a minimal maximal clique label propagation algorithm (MMCLPA). The algorithm uses the minimal maximal clique (MMC), and allows each MMC to share the same label by reducing redundant labels and random factors. Therefore, the MMCLPA algorithm increases the stability of the algorithm. Mean-while, the MMCLPA algorithm completes label propagation from core node groups (MMC) for distribution using intimacy as the weight of the label. For the labels post processing, uses adaptive threshold method to overcome pre-parameter limitations in unknown complex networks. When compared with other community detection al-gorithms using arti cial and real network data, our experiment results prove that the MMCLPA algorithm not only increases the tolerance for mixing parameters, but also improves the robustness of the algorithm. Lastly, by employing a distributed computing model (Map Reduce) and cloud platform (Hadoop), we allow parallelization implementation of MMCLPA. Our experiment results show that parallel MMCLPA owns an approximation of quality compared with the stand-alone system, as well as better scalability.

In this paper, we present a novel data clustering framework for big sensory data produced by IoT applications. Based on a network representation of the relations among multi-dimensional data, data clustering is mapped to node clustering over the produced data graphs. To address the potential very large scale of such datasets/graphs that test the limits of state-of-the-art approaches, we map the problem of data clustering to a community detection one over the corresponding data graphs. Specifically, we propose a novel computational approach for enhancing the traditional Girvan–Newman (GN) community detection algorithm via hyperbolic network embedding. The data dependency graph is embedded in the hyperbolic space via Rigel embedding, allowing more efficient computation of edge-betweenness centrality needed in the GN algorithm. This allows for more efficient clustering of the nodes of the data graph in terms of modularity, without sacrificing considerable accuracy. In order to study the operation of our approach with respect to enhancing GN community detection, we employ various representative types of artificial complex networks, such as scale-free, small-world and random geometric topologies, and frequently-employed benchmark datasets for demonstrating its efficacy in terms of data clustering via community detection. Furthermore, we provide a proof-of-concept evaluation by applying the proposed framework over multi-dimensional datasets obtained from an operational smart-city/building IoT infrastructure provided by the Federated Interoperable Semantic IoT/cloud Testbeds and Applications (FIESTA-IoT) testbed federation. It is shown that the proposed framework can be indeed used for community detection/data clustering and exploited in various other IoT applications, such as performing more energy-efficient smart-city/building sensing.

The role of influential nodes and their influence domain in community detection: An approximate method for maximizing modularity