Detecting network communities: a new systematic and efficient algorithm

Community structure in networks indicates some meaningful groups or organizations in the real world. Various algorithms to detect community in complex networks were proposed. However, problems about how to judge the goodness and performance of algorithms are still open. This paper reviewed and analyzed the related work and algorithms for community detection, hoping to benefit researchers in related field.

There is an increasing recognition on community detection in complex networks in recent years. In this study, we improve a recently proposed memetic algorithm for community detection in networks. By introducing a Population Generation via Label Propagation (PGLP) tactic, an Elitism Strategy (ES) and an Improved Simulated Annealing Combined Local Search (ISACLS) strategy, the improved memetic algorithm called (iMeme-Net) is put forward for solving community detection problems. Experiments on both computer-generated and real-world networks show the effectiveness and the multi-resolution ability of the proposed method.

Community detection in complex networks is an important multidisciplinary research area and is considered crucial for understanding the structure of complex networks. Unsupervised deep learning models (e.g. stack autoencoders) have been successfully proposed for the problem of community detection, which can extract network features and use them in splitting the network into communities. Despite their effectiveness, these methods are not very efficient, especially when large networks are involved. Furthermore, existing models usually handle the network as a single object, which means that massive trainable parameters are required during training (which in normal complex networks often reach millions of parameters, not to mention large networks), thereby increasing the complexity of the model. To overcome these problems, this paper proposes a deep autoencoder method for network community detection based on three techniques: network-data partitioning, reduction and sharing of trainable parameters, which contribute significantly to improve the efficiency of the method. A new partitioning strategy is imposed on complex networks at different levels. The paper also proposes a parallel design for the proposed method. Furthermore, a new similarity constraint function is proposed to improve and preserve the performance of community detection task. We performed extensive experiments for different partitioning levels of a network-dataset to evaluate the method with CPU and GPU devices. The results showed that the proposed method significantly improved training speed and efficiency while maintaining performance. The results also showed that the efficiency of the method increases as we move to a deeper level of partitioning.

Detecting communities in complex networks using triangles and modularity density

Community detection in complex networks using edge-deleting with restrictions

Vulnerability metrics and analysis for communities in complex networks

Identifying and tracking community structures in complex networks are one of the cornerstones of network studies, spanning multiple disciplines, from statistics to machine learning to social sciences, and involving even a broader range of application areas, from biology to politics to blockchain. This survey paper aims to provide an overview of some most popular approaches in statistical network community detection as well as the newly emerging research directions such as community extraction with higher‐order features and community discovery in multilayer and multiscale networks. Our goal is to offer a unified view at methodological interconnections and the wide spectrum of interdisciplinary data science applications of network community analysis.This article is categorized under: Data: Types and Structure > Graph and Network Data Statistical Learning and Exploratory Methods of the Data Sciences > Clustering and Classification

A multi-objective adaptive evolutionary algorithm to extract communities in networks

Complex networks (CNs) have gained much attention in recent years due to their importance and popularity. The rapid growth in the size of CNs leads to more difficulties in the analysis of CNs tasks. Community Detection (CD) is an important multidisciplinary research area where many machine/deep learning-based methods have been applied to map CNs into a low-dimensional representation for extracting information similarity among members of CNs. Currently, Deep Learning (DL) is one of the promising methods to extract knowledge and learn information from high dimensional space and represent it in low dimensional space. However, designing an accurate and efficient DL-based CD method especially when dealing with large CNs is always an on-going research endeavor to pursue. Meta-Heuristic (MH) algorithms have shown their potentials in improving DL models in terms of solution quality and computational cost. In addition, parallel computing is a feasible solution for building efficient DL models. The algorithmic principle of MH is parallel in nature; however, its computation framework in DL training that is reported in the literature is not really implemented in a parallel computing setup. In this paper, we present a systematic review of CD in CNs from conventional machine learning to DL methods and point out the gap of applying DL-based CD methods in large CNs. In addition, the relevant studies on DL with parallel and MH approaches are reviewed and their implications on DL models are highlighted to prospect effective solutions to overcome the challenges of DL-based CD methods. We also point out research challenges in the field of CD and suggest possible future research directions.

Detecting communities in complex networks and particularly in social networks have been gaining traction in recent years. Not much work has been undertaken in the area of Community Detection for patient-centric social networks. In this work, we have tried to detect significant communities in a patient-centric social network by computing similarity among the unstructured physician notes which are in the form of long texts. Experiments have been conducted using the MIMIC III dataset, which is a large open database containing de-identified health-related patient data. Three modularity based community detection algorithms, viz., FastGreedy, Walktrap, and Louvain have been applied to identify the potential communities in the network. Further, the significance of such communities has been tested using the Wilcoxon rank-total test. It is found that Louvain algorithm fared better in terms of modularity and significance compared to the other two algorithms.

Quantum adiabatic optimization has long been expected to outperform classical methods in solving NP -type problems. While this has been proven in certain experiments, its main applications still reside in academic problems where the size of the system to be solved would not represent an obstacle to any modern desktop computer. Here, we develop a systematic procedure to find the global optima of the modularity function to discover community structure in complex networks solely relying on pure annealers rather than hybrid solutions. We bypass the one-hot encoding constraints by hierarchically and recursively encoding binary instances of the problem that can be solved without the need to guess the exact penalties for the Lagrange multipliers. We study the variability and robustness of the annealing process as a function of network size, directness of connections, topology, and the resolution of the communities. We show how our approach produces meaningful and at least equally optimal solutions to state-of-the-art community detection algorithms while maintaining tractable and potentially scalable computing times. Lastly, due to its recursive nature, the annealing process returns intermediate subdivisions, thus offering interpretable rather than black-box solutions. These <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">dendrograms</i> can be used to unveil normal and pathological hidden hierarchies in brain networks, hence opening the door to clinical workflows. Overall, this represents a first step towards an applicable practice-oriented usage of pure quantum annealing, potentially bridging two segregated communities in modern science and engineering: that of network science and quantum computing.

Complexity is highly susceptible to variations in the network dynamics, reflected on its underlying architecture where topological organization of cohesive subsets into clusters, system’s modular structure and resulting hierarchical patterns, are cross-linked with functional dynamics of the system. Here we study connection between hierarchical topological scales of the simplicial complexes and the organization of functional clusters – communities in complex networks. The analysis reveals the full dynamics of different combinatorial structures of q-th-dimensional simplicial complexes and their Laplacian spectra, presenting spectral properties of resulting symmetric and positive semidefinite matrices. The emergence of system’s collective behavior from inhomogeneous statistical distribution is induced by hierarchically ordered topological structure, which is mapped to simplicial complex where local interactions between the nodes clustered into subcomplexes generate flow of information that characterizes complexity and dynamics of the full system.

Community detection is of extraordinary significance in comprehending the structure and functions of complex networks. The particle competition algorithm is a quick and heuristic algorithm when applied to community detection. However, existing particle competition algorithms do not make full use of all information of networks and have several shortcomings such as poor robustness, weak stability, and low accuracy. In addition, it cannot be effectively applied to overlapping community detection. In this paper, a new particle propagation model with semi-supervised learning for community detection in social networks (SSPCO) is proposed. SSPCO divides the formation process of communities into the initialization phase, walking phase, restart phase, convergence phase and overlapping community detection phase. In the initialization phase, each team of labeled vertices generates a particle of this team. The domination level of each team particles at vertices and edges is also initialized in this phase. In the walking phase, the particle walks to one of the neighbors of the current vertex based on the proposed walking probability calculated by the proposed transfer acceptance probability and the proposed transfer proposal probability. In the process of particle walking, the particle has a possibility of entering the restart phase. The proposed restart probability determines whether the particle performs the restart mechanism. If the particle decides to restart, it will select a vertex for restart based on the domination level of this team particles at vertices. Otherwise, it continues to walk. After several particle walking and restart phases, the particle meets the convergence state. In the convergence phase, if all particles meet the proposed convergence condition, we will obtain community partition results based on the domination level of each team particles at the vertex. In the overlapping community detection phase, we can obtain overlapping community partition results based on the overlapping community detection mechanism. Experiment results reveal that SSPCO can improve the stability and accuracy of detecting communities. Moreover, SSPCO runs in near-linear time complexity, which allows it to be applied in large-sized networks.

Communities are basic units of complex networks and understanding of their structure help us to understand the structure of a network. Communities are groups of nodes that have many links inside and few links outside them. Community detection in a network can be modeled as an optimization problem. We can use some measures such as Modularity and Community Score for evaluating the quality of a partition of nodes. In this paper, we present a new algorithm for detecting communities in networks based on an Estimation of Distribution Algorithm (EDA) with the assumption that the problem variables are independent. EDAs are those evolutionary algorithms that build and sample the probabilistic models of selected solutions instead of using crossover and mutation operators. In this paper, we assess our algorithm by synthetic and real data sets and compare it with other community detection algorithms.

We introduce a notion of data depth for recovery of community structures in large complex networks. We propose a new data-driven algorithm, K-depths, for community detection using the L 1-depth in an unsupervised setting. We evaluate finite sample properties of the K-depths method using synthetic networks and illustrate its performance for tracking communities in online social media platform Flickr. The new method significantly outperforms the classical K-means and yields comparable results to the regularized K-means. Being robust to low-degree vertices, the new K-depths method is computationally efficient, requiring up to 400 times less CPU time than the currently adopted regularization procedures based on optimizing the Davis–Kahan bound.