Clustering Heterogeneous Information Network by Joint Graph Embedding and Nonnegative Matrix Factorization

Recently, there is a surge of interests on heterogeneous information network analysis. Although evaluating the importance of objects has been well studied in homogeneous networks, it is not yet exploited in heterogeneous networks. In this paper, we study the ranking problem in heterogeneous networks and propose the HRank method to evaluate the importance of multiple types of objects and meta paths. A constrained meta path is proposed to subtly capture the rich semantics in heterogeneous networks. Since the importance of objects depends upon the meta paths in heterogeneous networks, HRank develops a path based random walk process. Furthermore, HRank can simultaneously determine the importance of objects and meta paths through applying the tensor analysis. Experiments on three real datasets show that HRank can effectively evaluate the importance of objects and paths together. Moreover, the constrained meta path shows its potential on mining subtle semantics by obtaining more accurate ranking results.

Extracting a core structure from heterogeneous information network using h-subnet and meta-path strength

Heterogeneous network user authentication keys are vulnerable to plain text attacks, resulting in poor encryption performance. Therefore, a heterogeneous bilinear pairing signcryption scheme is proposed. The symbol frequency detection method is used to detect symbols of user authentication data, establish an ORK user protocol in a heterogeneous network, and perform a pairwise signcryption scheme to linearly encode user cognitive information in a heterogeneous network. Use Ryption technology to authenticate and re-sign users in heterogeneous networks, and use a bilinear pairing signature encryption scheme to control cipher text in user processes to encrypt identity authentication information in heterogeneous networks. Establish a statistical analysis model to encrypt user authentication information in a heterogeneous network to achieve intelligence. Simulation results show that the method has good scrambling ability and strong anti-attack ability. It is used for bilinear pairing signature encryption of user authentication keys in heterogeneous networks.

Network embedding (graph embedding) has become the focus of studying graph structure in recent years. In addition to the research on homogeneous networks and heterogeneous networks, there are also some methods to attempt to solve the problem of dynamic network embedding. However, in dynamic networks, there is no research method specifically for heterogeneous networks. Therefore, this paper proposes a heterogeneous dynamic graph attention network (HDGAN), which attempts to use the attention mechanism to take the heterogeneity and dynamics of the network into account at the same time, so as to better learn network embedding. Our method is based on three levels of attention, namely structural-level attention, semantic-level attention and time-level attention. Structural-level attention pays attention to the network structure itself, and obtains the representation of structural-level nodes by learning the attention coefficients of neighbor nodes. Semantic-level attention integrates semantic information into the representation of nodes by learning the optimal weighted combination of different meta-paths. Time-level attention is based on the time decay effect, and the time feature is introduced into the node representation by neighborhood formation sequence. Through the above three levels of attention mechanism, the final network embedding can be obtained.Through experiments on two real-world heterogeneous dynamic networks, our models have the best results, proving the effectiveness of the HDGAN model.

In this paper, we propose an approach to learn optimal service representations that can be used in downstream data mining tasks by combining attributes and multiple relations from a heterogeneous information network and using meta-paths to model service relations. We construct a heterogeneous information network that connects services, mashups, and their attributes and derive latent relational knowledge from it for representation learning. We address two major challenges related to using such a heterogeneous network in representation learning: (1) how to effectively combine attribute information and network topology, (2) how to optimize the weighting scheme among those inputs to enhance the learning from relevant features and minimize distraction from noisy ones. Our approach can take advantage of partially or fully annotated data, and still works in a fully unsupervised setting. We conduct a comprehensive experimental study on a real world dataset, where we use clustering as a downstream task. In our experiments, Our model performs better than all competing approaches.

Resources are provided mainly in the form of services in cloud computing. In the distribute environment of cloud computing, how to find the needed services efficiently and accurately is the most urgent problem in cloud computing. In cloud computing, services are the intermediary of cloud platform, services are connected by lots of service providers and requesters and construct the complex heterogeneous network. The traditional recommendation systems only consider the functional and non-functional requirements of services but ignore the links between providers and requesters of service, which result to the service position is not accurate. Focus on the problems, this study intends to model the relationship of the cloud services participants with the format of heterogeneous information network, which intend to mine the hidden relationships between services participants in the cloud computing environment. In theoretical research, we proposed a cloud service heterogeneous network extraction and automatic maintenance model, proposed a new service recommendation system based on heterogeneous service network ranking and clustering.

Heterogeneous Information Network (HIN) has attracted much attention due to its wide applicability in a variety of data mining tasks. A potentially large number of meta-paths can be extracted from the heterogeneous networks, providing abundant semantic knowledge. However, too many meta-paths may be redundant. Reduction on the number of meta-paths can enhance the effectiveness since some redundant meta-paths provide interferential linkage to the task. Moreover, the reduced meta-paths can reflect the characteristic of the heterogeneous network. In this paper, unlike previous supervised model, we propose a novel algorithm, SPMR (Semantic Preserving Meta-path Reduction), to reduce a set of pre-defined meta-paths in an unsupervised setting. The proposed method is able to evaluate a set of meta-paths to maximally preserve the semantics of original meta-paths after reduction. Experimental results show that SPMR can select a succinct subset of meta-paths which can achieve comparable or even better performance with fewer meta-paths.

Classification can also take advantage of links in heterogeneous information networks. Knowledge can be effectively propagated across a heterogeneous network because the nodes of the same type that are linked similarly via the same typed links are likely to be similar. Moreover, following the idea of ranking-based clustering, one can explore ranking-based classification since objects highly ranked in a class are likely to play a more important role in classification. In this chapter, we show that by distinguishing the types of links in the networks during class label propagation, the classification accuracy can be significantly enhanced.

Network and linked data have become quite prevalent in recent years because of the ubiquity of the web and social media applications, which are inherently network oriented. Such networks are massive, dynamic, contain a lot of content, and may evolve over time. In this paper, we will study the problem of efficient dynamic link inference in temporal and heterogeneous information networks. The problem of efficiently performing dynamic link inference is extremely challenging in massive and heterogeneous information network because of the challenges associated with the dynamic nature of the network, and the different types of nodes and attributes in it. Both the topology and type information need to be used effectively for the link inference process. We propose an effective two‐level scheme which makes efficient macro‐ and micro‐decisions for combining structure and content in a dynamic and time‐sensitive way. The time‐sensitive nature of the links is leveraged in order to perform effective link prediction. We will also study how to apply the method to the problem of community prediction. We illustrate the effectiveness of our technique over a number of real data sets. Statistical Analysis and Data Mining 2013 DOI: 10.1002/sam.11198

In recent years, heterogeneous network/graph representation learning/embedding (HNE) has drawn tremendous attentions from research communities in multiple disciplines. HNE has shown its outstanding performances in various networked data analysis and mining tasks. In fact, most of real-world information networks in multiple fields can be modelled as the heterogeneous information networks (HIN). Thus, the HNE-based techniques can sufficiently capture rich-structured and semantic latent features from the given information network in order to facilitate for different task-driven learning tasks. This is considered as fundamental success of HNE-based approach in comparing with previous traditional homogeneous network/graph based embedding techniques. However, there are recent studies have also demonstrated that the heterogeneous network/graph modelling and embedding through graph neural network (GNN) is not usually reliable. This challenge is original come from the fact that most of real-world heterogeneous networks are considered as incomplete and normally contain a large number of feature noises. Therefore, multiple attempts have proposed recently to overcome this limitation. Within this approach, the meta-path-based heterogeneous graph-structured latent features and GNN-based parameters are jointly learnt and optimized during the embedding process. However, this integrated GNN and heterogeneous graph structure (HGS) learning approach still suffered a challenge of effectively parameterizing and fusing different graph-structured latent features from both GNN- and HGS-based sides into better task-driven friendly and noise-reduced embedding spaces. Therefore, in this paper we proposed a novel attention-supplemented heterogeneous graph structure embedding approach, called as: AGSE. Our proposed AGSE model supports to not only achieve the combined rich heterogeneous structural and GNN-based aggregated node representations but also transform achieved node embeddings into noise-reduced and task-driven friendly embedding space. Extensive experiments in benchmark heterogeneous networked datasets for node classification task showed the effectiveness of our proposed AGSE model in comparing with state-of-the-art network embedding baselines.

Information network derived from various domains are studied recently. Searching for Similarity is a major task into such types Information Network. Lot of research on computing similar objects is done in Homogeneous Information Network. But real world scenario can be described easily by Heterogeneous Information Network (HIN) which consists of different types of entities and relationship among them. Due to multiple type of entities and links between them in HIN, it is necessary to find the similarities between the nodes of HIN. In Homogeneous Information Network, there is only single type of node and links in between them. There are many existing methods by which similarity among the nodes of Homogeneous Information Network can be calculated. But those methods cannot be applied for the HIN because semantic meaning behind each path cannot be considered. If we want to apply techniques of Homogeneous Information Network on HIN then we need to project HIN into Homogeneous Information Network which causes loss of Information. So there is a need to apply different techniques or similarity measures on HIN to calculate the similarities between nodes in HIN. There are many similarity measures implemented by researchers for HIN. Similarity search basically concentrates on discovering the most similarity objects for a given query entity. In a comparative analysis section, we have discussed some of the measures used for similarity.

Mention recommendation is the task of recommending the right candidate users in a message. Many works have been conducted on the problem of whom to mention. However, due to the sparsity and heterogeneous of mention data, none of them well solve the problem. The recent advances in network embedding representation learning provide an effective approach to model the sparsity and heterogeneous simultaneously in heterogeneous information network. To this end, we propose a novel Network Embedding Mention (NEM) recommendation model to recommend the right users in a message. NEM constructs a heterogeneous mention network based on different relationships among different entities. Then NEM learns a unified low dimensional embedding vector using random walk for users and messages by considering network structure and vertex content information. Finally, whom to mention is ranked by calculating the relevance scores from heterogeneous user and message embeddings. To evaluate the proposed method, we construct a large dataset and their corresponding social networks from a real-world social media platform. Through extensive experiments on real-world mention collection, we demonstrate that our proposed model outperforms the previous state-of-the-art methods in term of recommendation task.

Prediction of lncRNA-disease associations via an embedding learning HOPE in heterogeneous information networks

Clustering and ranking have been successfully applied independently to homogeneous information networks, containing only one type of objects. However, real-world information networks are oftentimes heterogeneous, containing multiple types of objects and links. Recent research has shown that clustering and ranking can actually mutually enhance each other, and several techniques have been developed to integrate clustering and ranking together on a heterogeneous information network. To the best of our knowledge, however, all of such techniques assume the network follows a certain schema. In this paper, we propose a probabilistic generative model that simultaneously achieves clustering and ranking on a heterogeneous network that can follow arbitrary schema, where the edges from different types are sampled from a Poisson distribution with the parameters determined by the ranking scores of the nodes in each cluster. A variational Bayesian inference method is proposed to learn these parameters, which can be used to output ranking and clusters simultaneously. Our method is evaluated on both synthetic and real-world networks extracted from the DBLP and YELP data. Experimental results show that our method outperforms the state-of-the-art baselines.

In this paper, we explore heterogenous information networks in which each vertex represents one entity and the edges reflect linkage relationships. Heterogenous information networks contain vertices of several entity types, such as papers, authors and terms, and hence can fully reflect multiple linkage relationships among different entities. Such a heterogeneous information network is similar to a mixed media graph (MMG). By representing a bibliographic dataset as an MMG, the performance obtained when searching relevant entities (e.g., papers) can be improved. Furthermore, our academic search enables multiple-entity search, where a variety of entity search results are provided, such as relevant papers, authors and conferences, via a one-time query. Explicitly, given a bibliographic dataset, we propose a Global-MMG, in which a global heterogeneous information network is built. When a user submits a query keyword, we perform a random walk with restart (RWR) to retrieve papers or other types of entity objects. To reduce the query response time, algorithm Net-MMG (standing for NetClus-based MMG) is developed. Algorithm Net-MMG first divides a heterogeneous information network into a collection of sub-networks. Afterward, the Net-MMG performs a RWR on a set of selected relevant sub-networks. We implemented our academic search and conducted extensive experiments using the ACM Digital Library. The experimental results show that by exploring heterogeneous information networks and RWR, both the Global-MMG and Net-MMG achieve better search quality compared with existing academic search services. In addition, the Net-MMG has a shorter query response time while still guaranteeing good quality in search results.