English

This paper presents a method of word sense disambiguation that assigns a target word the sense that is most related to the senses of its neighbor words. We explore the use of measures of relatedness between word senses based on a novel hybrid approach. First, we investigate how to “literally” and “regularly” express a “concept”. We apply set algebra to Wordnet's synsets cooperating with Wordnet's word ontology. In this way we establish regular rules for constructing various representations (lexical notations) of a concept using Boolean operators and word forms in various synset(s) defined in Wordnet. Then we establish a formal mechanism for quantifying and estimating the semantic relatedness between concepts – we facilitate “concept distribution statistics” to determine the degree of semantic relatedness between two lexically expressed concepts. Human languages have words that can mean different things in different contexts, such words with multiple meanings are potentially “ambiguous”. The process of “deciding which of several meanings of a term is intended in a given context” is known as “Word Sense Disambiguation (WSD)”. The proposed method is not supervised, and does not require any manually created sense‐tagged training examples. The experimental results showed good performance on Semcor, a subset of the Brown corpus. We observe that measures of semantic relatedness are useful sources of information for word sense disambiguation.

All human languages have words that can mean different things in different contexts, such words with multiple meanings are potentially “ambiguous”. The process of “deciding which of several meanings of a term is intended in a given context” is known as “word sense disambiguation (WSD)”. This paper presents a method of WSD that assigns a target word the sense that is most related to the senses of its neighbor words. We explore the use of measures of relatedness between word senses based on a novel hybrid approach. First, we investigate how to “literally” and “regularly” express a “concept”. We apply set algebra to WordNet’s synsets cooperating with WordNet’s word ontology. In this way we establish regular rules for constructing various representations (lexical notations) of a concept using Boolean operators and word forms in various synset(s) defined in WordNet. Then we establish a formal mechanism for quantifying and estimating the semantic relatedness between concepts—we facilitate “concept distribution statistics” to determine the degree of semantic relatedness between two lexically expressed concepts. The experimental results showed good performance on Semcor, a subset of Brown corpus. We observe that measures of semantic relatedness are useful sources of information for WSD.

This paper presents a cross-modal approach for extracting semantic relationships between concepts using tagged images. In the proposed method, we first project both text and visual features of the tagged images to a latent space using canonical correlation analysis (CCA). Then, under the probabilistic interpretation of CCA, we calculate a representative distribution of the latent variables for each concept. Based on the representative distributions of the concepts, we derive two types of measures: the semantic relatedness between the concepts and the abstraction level of each concept. Because these measures are derived from a cross-modal scheme that enables the collaborative use of both text and visual features, the semantic relationships can successfully reflect semantic and visual contexts. Experiments conducted on tagged images collected from Flickr show that our measures are more coherent to human cognition than the conventional measures that use either text or visual features, or the WordNet-based measures. In particular, a new measure of semantic relatedness, which satisfies the triangle inequality, obtains the best results among different distance measures in our framework. The applicability of our measures to multimedia-related tasks such as concept clustering, image annotation and tag recommendation is also shown in the experiments.

Searching for the best sense for a polysemous word remains one of the greatest challenges in the representation of biomedical text. To this end, Word Sense Disambiguation (WSD) algorithms mostly rely on an External Source of Knowledge, like a Thesaurus or Ontology, for automatically selecting the proper concept of an ambiguous term in a given Window of Context using semantic similarity and relatedness measures. In this paper, we propose a Web-based Kernel function for measuring the semantic relatedness between concepts to disambiguate an expression versus multiple possible concepts. This measure uses the large volume of documents returned by PubMed Search engine to determine the greater context for a biomedical short text through a new term weighting scheme based on Rough Set Theory (RST). To illustrate the efficiency of our proposed method, we evaluate a WSD algorithm based on this measure on a biomedical dataset (MSH-WSD) that contains 203 ambiguous terms and acronyms. The obtained results demonstrate promising improvements.

This paper presents a method of word sense disambiguation that assigns a target word the sense that is most related to the senses of its neighbor words. We explore the use of measures of relatedness between word senses based on a novel hybrid approach. First, we investigate how to literally and regularly express a concept. We apply set algebra to Wordnet’s synsets cooperating with Wordnet’s word ontology. In this way we establish regular rules for constructing various representations (lexical notations) of a using Boolean operators and various word forms in synset(s). Then we construct a formal mechanism for quantifying and estimating the semantic relatedness between concepts - we facilitate concept distribution statistics to determine the degree of semantic relatedness between two lexically expressed concepts. Then we applied the measure of semantic relatedness to the WSD task. The experimental results showed good performance on Semcor, a subset of Brown corpus. We observe that measures of semantic relatedness are useful sources of information for word sense disambiguation.

Determining the extent to which two text snippets are semantically equivalent is a well-researched topic in the areas of natural language processing, information retrieval and text summarization. The sentence-to-sentence similarity scoring is extensively used in both generic and query-based summarization of documents as a significance or a similarity indicator. Nevertheless, most of these applications utilize the concept of semantic similarity measure only as a tool, without paying importance to the inherent properties of such tools that ultimately restrict the scope and technical soundness of the underlined applications. This paper aims to contribute to fill in this gap. It investigates three popular WordNet hierarchical semantic similarity measures, namely path-length, Wu and Palmer and Leacock and Chodorow, from both algebraical and intuitive properties, highlighting their inherent limitations and theoretical constraints. We have especially examined properties related to range and scope of the semantic similarity score, incremental monotonicity evolution, monotonicity with respect to hyponymy/hypernymy relationship as well as a set of interactive properties. Extension from word semantic similarity to sentence similarity has also been investigated using a pairwise canonical extension. Properties of the underlined sentence-to-sentence similarity are examined and scrutinized. Next, to overcome inherent limitations of WordNet semantic similarity in terms of accounting for various Part-of-Speech word categories, a WordNet “All word-To-Noun conversion” that makes use of Categorial Variation Database (CatVar) is put forward and evaluated using a publicly available dataset with a comparison with some state-of-the-art methods. The finding demonstrates the feasibility of the proposal and opens up new opportunities in information retrieval and natural language processing tasks.

Generalized Vector Space Models (GVSM) extend the standard Vector Space Model (VSM) by embedding additional types of information, besides terms, in the representation of documents. An interesting type of information that can be used in such models is semantic information from word thesauri like WordNet. Previous attempts to construct GVSM reported contradicting results. The most challenging problem is to incorporate the semantic information in a theoretically sound and rigorous manner and to modify the standard interpretation of the VSM. In this paper we present a new GVSM model that exploits WordNet's semantic information. The model is based on a new measure of semantic relatedness between terms. Experimental study conducted in three TREC collections reveals that semantic information can boost text retrieval performance with the use of the proposed GVSM.

Department of PsychologyUniversity of PennsylvaniaInvited chapter for LSA: A Road Toward Meaning. In press September 8, 2005AbstractIn remembering a list of words, subjects’ order of recall can reveal the in-fluence of both semantic and temporal associations among items. In thischapter, we examine how well measures of semantic relatedness (e.g., Lan-dauer & Dumais, 1997; Steyvers, Shiffrin, & Nelson, 2004) predict the orderof subject’s recalls. Analysis of recall transitions reveal that subtle varia-tions in semantic relatedness strongly influence memory retrieval. Contraryto the view that temporal and semantic similarity strictly compete as re-trieval cues, the data reveal that these two factors are separately modifiable,at least under certain conditions. These findings are not easily reconciledwithin current models of episodic and semantic memory.A central function of episodic memory is to form and utilize associations betweenitems experienced at nearby times. In addition to these newly–formed episodic associations,subjects enter the laboratory with a great deal of knowledge about verbal stimuli. Studyingthe relation between episodic and pre–existing, or semantic, associations can help shedlight on the processes that lead to episodic retrieval. One prominent view is that episodicmemory and semantic memory are separate memory systems (Tulving, 1983, 2002), and

Numerous measures have been proposed to determine the semantic relatedness between words. Earlier approaches rely on the location of the words within the structure of a terminological ontology and are categorized into distance-based or information content models. More recently research has considered the overlapping of attributes or relationships, i.e., feature matching, between words or lexical concepts. This paper focuses on Tversky's prominent parameterized ratio model and its fundamental role in semantic relatedness measures. Existing semantic relatedness measures from the distance-based and information content categories are unified through this model. Through appropriate feature selection of properties of word objects in terminological ontologies, the model may also be used as the basis for proposing numerous other approaches to creating a variety of semantic relatedness measures

A measure of semantic relatedness for resolving ambiguities in natural language database requests

Semantic Similarity is one of the highest levels of NLP. STS has significant advantages in NLP applications like information retrieval, information extraction, text summarization, data mining, machine translation, and other tasks. This research aims to present a deep learning approach for capturing semantic textual similarity (STS) in the Guragigna. The methodology involves collecting a Guragigna language corpus and preprocessing the text data and text representation is done using the Universal Sentence Encoder (USE), along with word embedding techniques including Word2Vec and GloVe and mean Square Error (MSE) is used to measure the performance. In the experimentation phase, models like LSTM, Bidirectional RNN, GRU, and Stacked RNN are trained and evaluated using different embedding techniques. The results demonstrate the efficacy of the developed models in capturing semantic textual similarity in the Guragigna language. Across different embedding techniques, including Word2Vec, GloVe, and USE, the Bidirectional RNN model with USE embedding achieves the lowest MSE of 0.0950 and the highest accuracy of 0.9244. GloVe and Word2Vec embedding also show competitive performance with slightly higher MSE and lower accuracy. The Universal Sentence Encoder consistently emerges as the top-performing embedding across all RNN architectures. The research results demonstrate the effectiveness of LSTM, GRU, Bi RNN, and Stacked RNN models in measuring semantic textual similarity in the Guragigna language.

Existing evaluation methods either investigate whether ontologies are “fit for purpose”, or focus on evaluating consistencies of the data in regard to the axioms defined in the ontologies. In this paper, we focus on how to evaluate the consistency of ontology with respect to taxonomic relationships, and we suggest a new measure to evaluate the taxonomic consistency of an ontology. As the semantic relatedness measure between concepts in ontologies is the key part of ontology consistency measure, we firstly propose a new approach to measure the semantic rela-tedness for pairs of words. Several experiments demonstrate that the proposed ontology measure identifing the consistency with respect to taxonomic relationships is better than existing approaches.

Main challenges to the current semantic web service technologies are exponential continuous growth in the number of services on the Internet, syntax based discovery, lack of common agreed upon semantic service standards and heterogeneity of ontologies. In this paper, a service discovery approach independent of semantic service description models is proposed to solve the challenges of the current web service discovery. The idea is to combine principles from machine learning, data mining, statistical techniques and measures of semantic relatedness to make the semantic web service discovery process more intelligent, efficient and effective. The proposed approach exploits the use of semantic as well as syntactic information present within the service description profiles. Our approach is unique in terms of its application to any web service description language and the use of Omiotis measure of semantic relatedness for service discovery. The proposed approach has been implemented on OWL-S based service descriptions profiles and is able to find semantic relationship between the services which were otherwise discarded by the OWL-MX matchmaker. Empirical analysis shows that the proposed method out performs the

Several approaches for computing semantic similarity and relatedness measures between terms have been developed. This paper proposes a new semantic similarity measure between two nodes concentrating on nouns as well as their hypernym/hyponym relationships based on the structure of Wordnet. In particular, the similarity of two given nouns depends not only on their positions but also on their relevancy connections in the hierarchy. We evaluate our measure and the other ones on dataset of Miller-Charles and then compute the correlation coefficients to the human judgments. The experimental results show that our method outperforms edge-counting methods.

Semantic textual similarity is the basis of countless applications and plays an important role in diverse areas, such as information retrieval, plagiarism detection, information extraction and machine translation. This article proposes an innovative word embedding-based system devoted to calculate the semantic similarity in Arabic sentences. The main idea is to exploit vectors as word representations in a multidi-mensional space in order to capture the semantic and syntactic properties of words. IDF weighting and Part-of-Speech tagging are applied on the examined sentences to support the identification of words that are highly descriptive in each sentence. The performance of our proposed system is confirmed through the Pearson correlation between our assigned semantic similarity scores and human judgments.