Natural Language Processing

Natural Language Processing (NLP) involves the use of algorithms and models and various computational techniques to analyze, process, and generate natural language data, including speech and text. NLP helps computers interact with humans in a more natural way, which has become increasingly important as more humancomputer interactions take place. NLP allows machines to process and analyze voluminous unstructured data, including social media posts, newspaper articles, reviews from customers, emails, and others. It helps organizations extract insights, automate tasks, and improve decision-making by enabling machines to understand and generate human-like language. A linguistic background is essential for understanding NLP. Linguistic theories and models help in developing NLU systems, as NLP specialists need to understand the structure and rules of language. NLU systems are organized into different components, including language modelling, parsing, and semantic analysis. NLU systems may be assessed through the use of metrics that includes measures like precision and recall, as well as indicators that convey meaningful information that include F1 score and others. Semantics and knowledge representation are central to NLU, as they involve understanding the meaning of words and sentences and representing this information in a way that machines can use. Approaches to knowledge representation include semantic networks, ontologies, and vector embeddings. Language modelling is an essential step in NLP that sees usage in applications like speech recognition, text generation, and text completion and also in areas such as machine translation. Ambiguity Resolution remains a major challenge in NLP, as language is often ambiguous and context-dependent. Some common applications of NLP include sentiment analysis, chatbots, virtual assistants, machine translation, speech recognition, text classification, text summarization, and information extraction. In this chapter, we show the applicability of a popular unsupervised learning technique, viz., clustering through K-Means. The efficiency provided by the K-Means algorithm can be improved through the use of an optimization loop. The prospects for NLP are promising, with an increasing demand for AI-powered language technologies in various industries, including healthcare, finance, and e-commerce. There is also a growing need for ethical and responsible AI systems that are transparent and accountable.

The growing availability of big data spontaneously generated by social media platforms allows us to leverage natural language processing (NLP) methods as valuable tools to understand the opioid crisis. We aimed to understand how NLP has been applied to Reddit (Reddit Inc) data to study opioid use. We systematically searched for peer-reviewed studies and conference abstracts in PubMed, Scopus, PsycINFO, ACL Anthology, IEEE Xplore, and Association for Computing Machinery data repositories up to July 19, 2022. Inclusion criteria were studies investigating opioid use, using NLP techniques to analyze the textual corpora, and using Reddit as the social media data source. We were specifically interested in mapping studies' overarching goals and findings, methodologies and software used, and main limitations. In total, 30 studies were included, which were classified into 4 nonmutually exclusive overarching goal categories: methodological (n=6, 20% studies), infodemiology (n=22, 73% studies), infoveillance (n=7, 23% studies), and pharmacovigilance (n=3, 10% studies). NLP methods were used to identify content relevant to opioid use among vast quantities of textual data, to establish potential relationships between opioid use patterns or profiles and contextual factors or comorbidities, and to anticipate individuals' transitions between different opioid-related subreddits, likely revealing progression through opioid use stages. Most studies used an embedding technique (12/30, 40%), prediction or classification approach (12/30, 40%), topic modeling (9/30, 30%), and sentiment analysis (6/30, 20%). The most frequently used programming languages were Python (20/30, 67%) and R (2/30, 7%). Among the studies that reported limitations (20/30, 67%), the most cited was the uncertainty regarding whether redditors participating in these forums were representative of people who use opioids (8/20, 40%). The papers were very recent (28/30, 93%), from 2019 to 2022, with authors from a range of disciplines. This scoping review identified a wide variety of NLP techniques and applications used to support surveillance and social media interventions addressing the opioid crisis. Despite the clear potential of these methods to enable the identification of opioid-relevant content in Reddit and its analysis, there are limits to the degree of interpretive meaning that they can provide. Moreover, we identified the need for standardized ethical guidelines to govern the use of Reddit data to safeguard the anonymity and privacy of people using these forums.

Psychedelics and meditation are known for their potential to induce personally meaningful and even transformative experiences. However, it is unclear how similar these experiences are, or how they differ from each other. This explorative study used natural language processing (NLP) methods to compare reports of personally meaningful subjective experiences facilitated by either psychedelic substances or meditation. Participants (N = 197) wrote open-ended narrative reports about their most meaningful experience facilitated either with psychedelics (n = 134) or meditation (n = 63). These reports were analysed with text similarity analyses, topic modeling and sentiment analysis. The semantic and lexical contents of the reports were highly similar and both groups expressed positive emotions on average. However, psychedelic experience reports were more emotionally charged, showing higher levels of positive and negative sentiments compared to more neutral meditation experiences. These results suggest that the two types of subjective experiences might be quite similar in general, but emotional intensity could be a distinguishing factor between them. Challenges with the NLP methods and the dataset limit the conclusions that can be drawn from the study. However, it offers new hypotheses and suggestions for future research on transformative experiences.

Natural language processing (NLP) is a branch of artificial intelligence, and is a computational technique which analyzes and synthesizes the natural language written and spoken by humans. The human brain can recognize natural language instantly, but for a machine to understand it, this raw data needs to be processed. Computer applications which work for varying structures of languages can be built using NLP. This process will take unstructured data (human language) as input, and after processing, it will be converted to computer-readable languages. This complex process must follow various attributes and the grammatical structure of natural language. NLP performs syntactic and semantic analysis to identify data patterns hidden in natural language. Syntactic analysis, also called parsing, is a phase whose purpose is to draw the exact meaning of an NLP statement. Formal grammar rules of the underlying language are considered while processing the input. The main aim of parsing is to ensure that the string symbols in natural language comply with the grammar rules. The Graph of Words model is an approach that can be used as a better alternative to the Bag of Words model for text processing. A graph representation of the input documents focuses on word independence by considering the order of words and the distance between relevant words.

Machine learning techniques have long been the foundations of speech processing. Bayesian classiflcation, decision trees, unsupervised clustering, the EM algorithm, maximum entropy, etc. are all part of existing speech recognition systems. The success of statistical speech recognition has led to the rise of statistical and empirical methods in natural language processing. Indeed, many of the machine learning techniques used in language processing, from statistical part-of-speech tagging to the noisy channel model for machine translation have roots in work conducted in the speech fleld. However, advances in learning theory and algorithmic machine learning approaches in recent years have led to signiflcant changes in the direction and emphasis of the statistical and learning centered research in natural language processing and made a mark on natural language and speech processing. Approaches such as memory based learning, a range of linear classiflers such as Boosting, SVMs and SNoW and others have been successfully applied to a broad range of natural language problems, and these now inspire new research in speech retrieval and recognition. We have seen an increasingly close collaboration between voice and language processing researchers in some of the shared tasks such as spontaneous speech recognition and understanding, voice data information extraction, and machine translation. The purpose of this special issue was to invite speech and language researchers to communicate with each other, and with the machine learning community on the latest machine learning advances in their work. The call for papers was met with great enthusiasm from the speech and natural language community. Thirty six submissions were received; each paper was reviewed by at least three reviewers. Only ten papers were selected re∞ecting not only some of the best work on machine learning in the areas of natural language and spoken language processing but also what we view as a collection of papers that represent current trends in these areas of research both from the perspective of

BackgroundLarge language models have had a huge impact on natural language processing (NLP) in recent years. However, their application in epidemiological research is still limited to the analysis of electronic health records and social media data.ObjectivesTo demonstrate the potential of NLP beyond these domains, we aimed to develop prediction models based on texts collected from an epidemiological cohort and compare their performance to classical regression methods.MethodsWe used data from the British National Child Development Study, where 10,567 children aged 11 years wrote essays about how they imagined themselves as 25-year-olds. Overall, 15% of the data set was set aside as a test set for performance evaluation. Pretrained language models were fine-tuned using AutoTrain (Hugging Face) to predict current reading comprehension score (range: 0-35) and future BMI and physical activity (active vs inactive) at the age of 33 years. We then compared their predictive performance (accuracy or discrimination) with linear and logistic regression models, including demographic and lifestyle factors of the parents and children from birth to the age of 11 years as predictors.ResultsNLP clearly outperformed linear regression when predicting reading comprehension scores (root mean square error: 3.89, 95% CI 3.74-4.05 for NLP vs 4.14, 95% CI 3.98-4.30 and 5.41, 95% CI 5.23-5.58 for regression models with and without general ability score as a predictor, respectively). Predictive performance for physical activity was similarly poor for the 2 methods (area under the receiver operating characteristic curve: 0.55, 95% CI 0.52-0.60 for both) but was slightly better than random assignment, whereas linear regression clearly outperformed the NLP approach when predicting BMI (root mean square error: 4.38, 95% CI 4.02-4.74 for NLP vs 3.85, 95% CI 3.54-4.16 for regression). The NLP approach did not perform better than simply assigning the mean BMI from the training set as a predictor.ConclusionsOur study demonstrated the potential of using large language models on text collected from epidemiological studies. The performance of the approach appeared to depend on how directly the topic of the text was related to the outcome. Open-ended questions specifically designed to capture certain health concepts and lived experiences in combination with NLP methods should receive more attention in future epidemiological studies.

Underreporting of privacy-laden family financial exploitation of older adults and Federal underinvestment in response to elder mistreatment can adversely influence older people’s help-seeking, health, and mental health outcomes. This study compared public attitudes toward family financial exploitation by focusing on one victim (21 YouTube videos), one perpetrator (8), and a case of family financial abuse generally (19), totaling 3,796 comments included in the analysis. The victims and perpetrators in the videos were not related. Three levels of analysis were conducted: sentiment and emotion analyses using advanced natural language processing (NLP) methods and a human-coded subsample. Sentiment analysis showed that among the three cases, a greater share of negative (about 40%) and positive (nearly 60%) comments was attributed to the perpetrator and victim, respectively. Emotion analysis found no shared emotions between the victim and perpetrator cases. Disapproval, surprise, disgust, and confusion were expressed solely concerning the perpetrator, whereas anger and fear were expressed solely concerning the victim. Caring, love, and gratitude were shared emotions across the victim and the general cases. Sadness, admiration, curiosity, annoyance, and approval were five emotions shared across all three cases. Human-coded sub-sample analysis showed expressions of sarcasm, and microaggressions directed at the perpetrator’s race and gender. Although NLP methods did not capture victim-perpetrator background-related attitudes in relation to family financial abuse, they delineated relatively clear-cut attitudes toward victim and perpetrator status, reflecting a public concern toward elder family financial exploitation. Public attitudes may be harnessed for stakeholder engagement to increase reporting and investment in elder mistreatment.

Sidhom and Hassoun discuss the crucial role of NLP (Natural Language Processing) tools in Knowledge Extraction and Management as well as in the design of Information Retrieval Systems. The authors focus more specifically on the morpho-syntactic issues by describing their morpho-syntactic analysis platform, which has been implemented to cover the automatic indexing and information retrieval topics. To this end they implemented the Cascaded Augmented Transition Network (ATN). They used this formalism in order to analyse French text descriptions of Multimedia documents. An implementation of an ATN parsing automaton is briefly described. The Platform in its logical operation is considered as an investigative tool towards the knowledge organization (based on an NP -Noun Phrase- recognition model) and management of multiform e(electronic)-documents (text, multimedia, audio, image) using their text descriptions.

Wine production is an important sector of the food industry in Bulgaria, contributing to both economic development and cultural heritage. The present study aims to show how natural language processing (NLP) and machine learning methods can be applied to analyze expert-written Bulgarian wine descriptions and to extract patterns related to wine quality and style. Based on a bilingual dataset of reviews (in Bulgarian and English), semantic analysis, classification, regression and clustering models were used, which combine textual and structured data. The descriptions were transformed into numerical representations using a pre-trained language model (BERT), after which algorithms were used to predict style categories and ratings. Additional sentiment and segmentation analyses revealed differences between wine types, and clustering identified thematic structures in the expert language. The comparison between predefined styles and automatically derived clusters was evaluated using metrics such as Adjusted Rand Index (ARI) and Normalized Mutual Information (NMI). The resulting analysis shows that text descriptions contain valuable information that allows for automated wine profiling. These findings can be applied by a wide range of stakeholders—researchers, producers, retailers, and marketing specialists.

Objective - This paper focuses on analyzing the significance of sports footwear brands by processing large text data from the Internet. In a modern environment, the brand distinguishes a company's products or services from those of its competitors. A strong brand can help build trust with customers as they perceive the brand as reliable and trustworthy. Methodology/Technique - The study uses NLP (Natural Language Processing) methods to analyze rich text content on the Internet. The research focus is based on the application of innovative methods to determine the importance and value of a brand using NLP techniques by analyzing the content of a large corpus of text originating from websites dealing with sports footwear brands. The NLP analysis models were programmed using the low-code analysis tool KNIME. Findings – The analysis is carried out for the most well-known sports footwear brands such as Nike, Adidas, Puma, Under Armour, Reebok and Asics. The research object refers to the analysis of brand significance and the evaluation of consumer opinions on sports footwear, based on the processing of large text data from the internet. Novelty - The research results are based on an innovative approach to measuring and evaluating the brand significance in sports footwear using NLP methods to analyze large text content from the Internet. The results obtained show that this new approach to metrics and evaluation can significantly improve existing methods of brand evaluation. Type of Paper: Empirical JEL Classification: M32, M39. Keywords: Brand, NLP Method, Text Analysis, Online Brand Management Strategies, Sports Footwear. Reference to this paper should be made as follows: Tarade, S.S; Vuković, D. (2023). Discovering the Significance of Sports Footwear Brands through Text Analysis, J. Mgt. Mkt. Review, 8(4), 166 – 175. https://doi.org/10.35609/jmmr.2023.8.4(7)

BackgroundMachine learning systems are part of the field of artificial intelligence that automatically learn models from data to make better decisions. Natural language processing (NLP), by using corpora and learning approaches, provides good performance in statistical tasks, such as text classification or sentiment mining.ObjectiveThe primary aim of this systematic review was to summarize and characterize, in methodological and technical terms, studies that used machine learning and NLP techniques for mental health. The secondary aim was to consider the potential use of these methods in mental health clinical practiceMethodsThis systematic review follows the PRISMA (Preferred Reporting Items for Systematic Review and Meta-analysis) guidelines and is registered with PROSPERO (Prospective Register of Systematic Reviews; number CRD42019107376). The search was conducted using 4 medical databases (PubMed, Scopus, ScienceDirect, and PsycINFO) with the following keywords: machine learning, data mining, psychiatry, mental health, and mental disorder. The exclusion criteria were as follows: languages other than English, anonymization process, case studies, conference papers, and reviews. No limitations on publication dates were imposed.ResultsA total of 327 articles were identified, of which 269 (82.3%) were excluded and 58 (17.7%) were included in the review. The results were organized through a qualitative perspective. Although studies had heterogeneous topics and methods, some themes emerged. Population studies could be grouped into 3 categories: patients included in medical databases, patients who came to the emergency room, and social media users. The main objectives were to extract symptoms, classify severity of illness, compare therapy effectiveness, provide psychopathological clues, and challenge the current nosography. Medical records and social media were the 2 major data sources. With regard to the methods used, preprocessing used the standard methods of NLP and unique identifier extraction dedicated to medical texts. Efficient classifiers were preferred rather than transparent functioning classifiers. Python was the most frequently used platform.ConclusionsMachine learning and NLP models have been highly topical issues in medicine in recent years and may be considered a new paradigm in medical research. However, these processes tend to confirm clinical hypotheses rather than developing entirely new information, and only one major category of the population (ie, social media users) is an imprecise cohort. Moreover, some language-specific features can improve the performance of NLP methods, and their extension to other languages should be more closely investigated. However, machine learning and NLP techniques provide useful information from unexplored data (ie, patients’ daily habits that are usually inaccessible to care providers). Before considering It as an additional tool of mental health care, ethical issues remain and should be discussed in a timely manner. Machine learning and NLP methods may offer multiple perspectives in mental health research but should also be considered as tools to support clinical practice.

The authors tested whether natural language processing (NLP) methods can detect and classify cognitive distortions in text messages between clinicians and people with serious mental illness as effectively as clinically trained human raters. Text messages (N=7,354) were collected from 39 clients in a randomized controlled trial of a 12-week texting intervention. Clinical annotators labeled messages for common cognitive distortions: mental filtering, jumping to conclusions, catastrophizing, "should" statements, and overgeneralizing. Multiple NLP classification methods were applied to the same messages, and performance was compared. A tuned model that used bidirectional encoder representations from transformers (F1=0.62) achieved performance comparable to that of clinical raters in classifying texts with any distortion (F1=0.63) and superior to that of other models. NLP methods can be used to effectively detect and classify cognitive distortions in text exchanges, and they have the potential to inform scalable automated tools for clinical support during message-based care for people with serious mental illness.

Yichao Zhou, Jyun-Yu Jiang, Kai-Wei Chang, Wei Wang. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.

BackgroundQualitative research methods are increasingly being used across disciplines because of their ability to help investigators understand the perspectives of participants in their own words. However, qualitative analysis is a laborious and resource-intensive process. To achieve depth, researchers are limited to smaller sample sizes when analyzing text data. One potential method to address this concern is natural language processing (NLP). Qualitative text analysis involves researchers reading data, assigning code labels, and iteratively developing findings; NLP has the potential to automate part of this process. Unfortunately, little methodological research has been done to compare automatic coding using NLP techniques and qualitative coding, which is critical to establish the viability of NLP as a useful, rigorous analysis procedure.ObjectiveThe purpose of this study was to compare the utility of a traditional qualitative text analysis, an NLP analysis, and an augmented approach that combines qualitative and NLP methods.MethodsWe conducted a 2-arm cross-over experiment to compare qualitative and NLP approaches to analyze data generated through 2 text (short message service) message survey questions, one about prescription drugs and the other about police interactions, sent to youth aged 14-24 years. We randomly assigned a question to each of the 2 experienced qualitative analysis teams for independent coding and analysis before receiving NLP results. A third team separately conducted NLP analysis of the same 2 questions. We examined the results of our analyses to compare (1) the similarity of findings derived, (2) the quality of inferences generated, and (3) the time spent in analysis.ResultsThe qualitative-only analysis for the drug question (n=58) yielded 4 major findings, whereas the NLP analysis yielded 3 findings that missed contextual elements. The qualitative and NLP-augmented analysis was the most comprehensive. For the police question (n=68), the qualitative-only analysis yielded 4 primary findings and the NLP-only analysis yielded 4 slightly different findings. Again, the augmented qualitative and NLP analysis was the most comprehensive and produced the highest quality inferences, increasing our depth of understanding (ie, details and frequencies). In terms of time, the NLP-only approach was quicker than the qualitative-only approach for the drug (120 vs 270 minutes) and police (40 vs 270 minutes) questions. An approach beginning with qualitative analysis followed by qualitative- or NLP-augmented analysis took longer time than that beginning with NLP for both drug (450 vs 240 minutes) and police (390 vs 220 minutes) questions.ConclusionsNLP provides both a foundation to code qualitatively more quickly and a method to validate qualitative findings. NLP methods were able to identify major themes found with traditional qualitative analysis but were not useful in identifying nuances. Traditional qualitative text analysis added important details and context.

Natural Language Processing, one of the most important branches of Artificial Intelligence, has close links with Logic Programming. It is one of the two roots from which Logic Programming developed, and still shares important core concepts with it (e.g. unification). The concepts and techniques used for two of its main tasks, viz. syntax analysis and semantic analysis, are illustrated with concrete examples. For syntax analysis, it is the notations of Definite Clause Grammars and Extraposition Grammars, for semantic analysis, the concepts of Montague Grammar and Generalized Quantifier Theory. Some of these techniques can also be applied to the analysis of formal languages.