Chapter 10 - Artificial intelligence and the interplay between tumor and immunity

Simple SummaryThe combination of digital pathology (DP) with artificial intelligence (AI) offers faster, more accurate, and more comprehensive diagnoses, resulting in more precise individualized treatment. As this technology is constantly evolving, it is critical to understand the current state of AI applications in DP. Thus, it is necessary to analyze AI patent applications, assignees, and leaders in the field. In this study, five major patent databases, namely, those of the USPTO, EPO, KIPO, JPO, and CNIPA, were searched using key phrases, such as DP, AI, machine learning, and deep learning, and 523 patents were shortlisted based on the inclusion criteria. Our data demonstrated that the key areas of the patents were whole-slide imaging, segmentation, classification, and detection. In the past five years, an increasing trend in patent filing has been observed, mainly in a few prominent countries, with a focus on the digitization of pathological images and AI technologies that support the critical role of pathologists.The integration of digital pathology (DP) with artificial intelligence (AI) enables faster, more accurate, and thorough diagnoses, leading to more precise personalized treatment. As technology is advancing rapidly, it is critical to understand the current state of AI applications in DP. Therefore, a patent analysis of AI in DP is required to assess the application and publication trends, major assignees, and leaders in the field. We searched five major patent databases, namely, those of the USPTO, EPO, KIPO, JPO, and CNIPA, from 1974 to 2021, using keywords such as DP, AI, machine learning, and deep learning. We discovered 6284 patents, 523 of which were used for trend analyses on time series, international distribution, top assignees; word cloud analysis; and subject category analyses. Patent filing and publication have increased exponentially over the past five years. The United States has published the most patents, followed by China and South Korea (248, 117, and 48, respectively). The top assignees were Paige.AI, Inc. (New York City, NY, USA) and Siemens, Inc. (Munich, Germany) The primary areas were whole-slide imaging, segmentation, classification, and detection. Based on these findings, we expect a surge in DP and AI patent applications focusing on the digitalization of pathological images and AI technologies that support the vital role of pathologists.

Artificial Intelligence: The Future of Maxillofacial Prognosis and Diagnosis?

Chapter 11 - Artificial intelligence for pathology

A conversational agent (chatbot) is computer software capable of communicating with humans using natural language processing. The crucial part of building any chatbot is the development of conversation. Despite many developments in Natural Language Processing (NLP) and Artificial Intelligence (AI), creating a good chatbot model remains a significant challenge in this field even today. A conversational bot can be used for countless errands. In general, they need to understand the user's intent and deliver appropriate replies. This is a software program of a conversational interface that allows a user to converse in the same manner one would address a human. Hence, these are used in almost every customer communication platform, like social networks. At present, there are two basic models used in developing a chatbot. Generative based models and Retrieval based models. The recent advancements in deep learning and artificial intelligence, such as the end-to-end trainable neural networks have rapidly replaced earlier methods based on hand-written instructions and patterns or statistical methods. This paper proposes a new method of creating a chatbot using a deep neural learning method. In this method, a neural network with multiple layers is built to learn and process the data.

Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases

The tumor microenvironment (TME) actively contribute to tumor development and treatment response. The interplay between tumor cells, immune cells, fibroblasts and blood vessels contribute to immune escape and drug resistance. Prior to treatment, higher tumor infiltrating lymphocytes correlate with better survival, while greater stromal content is linked to poor survival. Studying the composition and dynamics of the TME is essential for improving patient stratification, however a scalable tool for addressing this question is still lacking. Spatially resolved omics technologies allow for charting tissue architecture at the individual cell level, though large-scale studies remain challenging due to high expenses. In contrast, hematoxylin and eosin (H&E) slides are a cost-effective modality that provide rich morphological information for studying spatial biology. However, their use relies on pathologist interpretation. A key area of research in digital pathology has been automating cell (type) identification, predicting nuclei location and cell type in H&E slides. Existing deep learning models are limited by the quantity and diversity of training data, which requires pathologists to carefully annotate the location and identity of large volume of cells. To date, the largest dataset comprises approximately 200,000 cells, annotated with four cell types across 19 cancer types. We propose a novel approach of automated “molecular annotation”, where cell types and location on H&E slides are annotated with the aid of spatial proteomics, in place of pathologist annotation. Specifically, samples were profiled with both modalities. From the spatial omics modality, pixels were first segmented into cells, followed by cell clustering and cluster annotation based on molecular features of the cells. The location and identity of all cells on the tissue were then identified. These information were subsequently transferred to the H&E image by alignment at single-cell resolution, forming a dataset annotated with molecular ground truth. With a spatial omics dataset of two spatial proteomics slides from colorectal cancer patients, we obtained 160,000 annotated cells including 50,000 immune cells, 25,000 tumor cells, 12,600 stroma, 7,900 endothelial cells, among others. The size of this dataset is close to the largest annotated dataset publicly available to date. We then use this dataset to benchmark existing state-of-the-art deep-learning based cell type predictions models, as well as to fine-tune existing models for predicting cells in the colorectal tumor microenvironment. This proof-of-concept study aims to demonstrate the feasibility of molecular annotation approach. By including more spatial omics data, this approach can boost the performance of existing pre-trained models and enhance generalizability to specific tumor types. It opens up the opportunity to harness millions of cells for deep learning models to predict cell types on H&E slides, make AI models a cost-effective option for studying the TME. Citation Format: Siao-Han Wong, Benedikt Brors, Sonja Loges. Empowering AI-driven prediction of the tumor microenvironment from histopathology images via molecular annotation [abstract]. In: Proceedings of the AACR Special Conference in Cancer Research: Artificial Intelligence and Machine Learning; 2025 Jul 10-12; Montreal, QC, Canada. Philadelphia (PA): AACR; Clin Cancer Res 2025;31(13_Suppl):Abstract nr B053.

Quality assessment of prenatal ultrasonography is essential for the screening of fetal central nervous system (CNS) anomalies. The interpretation of fetal brain structures is highly subjective, expertise-driven, and requires years of training experience, limiting quality prenatal care for all pregnant mothers. With recent advancement in Artificial Intelligence (AI), computer assisted diagnosis has shown promising results, being able to provide expert level diagnosis in matter of seconds and therefore has the potential to improve access to quality and standardized care for all. Specifically, with advent of deep learning (DL), assistance in precise anatomy identification through semantic segmentation essential for the reliable assessment of growth and neurodevelopment, and detection of structural abnormalities have been proposed. However, existing works only identify certain structures (e.g., cavum septum pellucidum [CSP], lateral ventricles [LV], cerebellum ) from either of the axial views (transventricular [TV], transcerebellar [TC]), limiting the scope for a thorough anatomical assessment as per practice guidelines necessary for the screening of CNS anomalies. Further, existing works do not analyze the generalizability of these DL algorithms across images from multiple ultrasound devices and centers, thus, limiting their real-world clinical impact. In this study, we propose a deep learning (DL) based segmentation framework for the automated segmentation of 10 key fetal brain structures from 2 axial planes from fetal brain USG images (2D). We developed a custom U-Net variant that uses inceptionv4 block as a feature extractor and leverages custom domain-specific data augmentation. Quantitatively, the mean (10 structures; test sets 1/2/3/4) Dice-coefficients were: 0.827, 0.802, 0.731, 0.783. Irrespective of the USG device/center, the DL segmentations were qualitatively comparable to their manual segmentations. The proposed DL system offered a promising and generalizable performance (multi-centers, multi-device) and also presents evidence in support of device-induced variation in image quality (a challenge to generalizibility) by using UMAP analysis. Its clinical translation can assist a wide range of users across settings to deliver standardized and quality prenatal examinations.

Deep Learning and Beyond: AI’s New Horizons” is an expansive monograph that delves into the dynamic and rapidly evolving field of deep learning, a key area of artificial intelligence. This comprehensive work provides an insightful exploration of the revolutionary developments, foundational concepts, and future directions of deep learning, positioning itself as a crucial resource for understanding this transformative technology. The monograph commences with an introductory chapter that lays the groundwork by elucidating the background of machine learning and chronicling the ascent of deep learning. This foundational perspective is vital for comprehending the underlying principles and methodologies that have propelled deep learning to the forefront of technological innovation. Subsequent chapters delve into the “Historical Evolution” of AI, tracing the origins of neural networks from their early inception to the Renaissance period of deep learning. This historical analysis is pivotal in understanding the field’s trajectory and significant milestones. The “Foundations of Deep Learning” chapter presents an in-depth analysis of neural networks, covering their basic architecture, activation functions, layers, and the critical process of backpropagation and gradient descent. This is followed by examining “Advanced Neural Network Architectures,” where the focus shifts to state-of-the-art models such as convolutional neural networks, recurrent neural networks, and groundbreaking transformers and attention mechanisms. In addressing the “Training Deep Models,” the monograph explores regularization techniques, optimization strategies, and the increasingly significant role of transfer learning and pre-trained models. The application-oriented chapter, “Applications of Deep Learning,” showcases real-world implementations in domains like image recognition, natural language viii processing, and autonomous systems, illustrating deep learning technologies’ vast potential and versatility. The monograph also tackles the “Challenges in Deep Learning,” including overfitting, interpretability, and the ethical considerations surrounding AI deployment. It then ventures into the “Future of Deep Learning,” contemplating emerging trends such as integrating quantum computing, neural architecture search, and the convergence of neuroscience and deep learning. “Case Studies” provide practical insights and empirical evidence of the impact of deep learning. At the same time, the concluding chapter synthesizes the current state of deep learning, offers predictions for the future, and provides reflective thoughts on this transformative field. “Deep Learning and Beyond: AI’s New Horizons” educates and informs readers about the vast potential and future possibilities of deep learning and artificial intelligence. Keywords: Deep Learning, Artificial Intelligence, Neural Networks, Machine Learning, Convolutional Neural Networks, Recurrent Neural Networks, Transformers, Quantum Computing, Ethical AI, Neural Architecture Search, Natural Language Processing, Autonomous Systems, AI in Healthcare, Future of AI, AI Applications, AI Challenges.

The integration of Artificial Intelligence (AI) into financial forecasting has transformed traditional stock market prediction methods. This research paper explores the effectiveness of AI techniques in forecasting stock trends within the Indian stock market over the last few years. We examine AI methodologies, including machine learning (ML), deep learning (DL), and hybrid models applied to the Bombay Stock Exchange (BSE) and the National Stock Exchange (NSE). By comparing historical data with AI-predicted trends, this study evaluates prediction accuracy and market relevance (Patel et al., 2015). Furthermore, the research outlines existing study gaps and proposes a future scope of integrating AI with behavioral finance and real-time analytics (Chen et al., 2022). The prediction of stock market trends remains a significant challenge due to the stochastic and non-linear nature of financial time series data (Zhang & Zhou, 2020). With the proliferation of Artificial Intelligence (AI), particularly Machine Learning (ML) and Deep Learning (DL) techniques, there has been a paradigm shift in the modeling and forecasting of stock price movements (Fischer & Krauss, 2018). This paper presents a comprehensive study on the effectiveness of AI in predicting stock market trends within the Indian financial ecosystem, focusing on a comparative analysis of AI models implemented over the last five years (2018–2023) on major indices and stocks listed on the NSE and BSE. This research evaluates the performance of multiple AI algorithms—including Support Vector Machines (SVM), Random Forests (RF), Long Short-Term Memory (LSTM) networks, Gated Recurrent Units (GRU), and hybrid ensemble models—in forecasting short- and medium-term price trends using historical stock data (Krauss et al., 2017; Chen & He, 2021). Standard evaluation metrics such as Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and classification accuracy are employed to assess model efficacy. The results indicate that while traditional machine learning algorithms offer moderate predictive power, advanced deep learning and hybrid models significantly outperform them, particularly during periods of high market volatility, such as the COVID-19 pandemic and post-lockdown recovery phases (Weng et al., 2018; Jain & Jain, 2021). The study identifies key research gaps, including limited sectoral diversification in datasets, inadequate integration of sentiment and behavioral data, overfitting issues in complex models, and the lack of real-time prediction systems in the Indian context (Gupta & Pathak, 2022). Furthermore, current models often ignore nonquantitative factors such as investor sentiment, macroeconomic indicators, and global events, which can critically impact prediction accuracy (Nassirtoussi et al., 2014). These limitations suggest the need for a more holistic and interdisciplinary approach to AI-driven financial forecasting. The scope for future research includes the development of real-time, adaptive AI systems using high-frequency trading data, the incorporation of behavioral finance through social media and news analytics, and the exploration of quantum computing-based AI models (Liu et al., 2023). From a practical standpoint, the findings of this study offer valuable insights for institutional investors, financial analysts, regulatory bodies, and developers of AIpowered trading platforms. The study concludes that while AI is not a definitive solution for market prediction, it provides a powerful augmentative tool that, when designed with robustness, transparency, and adaptability, can significantly enhance decision-making in India’s fastevolving financial markets.

In today’s digital environment, the pattern is everywhere. It is present in many aspects of our daily life. Algorithms can be used to detect or mathematically observe a pattern physically. Vector feature values represent a pattern in the digital world. With the advent of artificial intelligence (AI) techniques in the recent era, there are so many machine learning (ML) and deep learning (DL) models that have been developed. ML is the branch of AI, which can perform tasks like data analysis, analytical model building, and classification without being explicitly programmed. DL is the subset of ML in AI. In DL, mostly artificial neural networks (ANNs) are utilized. It has the capability of work based upon unsupervised learning from the data that is unlabeled and unstructured. Using these DL and ML models, extract the meaningful features from the given image or video is known as pattern recognition (PR). PR is used in many engineering applications such as computer vision, natural language processing, character recognition, robotics, speech recognition, and so on. It is also used in many medical image processing applications and telemedicine. The present work discussed the pattern recognition problem and its various stages in detail. In addition to that, the application of deep learning and machine learning in pattern recognition is also explained briefly.

Artificial Intelligence and the Pathologist: Future Frenemies?

The rapid advancements in deep learning (DL) and artificial intelligence (AI) have led to transformative applications across various domains. Edge devices, including mobile and embedded systems, are crucial for the widespread adoption of machine intelligence. However, training and deploying deep neural networks (DNNs) require substantial computational resources, resulting in high energy consumption. This energy often stems from non-renewable sources, leading to significant carbon dioxide emissions and environmental damage. With the emergence of large-scale models for AI-generated content (AIGC), such as large language models and diffusion models, the energy consumption issue has intensified, creating an urgent demand for sustainable AI solutions. These challenges motivate my research on energy-efficient deep learning toward sustainable AI. To build sustainable AI systems, this thesis works on promoting AI sustainability and using AI for sustainability purposes. To promote AI sustainability, a hardware-software co-design approach is adopted, integrating both bottom-up and top-down strategies for practical, energy-efficient deep learning deployments.The first part of the thesis introduces the bottom-up approach, emphasizing AI algorithm-aware efficient system design. Specifically, edge devices utilize dynamic power management strategies, such as dynamic voltage and frequency scaling (DVFS), to manage energy consumption by adjusting voltage-frequency (VF) levels. System-level configurations, including CPU cores, CPU VF levels, and GPU VF levels, significantly impact both latency and power consumption during DNN inference. Developing effective strategies for these configurations enables system-level optimizations, providing a path to deal with the efficiency challenge. The second part of the thesis presents the top-down approach, which focuses on designing hardware-driven efficient AI algorithms. Given the hardware constraints in AI application environments, this approach explores efficient compression techniques, such as weight pruning and knowledge distillation, to create lightweight models with reduced computational demands, thereby enhancing efficiency. The third part of the thesis examines the efficiency challenges posed by the evolution of large-scale models, which have greatly enhanced the capabilities of AIGC for text and image generation. While these models offer substantial generative potential, they also exacerbate the efficiency dilemma. This section explores strategies to optimize the efficiency of these large-scale models based on their unique characteristics. Beyond efficiency, the deployment of AI in real-world applications, such as autonomous vehicles, underscores the importance of prioritizing safety. The fourth part of the thesis addresses issues of AI fairness, trustworthiness, and security to ensure sustainable AI. This section investigates the potential to reverse-engineer adversarial attacks to infer the adversary's underlying information. In conclusion, this thesis works on building energy-efficient DL for sustainable AI. The objective of the work is not only to enhance the efficiency of AI systems but also to address broader concerns of fairness, trust, and security, paving the way for responsible and sustainable AI deployment in real-world scenarios.--Author's abstract

Privacy preserving multi-party computation delegation for deep learning in cloud computing

This study examines the interdisciplinary connections that result from deep learning applications in artificial intelligence (AI) across several fields. A division of machine learning recognized as "deep learning" has proven to be remarkably effective at drawing out intricate patterns and representations from enormous datasets. Deep learning algorithms have made important improvements in fields as well as computer vision, natural language processing, robotics, finance, healthcare, advertising, and more by utilizing deep neural networks. This study’s goal is to evaluate the impact of deep learning in AI across disciplines and to draw attention to its revolutionary potential. The study examines the specific uses of deep learning in several fields and talk about the potential and problems that come with its deployment. The study provides a look at how precise object recognition, scene comprehension, and image production made deep learning transform the computer vision. Deep learning approaches have improved machine translation, sentiment analysis, and dialogue systems in natural language processing. This research study offers insights into the possibility of interdisciplinary cooperation by looking at the uses, difficulties, and future prospects of deep learning in AI. It demonstrates the transformative impact of deep learning in fostering creativity and advancement across a variety of sectors, opening the door for the creation of more intelligent and advanced AI systems.

In recent years, Deep Learning (DL), such as the algorithms of Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN) and Generative Adversarial Networks (GAN), has been widely studied and applied in various fields including agriculture. Researchers in the fields of agriculture often use software frameworks without sufficiently examining the ideas and mechanisms of a technique. This article provides a concise summary of major DL algorithms, including concepts, limitations, implementation, training processes, and example codes, to help researchers in agriculture to gain a holistic picture of major DL techniques quickly. Research on DL applications in agriculture is summarized and analyzed, and future opportunities are discussed in this paper, which is expected to help researchers in agriculture to better understand DL algorithms and learn major DL techniques quickly, and further to facilitate data analysis, enhance related research in agriculture, and thus promote DL applications effectively. Keywords: deep learning, smart agriculture, neural network, convolutional neural networks, recurrent neural networks, generative adversarial networks, artificial intelligence, image processing, pattern recognition DOI: 10.25165/j.ijabe.20181104.4475 Citation: Zhu N Y, Liu X, Liu Z Q, Hu K, Wang Y K, Tan J L, et al. Deep learning for smart agriculture: Concepts, tools, applications, and opportunities. Int J Agric & Biol Eng, 2018; 11(4): 32-44.