AdaptAhead Optimization Algorithm for Learning Deep CNN Applied to MRI Segmentation.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

Artificial Intelligence in the American Healthcare Industry: Looking Forward to 2030

Deep Learning and Beyond: AI’s New Horizons” is an expansive monograph that delves into the dynamic and rapidly evolving field of deep learning, a key area of artificial intelligence. This comprehensive work provides an insightful exploration of the revolutionary developments, foundational concepts, and future directions of deep learning, positioning itself as a crucial resource for understanding this transformative technology. The monograph commences with an introductory chapter that lays the groundwork by elucidating the background of machine learning and chronicling the ascent of deep learning. This foundational perspective is vital for comprehending the underlying principles and methodologies that have propelled deep learning to the forefront of technological innovation. Subsequent chapters delve into the “Historical Evolution” of AI, tracing the origins of neural networks from their early inception to the Renaissance period of deep learning. This historical analysis is pivotal in understanding the field’s trajectory and significant milestones. The “Foundations of Deep Learning” chapter presents an in-depth analysis of neural networks, covering their basic architecture, activation functions, layers, and the critical process of backpropagation and gradient descent. This is followed by examining “Advanced Neural Network Architectures,” where the focus shifts to state-of-the-art models such as convolutional neural networks, recurrent neural networks, and groundbreaking transformers and attention mechanisms. In addressing the “Training Deep Models,” the monograph explores regularization techniques, optimization strategies, and the increasingly significant role of transfer learning and pre-trained models. The application-oriented chapter, “Applications of Deep Learning,” showcases real-world implementations in domains like image recognition, natural language viii processing, and autonomous systems, illustrating deep learning technologies’ vast potential and versatility. The monograph also tackles the “Challenges in Deep Learning,” including overfitting, interpretability, and the ethical considerations surrounding AI deployment. It then ventures into the “Future of Deep Learning,” contemplating emerging trends such as integrating quantum computing, neural architecture search, and the convergence of neuroscience and deep learning. “Case Studies” provide practical insights and empirical evidence of the impact of deep learning. At the same time, the concluding chapter synthesizes the current state of deep learning, offers predictions for the future, and provides reflective thoughts on this transformative field. “Deep Learning and Beyond: AI’s New Horizons” educates and informs readers about the vast potential and future possibilities of deep learning and artificial intelligence. Keywords: Deep Learning, Artificial Intelligence, Neural Networks, Machine Learning, Convolutional Neural Networks, Recurrent Neural Networks, Transformers, Quantum Computing, Ethical AI, Neural Architecture Search, Natural Language Processing, Autonomous Systems, AI in Healthcare, Future of AI, AI Applications, AI Challenges.

Algorithms based on deep learning are taking off as solutions to several problems in numerous fields. Numerous deep learning architectures like convolutional neural networks, recurrent neural networks, deep belief networks, artificial neural networks and deep neural networks have been used in fields such as audio recognition, machine vision, processing of natural language, recognition of speech, social network filtering, computer vision, translating languages and bioinformatics. One such application of deep learning architectures is object detection. Object detection in satellite and aerial imagery undertakes an important role in a long list of applications and has allured a lot of attention which resulted in exceptional progress in recent years. It has abundant uses in various fields such as surveillance, military, national security, urban planning, environmental applications, traffic control and forestry. Several issues like varying size, background and orientation of the target object make the automatic detection of target in satellite imagery a challenging issue. Recent research in this field has given better speed and accuracy to the detection of the target object. With the rise in the data being generated by the Earth Observation programs, it is becoming much more imperative to find better and efficient ways to exploit this data by improving upon the existing Deep Learning research. In this paper, we bring forth a wide-ranging analysis of the recent advancements in methods of object detection based on deep learning to recognize the objects in satellite imagery.KeywordsDeep learningObject detectionSatellite imageryRemote sensingYou Only Look Once (YOLO)You Only Look Twice (YOLT)Single Shot Detector (SSD)Convolutional Neural Networks (CNN)Faster Region-based Convolutional Neural Networks (Faster RCNN)Hybrid Deep Convolutional Neural Network (HDNN)Satellite Imagery Multiscale Rapid Detection with Windowed Networks (SIMRDWN)

Artificial intelligence (AI) has emerged as a transformative tool in the diagnosis and management of gastrointestinal (GI) and liver diseases. In clinical practice AI consists of overlapping technologies such as machine learning (ML), deep learning, natural language processing, computer vision, and generative AI. ML is a computer learning system that can provide insight into disease risk factors and phenotypes. Deep learning is an advanced and complex form of ML, structured with different levels of specific algorithms known as convolutional neural networks that can rapidly and accurately process unstructured, high-dimensional data, such as texts, images, and waveforms. Natural language processing is dedicated to facilitating interactions between computers and humans using natural language and helps to analyze, understand, and derive actionable information from unstructured healthcare data, including electronic health records, clinical notes, medical literature, and patient-generated content. Computer vision focuses on enabling computers to see and interpret images and videos and serves as an augmentation tool for endoscopists, improving accuracy and decreasing procedural time. Generative AI is capable of creating new forms of content by learning from a large body of data in the form of text, audio, images, or video and includes large language models. AI has been used in several GI diseases such as esophageal neoplasia, gastric cancer, Helicobacter pylori infection, gastritis, GI stromal tumors, colorectal polyps, inflammatory bowel disease, irritable bowel syndrome, GI bleeding, and pancreatobiliary diseases. The potential applications of AI in liver diseases encompass a variety of conditions such as liver masses, metabolic dysfunction-associated steatotic liver disease, viral hepatitis, cirrhosis, and liver transplantation. This review discussed the common terminologies and the current status of AI in gastroenterology and hepatology, exploring its applications and ethical issues.

Artificial intelligence (AI), especially through the development of deep learning techniques like convolutional neural networks (CNNs), has revolutionized numerous fields. CNNs, introduced by Yann LeCun in the 1990s (Hubbard, W.; Jackel, L. D. Backpropagation Applied to Handwritten Zip Code Recognition. Neural Comput. 1989, 1 (4), 541- 551. https://doi.org/10.1162/neco.1989.1.4.541), have found applications in healthcare for medical diagnostics, autonomous vehicles in transportation, stock market prediction in finance, and image recognition in computer vision to name just a few. Similarly, in analytical chemistry, deep learning has enhanced data analysis from techniques like MS spectrometry, NMR, fluorescence spectroscopy, and chromatography. Another AI branch, Natural Language Processing (NLP), has surged recently with the advent of Large Language Models (LLMs), such as OpenAI's ChatGPT. This paper demonstrates the application of an LLM via a smartphone to conduct multivariate data analyses, in an interactive conversational manner, of a hyper-spectral imaging data set from laser-induced breakdown spectroscopy (LIBS). We demonstrate the potential of LLMs to process and analyze data sets, which automatically generate and execute code in response to user queries, and anticipate their growing role in the future of analytical chemistry.

Deep convolutional neural networks (DCNNs) have been proposed as enhanced developments of neural networks (NNs) in the field of artificial intelligence (AI) and successfully applied in deep learning (DL) scenarios. With the advancement of technology, the number of network layers has continuously increased, resulting in a huge number of calculations and memory accesses required in the training and inference process of DCNNs and thereby hindering their further deployment and application. Using a specific dataflow formed by reusable DCNN data in the network-on-chip (NoC), reducing the memory access pressure and improving DCNN processing efficiency has become a promising acceleration schemes for the current DCNN. In this paper, a novel convolution layer (CONV) acceleration strategy based on logical PE set segmentation for row stationary (RS) dataflow is proposed to solve the problems of low flexibility and inefficient processing array utilization faced by the conventional folding mapping strategy. The simulation results show that the new mapping strategy based on PE set segmentation can achieve better processing element utilization and CONV acceleration improvement at the expense of little increase in the data movement energy consumption compared with the conventional strategy.

Artificial intelligence (AI) has transformed pharmacological research through machine learning, deep learning, and natural language processing. These advancements have greatly influenced drug discovery, development, and precision medicine. AI algorithms analyze vast biomedical data identifying potential drug targets, predicting efficacy, and optimizing lead compounds. AI has diverse applications in pharmacological research, including target identification, drug repurposing, virtual screening, de novo drug design, toxicity prediction, and personalized medicine. AI improves patient selection, trial design, and real-time data analysis in clinical trials, leading to enhanced safety and efficacy outcomes. Post-marketing surveillance utilizes AI-based systems to monitor adverse events, detect drug interactions, and support pharmacovigilance efforts.Machine learning models extract patterns from complex datasets, enabling accurate predictions and informed decision-making, thus accelerating drug discovery. Deep learning, specifically convolutional neural networks (CNN), excels in image analysis, aiding biomarker identification and optimizing drug formulation. Natural language processing facilitates the mining and analysis of scientific literature, unlocking valuable insights and information.However, the adoption of AI in pharmacological research raises ethical considerations. Ensuring data privacy and security, addressing algorithm bias and transparency, obtaining informed consent, and maintaining human oversight in decision-making are crucial ethical concerns. The responsible deployment of AI necessitates robust frameworks and regulations.The future of AI in pharmacological research is promising, with integration with emerging technologies like genomics, proteomics, and metabolomics offering the potential for personalized medicine and targeted therapies. Collaboration among academia, industry, and regulatory bodies is essential for the ethical implementation of AI in drug discovery and development. Continuous research and development in AI techniques and comprehensive training programs will empower scientists and healthcare professionals to fully exploit AI's potential, leading to improved patient outcomes and innovative pharmacological interventions.

Recently, advances in machine learning and artificial intelligence have made these techniques increasingly prominent. Companies and institutions have begun investing in healthcare research to improve the accuracy of disease prediction because of its widespread popularity and effective pattern detection and categorization capabilities. However, there are numerous difficulties that arise while employing these methods. The lack of a huge data set for medical pictures is one of the biggest challenges. This study aims to provide a reasonable introduction to deep learning in medical image processing, beginning with theoretical foundations and progressing to practical implementations. Deep learning (DL) has become increasingly popular due to a number of computer science discoveries, according to a new study. To get a better grasp of neural networks, the next step was to familiarise ourselves with the principles. That's why convolutional neural networks (CNNs) and deep learning are used. This gives us a better idea of why deep learning is advancing so quickly in so many different application domains, including medical image processing. Key Words: Machine Learning, Deep Learning, CNN, Cancer, Algorithm, ANN.

The problems of plant leaf disease are rather serious in the world agricultural industry, leading to a significant decrease in crop quantity and quality, consequently, resulting in a huge loss in the economy and food insecurity. Detection and successful classification of plant diseases at the initial stage is essential to further agricultural output and the quality production of food. The recent improvements in the field of artificial intelligence (AI), specifically, machine learning (ML) and deep learning (DL), have shown significant prospects in automating and enhancing methods of diagnosing plant leaf diseases by using a wide variety of ML and DL algorithms. This review article presents an in-depth analysis of thirty novel methods created by researchers to diagnose and classify plant leaf diseases. They are such conventional classifiers as Support Vector Machines (SVM), Random Forests (RF), and K-Nearest Neighbors (KNN), along with some advanced DL architectures, such as Convolutional Neural Networks (CNN), VGG16, ResNet50, InceptionResNetV2, EfficientNet, and various hybrids. The review analysis takes into consideration the methodologies applied, performance metrics, and insights in practice, as well as the strengths and weaknesses of both. The most crucial findings of the review show that deep learning models, and CNNs in particular, tend to be more accurate, robust, and feature extractors than traditional models of MLs. The performance of classification is also enhanced by numerous hybrid models that will use ML together with DL, and transfer learning has been an effective method to enhance the generalization using small datasets. Nevertheless, with all this progress, the issues of diversity of datasets, computational resource requirements and model interpretability are still to be explored in the future.

Deep learning (DL) has shown explosive growth in its application to bioinformatics and has demonstrated thrillingly promising power to mine the complex relationship hidden in large-scale biological and biomedical data. A number of comprehensive reviews have been published on such applications, ranging from high-level reviews with future perspectives to those mainly serving as tutorials. These reviews have provided an excellent introduction to and guideline for applications of DL in bioinformatics, covering multiple types of machine learning (ML) problems, different DL architectures, and ranges of biological/biomedical problems. However, most of these reviews have focused on previous research, whereas current trends in the principled DL field and perspectives on their future developments and potential new applications to biology and biomedicine are still scarce. We will focus on modern DL, the ongoing trends and future directions of the principled DL field, and postulate new and major applications in bioinformatics.

Wireless Sensor Network (WSN) signifies a state-of-the-art technology that combines energy-effective sensors with wireless transmission services enabling prompt surveillance and data collecting from the nearby environments. Owing to the intrinsic features of WSNs, they face numerous challenges of security that range from resource-based attacks, like computational overload or energy depletion, to interception, eavesdropping, and tampering. With the hacked data, the attackers can replicate the same sensors and use clones in the corresponding WSNs. This kind of cloning of the sensors, which is comprised of the WSN, is called a clone attack. Since the replicated sensors formed by the attackers have parallel keys and information, therefore the clone attacks have become a great attack for WSN. To defend WSNs against cyberattacks, machine learning (ML) and deep learning (DL) were applied to classify malicious and normal traffic. This study designs an Attack Detection and Mitigation using Deep Learning with an Optimization Algorithm in Wireless Sensor Networks (ADMDL-OAWSN). The main objective of the ADMDL-OAWSN system is to improve security in cloned nodes for the cyberattack detection model. In the primary step, the data pre-processing employs the StandardScalar method to transform input data into a suitable format. Next, the proposed ADMDL-OAWSN model designs a crayfish optimization algorithm (COA) for the subset of the feature selection (FS) to pick the most related features from an input dataset. For the attack classification process, the convolutional neural network and bi-directional gated recurrent unit with attention mechanism (CNN-BiGRU-A) technique have been exploited. At last, the parameter tuning of the CNN-BiGRU-A is applied by the design of the secretary wolf bird optimization (SeWBO) algorithm. Extensive experiments have been conducted to validate the results of the ADMDL-OAWSN system. The simulation results revealed that the ADMDL-OAWSN system emphasized furtherance when compared to other recent systems

Deep (machine) learning in recent years has significantly increased the predictive modeling strengths for applications in the areas of computer vision, speech recognition, and natural language processing. Being heavily data-driven, conventional general-purpose deep learning methods mainly rely on training data to learn task-specific data representations. In this thesis, we focus on leveraging novel learning algorithms in deep learning to tackle visual recognition challenges at the three key levels -- namely pixel, object, and image levels. Throughout the thesis, we demonstrate how each and every of our proposed methods can address a specific visual recognition problem. Firstly, we apply deep learning to improve the saliency detection performance of deep networks. A coarse saliency map of the input image's salient object is initially predicted by a convolutional-deconvolutional network (or equivalently a fully convolutional network). Following that, the coarse saliency map is sequentially refined by a separate network called Recurrent Attentional Convolutional-Deconvolutional Network (RACDNN) that shares its network weights across its sequential steps. At every sequential (temporal) step, the same RACDNN is applied to a newly selected/attended image sub-region and it performs saliency map refinement for that particular sub-region. Despite having many learnable network parameters and no access to additional training data, RADCNN can be trained well and it outperforms the "single-step" (coarse saliency detection) baseline and state-of-the-art saliency detection methods by large margins, on several saliency detection benchmark datasets. Secondly, we introduce auto-encoder weight transfer networks (AE-WTN+), a deep model for scaling up object detection. Conventional WTN transfers object class knowledge from the classification weights of a pretrained large-scale image classification network, to the classification weights of an object detection network. However, they suffer from under-fitting and are not able to preserve the rich object class information of novel classes. In this work, we propose a new WTN method -- AE-WTN+ which makes use of normalization techniques to ease network optimization. Inputs and intermediate features are normalized to improve trainability for reduced under-fitting. More importantly, a novel auto-encoding (reconstruction) loss is proposed to encourage information preservation of all classes in the weight predictions of AE-WTN+. This enables the predicted weights of AE-WTN+ to maintain the class discriminability and neighbourhood relationships contained in the pre-trained large-scale classification weights. Experiments on large-scale detection datasets validate the effectiveness of AE-WTN+ on both seen and novel classes. Thirdly, we improve the efficiency of cross-layer network connections for very deep convolutional network in the context of image classification. This gives rise to a new convolutional network architecture called Deluge Networks (DelugeNets) which pass the output (feature activations) of any preceding composite network layer as direct inputs to all succeeding composite layers. For the incoming feature activations of preceding composite layers, the succeeding composite layers first apply rather lightweight cross-layer depthwise convolutional weights on them for feature aggregation. The heavy lifting is carried out by the last convolutional weight layer in each preceding composite layer that performs cross-channel convolutions. The proposed technique enables unimpeded information flow among many layers in very deep DelugeNets with great efficiency. Experiments on small-scale and large-scale datasets show that DelugeNets perform competitively to state-of-the-art deep convolutional networks at lower computational and parameter costs. Fourthly, we propose Stochastic Downsampling (SDPoint), a method to overcome a major limitation suffered by conventional deep convolutional networks -- their computational costs during inference are fixed and cannot be changed. SDPoint downsamples the feature maps at a randomly selected point (layer index) in the network hierarchy during training. The many downsampling configurations known as SDPoint instances each entail a unique downsampling point and downsampling ratio. The same convolutional network weights are shared across the different SDPoint instances that downsample feature maps differently. During inference, the computational cost of a network trained with SDPoint can be instantaneously adjusted to fit a given computational budget, by manually selecting an appropriate SDPoint instance. Additionally, sharing weights between different feature map scales provides significant regularization benefits, making the networks trained with SDPoint less sensitive to scales and more competent. In image classification experiments, SDPoint demonstrates significant cost-accuracy and computational advantages, over independently-trained (non-weight-shared) baselines with various inference costs.

People around the world with speech and hearing impairment use a media of communication known as ‘Sign language’. In recent times, Sign language is omnipresent. However, there exists a challenge for people who do not know sign language, to communicate with people who can communicate exclusively using sign language. This gap can be bridged by using technologies of recent times to recognize gestures and design intuitive systems with deep learning. The aim of this paper is to recognise American Sign Language gestures dynamically and create an intuitive system which provides sign language translation to text and speech of various languages. The system uses Convolutional neural network, natural language processing, language translation and text-to-speech algorithms. It is capable of recognizing hand gestures dynamically and predicting the corresponding letters to form a desired sentence accurately.

With artificial intelligence (AI) rapidly reshaping global industries, its role in healthcare, and particularly in mental health, is becoming more prominent. The rising adoption of AI for enhancing clinical decision-making and therapeutic processes highlights the need to examine its use in mental health environments. To analyze the AI implementation for detecting mental health disorders is the objective of this review paper, focusing on AI contributions to risk assessment, personalized treatment, and early diagnosis of the disorders. We analyzed published studies from the year 2000 to 2024 using the PRISMA methodology, which explored machine learning (ML) models, deep learning (DL) models, natural language processing (NLP) technique, convolutional neural networks (CNNs), and reinforcement learning in the mental healthcare sector. The results show that AI-powered chatbots and data-driven therapy platforms can enhance access to mental health services, improve treatment, and increase disease detection accuracy. But these advancements also raise ethical concerns related to algorithmic biasness, data security, and the chances of depersonalization of care. Though AI implementation is highly promising, future research is essential to optimize its usage, ensure inclusivity across diverse populations, and address legal and ethical considerations. This paper explores the dynamic landscape of AI mental disorder treatment and underscores the necessity for reliable, transparent and fair AI systems development.