Applications and Research Progresses of the Integrating Image Processing and Deep Learning Technologies in the Lithofacies Identification

In recent years, with the rapid development of artificial intelligence technology, the application of deep learning in the field of pathology has been continuously expanding. Particularly, the rise of multimodal data fusion methods has opened up new technical paths for the precise diagnosis, prognosis assessment, and individualized treatment of tumors. By integrating multi-level and multi-source data such as clinical information, pathological omics, molecular omics, and imaging omics, deep learning models can identify potential associated features and key biological mechanisms that are difficult to reveal by a single modality, thereby significantly improving the accuracy of disease classification and the scientific nature of risk stratification. This article systematically reviews the research progress of multimodal data fusion methods based on deep learning in the field of pathology in recent years, focuses on sorting out different types of fusion strategies, evaluates their advantages and challenges in practical clinical applications, and looks forward to future development trends.

Temporomandibular disorders (TMD) is one of the most clinically common oral diseases.It covers a range of conditions involving the temporomandibular joint (TMJ) and its adjacent muscles and tissues. Patients typically experience discomfort symptoms such as joint clicking, TMJ pain, chewing muscle discomfort, and jaw movement dysfunction. Given the complexity of the etiology of TMD, the diversity and non-specificity of symptoms, how to accurately diagnose and formulate the best treatment plan has become a challenging issue that urgently needs to be addressed in clinical practice. In recent years, the rapid development of artificial intelligence technology, especially deep learning (DL) technology, has brought a revolutionary driving force to medical diagnosis and treatment. This article aims to review the current application of DL in the diagnosis and treatment of TMD, discuss the challenges faced, and provide prospects for future development, in order to have a deeper understanding and reflection on the application of DL in the diagnosis and treatment of TMD.

The Internet of Things (IoT) continues to attract attention in the context of computational resource growth. Various disciplines and fields have begun to employ IoT integration technologies in order to enable smart applications. The main difficulty in supporting industrial development in this scenario involves potential risk or malicious activities occurring in the network. However, there are tensions that are difficult to overcome at this stage in the development of IoT technology. In this situation, the future of security architecture development will involve enabling automatic and smart protection systems. Due to the vulnerability of current IoT devices, it is insufficient to ensure system security by implementing only traditional security tools such as encryption and access control. Deep learning and blockchain technology has now become crucial, as it provides distinct and secure approaches to IoT network security. The aim of this survey paper is to elaborate on the application of deep learning and blockchain technology in the IoT to ensure secure utility. We first provide an introduction to the IoT, deep learning, and blockchain technology, as well as a discussion of their respective security features. We then outline the main obstacles and problems of trusted IoT and how blockchain and deep learning may be able to help. Next, we present the future challenges in integrating deep learning and blockchain technology into the IoT. Finally, as a demonstration of the value of blockchain in establishing trust, we provide a comparison between conventional trust management methods and those based on blockchain.

The healthcare system is transforming as a result of new technology invention and implementation, which promotes therapeutic interventions and treatment outcomes for improved patient care. Numerous diverse parameters like gene variation, sociodemographics, lifestyle/environmental elements, should be measured to expedite precision/personalized medicine (PM). As a result, one of the most important difficulties in PM is bridging the translational gap in the clinical context by transforming big, multimodal data into decision support tools. Deep learning (DL) offers a novel technique to overcome these challenges, enabling the building or acquisition of accuracy, multimodal predictive models that could help the PM vision become a reality shortly. DL along with modern artificial intelligence (AI), in particular, provides tools in the form of algorithms that could pave the way for an individualized malignancy treatment in a more precise and customized manner by allowing early diagnosis and precise treatment options. Machine learning (ML) techniques applied to genomic datasets have a lot of potentials to deliver PM. DL has the power to accurately analyze tumor data and recommend the best possible treatment for cancer patients with a personalized approach. The capacity to anticipate how a patient will respond to a medication using DL techniques will aid in the reevaluation of treatment decisions, as well as the reduction of errors and disease-related financial burden. This chapter discusses the overall characteristics of DL and PM, as well as the importance of DL in precision oncology drug discovery and development, genomics, and biomarker datasets. It also outlines the potential of different technologies of DL in cancer diagnosis, detection, and prediction. It also highlights the applications of DL in translational oncology and its clinical benefits. Various challenges and limitations associated with DL techniques, such as like unique genomic patterns, small sample size, multidisciplinary expertise, and clinical trials, are also addressed.

Plant disease can seriously affect the growth and development of plants, resulting in reduced production and even death. Disease control can assist in plant breeding and cultivation, ensuring crop yield and quality. But traditional disease control methods are increasingly difficult to meet modern time, space and cost requirements. Deep learning technology has developed rapidly in recent years; it can improve the efficiency of plant disease diagnosis and detection, and greatly reduce the risk of human intervention and misjudgment. However, challenges such as data acquisition, environmental interference, and model deployment complexity hinder the application of deep learning in plant disease control. Therefore, there is an urgent need for disease feature optimization algorithms to protect current large-scale agricultural production.This research topic provides a platform for sharing the latest research results of deep learning in control of plant disease. The focus on the progress of deep learning technology in this field mainly involves the application of advanced technology in plant disease feature adaptation. This research topic aims to explore the latest research and application of deep learning technology in plant disease identification and control, focusing on: 1) identification techniques for early plant disease, 2) prediction and prevention of the spread of plant disease, 3) new methods for collecting multi-source plant disease image data, 4) quantitative evaluation of plant damage, 5) real-time application deployment based on embedded devices and edge wearable devices, 6) adaptive image processing methods for different application environments.A study by Le Yang et al. explored a new maize weed recognition model, SE-VGG16, and applied the SE-VGG16 model to weed detection of other species to build a weed detection model with the ability to generalize weed control in agricultural production processes. SE-VGG16 model is based on VGG16, adding SE attention mechanism. The model implements automatic focusing and allocates limited information processing resources to important parts. It has the characteristics of high efficiency, stability and high detection accuracy.Pushkar Gole et al. focused on lightweight visual converter networks in a study of automatic plant disease recognition. This study mainly introduces two tasks: one is to replace a multilayer perceptron (MLP) with the initial module and reconstruct the transformer Inception module to reduce the computational complexity of the vision transformer (ViT) model. In addition, the proposed new network is trained and tested on the PlantVillage dataset and the field maize image dataset, which proves its applicability in real scenarios.Further, Xin Xu et al. studied a cotton moth infestation monitoring method. In this study, five different models of cotton aphid infestation identification were constructed, trained and tested, among which YOLOv5 model had the best performance. The real-time identification system established in this study can provide a faster and more convenient technical means for the monitoring of cotton aphid infection.In another article, Nak Jung Choi et al. focused on identifying and tracking the behavior, movement, size, and habits of different species of insects by building a 3D monitoring system. While traditional 2D monitoring systems are static and ignore Zaxis depth dimensions, 3D systems are able to track insect movement more comprehensively, providing valuable depth dimension insights.Another study by Jitong Cai et al., explored a lightweight CNN model, FCA-EfficientNet, to achieve accurate identification of multiple maize disease. The work introduced autofocus modules and FCA modules to filter out background noise, allowing the network to focus on disease areas. It also makes the model more lightweight by removing redundant network structures.In addition, Fei Nan et al. studied the classification of maize disease from another angle. They focused on a deep convolutional neural network with RGB-D images. Among them, a variety of improved data preprocessing methods improved the accuracy and speed of maize diseases image recognition.A study by Zhenghang Zhang et al. explored the potential of applying Generative Adversarial Networks (GANs) to the diagnosis of cotton fusarium wilt. This study designed a model based on small sample learning and proposed an innovative cotton verticillium wilt diagnosis system. The convolutional neural network is used as feature extractor, and the trained GANs model is used for sample enhancement to improve the classification accuracy.In summary, these findings highlight the significant advances that deep learning technology has made in identifying and controlling plant disease in the information age. In the future, these models can be deployed in smart agriculture systems to monitor and identify plant disease in real time, so that appropriate control measures can be taken in a timely manner. As deep learning technology continues to evolve and improve, we can expect these models to play an increasingly important role in plant disease control, providing more effective support for agricultural production.

Nowadays, machine learning (ML) has attained a high level of achievement in many contexts. Considering the significance of ML in medical and bioinformatics owing to its accuracy, many investigators discussed multiple solutions for developing the function of medical and bioinformatics challenges using deep learning (DL) techniques. The importance of DL in Internet of Things (IoT)-based bio- and medical informatics lies in its ability to analyze and interpret large amounts of complex and diverse data in real time, providing insights that can improve healthcare outcomes and increase efficiency in the healthcare industry. Several applications of DL in IoT-based bio- and medical informatics include diagnosis, treatment recommendation, clinical decision support, image analysis, wearable monitoring, and drug discovery. The review aims to comprehensively evaluate and synthesize the existing body of the literature on applying deep learning in the intersection of the IoT with bio- and medical informatics. In this paper, we categorized the most cutting-edge DL solutions for medical and bioinformatics issues into five categories based on the DL technique utilized: convolutional neural network, recurrent neural network, generative adversarial network, multilayer perception, and hybrid methods. A systematic literature review was applied to study each one in terms of effective properties, like the main idea, benefits, drawbacks, methods, simulation environment, and datasets. After that, cutting-edge research on DL approaches and applications for bioinformatics concerns was emphasized. In addition, several challenges that contributed to DL implementation for medical and bioinformatics have been addressed, which are predicted to motivate more studies to develop medical and bioinformatics research progressively. According to the findings, most articles are evaluated using features like accuracy, sensitivity, specificity, F-score, latency, adaptability, and scalability.

Breast cancer is the most common malignant tumor among women worldwide and remains one of the leading causes of death among women. Its incidence and mortality rates are continuously rising. In recent years, with the rapid advancement of deep learning (DL) technology, DL has demonstrated significant potential in breast cancer diagnosis, prognosis evaluation, and treatment response prediction. This paper reviews relevant research progress and applies DL models to image enhancement, segmentation, and classification based on large-scale datasets from TCGA and multiple centers. We employed foundational models such as ResNet50, Transformer, and Hover-net to investigate the performance of DL models in breast cancer diagnosis, treatment, and prognosis prediction. The results indicate that DL techniques have significantly improved diagnostic accuracy and efficiency, particularly in predicting breast cancer metastasis and clinical prognosis. Furthermore, the study emphasizes the crucial role of robust databases in developing highly generalizable models. Future research will focus on addressing challenges related to data management, model interpretability, and regulatory compliance, ultimately aiming to provide more precise clinical treatment and prognostic evaluation programs for breast cancer patients.

This review examines the recent developments in deep learning (DL) techniques applied to multimodal fusion image segmentation for liver cancer. Hepatocellular carcinoma is a highly dangerous malignant tumor that requires accurate image segmentation for effective treatment and disease monitoring. Multimodal image fusion has the potential to offer more comprehensive information and more precise segmentation, and DL techniques have achieved remarkable progress in this domain. This paper starts with an introduction to liver cancer, then explains the preprocessing and fusion methods for multimodal images, then explores the application of DL methods in this area. Various DL architectures such as convolutional neural networks (CNN) and U-Net are discussed and their benefits in multimodal image fusion segmentation. Furthermore, various evaluation metrics and datasets currently used to measure the performance of segmentation models are reviewed. While reviewing the progress, the challenges of current research, such as data imbalance, model generalization, and model interpretability, are emphasized and future research directions are suggested. The application of DL in multimodal image segmentation for liver cancer is transforming the field of medical imaging and is expected to further enhance the accuracy and efficiency of clinical decision making. This review provides useful insights and guidance for medical practitioners.

Abstract: The size of the medical information system is growing gradually. Due to this, traditional data analysis for extracting helpful information for any disease has become inefficient in providing accurate real-time valid information. Traditional data mining and statistical learning techniques, which lack sufficient domain knowledge on a complicatedly colossal amount of data, need to stop adopting new advances in deep learning technologies. Thus, the use of sophisticated machines with in-depth understanding and analysis capability is vital to provide real-time information in detecting and diagnosing diseases in the healthcare system. In this paper, we study recent deep learning approaches which are capable of working on high-dimensional and multi-dimensional data. These approaches have been deployed to identify the root cause of various diseases like Cancer, Lung Diseases, Heart Diseases, Diabetes, Hepatitis, Alzheimer’s, Dengue, Parkinson’s, etc. : In this study, our key contributions are: 1: A decent overview of the deep learning techniques. 2: Several modalities in the diagnosis of various diseases. 3: Set out recent trends in various applications of deep learning in healthcare, some of which are analysis and diagnosis of medical images, precision medicine, drug discovery, predictive analysis to support clinical decisions, and sustainable public health. 4: Several deep learning approaches with their performance are described in detail. 5: Although deep learning has achieved notable performance in detecting AD, there are several limitations, especially the availability of the patient’s data for training deep learning models on a particular disease is comparatively much less than required.

With the development of information and technology, especially with the boom in big data, healthcare support systems are becoming much better. Patient data can be collected, retrieved, and stored in real time. These data are valuable and meaningful for monitoring, diagnosing, and further applications in data analysis and decision-making. Essentially, the data can be divided into three types, namely, statistical, image-based, and sequential data. Each type has a different method of retrieval, processing, and deployment. Additionally, the application of machine learning (ML) and deep learning (DL) in healthcare support systems is growing more rapidly than ever. Numerous high-performance architectures are proposed to optimize decision-making. As reliability and stability are the most important factors in the healthcare support system, enhancing the predicted performance and maintaining the stability of the model are always the top priority. The main idea of our study comes from ensemble techniques. Numerous studies and data science competitions show that by combining several weak models into one, ensemble models can attain outstanding performance and reliability. We propose three deep ensemble learning (DEL) approaches, each with stable and reliable performance, that are workable on the above-mentioned data types. These are deep-stacked generalization ensemble learning, gradient deep learning boosting, and deep aggregation learning. The experiment results show that our proposed approaches achieve more vigorous and reliable performance than traditional ML and DL techniques on statistical, image-based, and sequential benchmark datasets. In particular, on the Heart Disease UCI dataset, representing the statistical type, the gradient deep learning boosting approach dominates the others with accuracy, recall, F1-score, Matthews correlation coefficient, and area under the curve values of 0.87, 0.81, 0.83, 0.73, and 0.91, respectively. On the X-ray dataset, representing the image-based type, the deep aggregation learning approach shows the highest performance with values of 0.91, 0.97, 0.93, 0.80, and 0.94, respectively. On the Depresjon dataset, representing the sequence type, the deep-stacked generalization ensemble learning approach outperforms the others with values of 0.91, 0.84, 0.86, 0.8, and 0.94, respectively. Overall, we conclude that applying DL models using our proposed approaches is a promising method for the healthcare support system to enhance prediction and diagnosis performance. Furthermore, our study reveals that these approaches are flexible and easy to apply to achieve optimal performance.

Deep learning has been successfully explored in addressing different multimedia topics recent years, ranging from object detection, semantic classification, entity annotation, to multimedia captioning, multimedia question answering and storytelling. Open source libraries and platforms such as Tensorflow, Caffe, MXnet significantly help promote the wide deployment of deep learning in solving real-world applications. On one hand, deep learning practitioners, while not necessary to understand the involved math behind, are able to set up and make use of a complex deep network. One recent deep learning tool based on Keras even provides the graphical interface to enable straightforward 'drag and drop' operation for deep learning programming. On the other hand, however, some general theoretical problems of learning such as the interpretation and generalization, have only achieved limited progress. Most deep learning papers published these days follow the pipeline of designing/modifying network structures - tuning parameters - reporting performance improvement in specific applications. We have even seen many deep learning application papers without one single equation. Theoretical interpretation and the science behind the study are largely ignored. While excited about the successful application of deep learning in classical and novel problems, we multimedia researchers are responsible to think and solve the fundamental topics in deep learning science. Prof. Guanrong Chen recently wrote an editorial note titled 'Science and Technology, not SciTech' [1]. This panel falls into similar discussion and aims to invite prestigious multimedia researchers and active deep learning practitioners to discuss the positioning of deep learning research now and in the future. Specifically, each panelist is asked to present their opinions on the following five questions: 1)How do you think the current phenomenon that deep learning applications are explosively growing, while the general theoretical problems remain slow progress? 2)Do you agree that deployment of deep learning techniques is getting easy (with a low barrier), while deep learning research is difficult (with a high barrier) 3)What do you think are the core problems for deep learning techniques? 4)What do you think are the core problems for deep learning science? 5)What's your suggestion on the multimedia research in the post-deep learning era?

Coastal aquifers are vital for sustaining ecosystems and providing freshwater for agriculture and domestic use. However, rising groundwater salinity in these regions demands innovative approaches for accurate modeling and prediction. In recent decades, machine learning (ML) and deep learning (DL) techniques have been extensively used across various water resource management fields, often yielding promising outcomes. This review examines the growing usage of ML and DL techniques in modeling groundwater salinity in coastal aquifers. The analysis is based on 104 peer-reviewed journal articles including the review articles indexed in PubMed, ScienceDirect, Google Scholar, Scopus, and SpringerLink using keywords like "saltwater intrusion", "machine learning", “deep learning”, and "groundwater salinity". The review discusses recent advancements, challenges, and future directions for improving ML model accuracy and applicability. Studies reveal an increasing reliance on ML techniques to predict groundwater salinity and manage seawater intrusion across various coastal geological settings. Researchers have employed a range of ML models, from traditional methods like Artificial Neural Networks and Adaptive Neuro Fuzzy Inference Systems to advanced DL-based models like Convolutional Neural Networks and Long Short-Term Memory Networks, often using ensemble methods to enhance accuracy. Key findings include the top-tier output of ensemble and optimized models, including Random Forest and Grasshopper Optimization Algorithm-XGBoost. These studies highlight the importance of model selection, input variable ranking, and computational efficiency, demonstrating ML's global relevance in environmental management. The review highlights the prospects of ML, DL, and ensemble models to redefine groundwater management in coastal aquifers, offering more effective and sustainable solutions to the challenges posed by groundwater salinity and saltwater intrusion. Future advancements will focus on further integrating DL, explainable artificial intelligence, and ensemble approaches, along with other innovative techniques, to explore sparsely studied variables, model new or unique study areas, and apply ML methods for managing groundwater salinity.

Millions of people worldwide suffer from Parkinson’s disease (PD), a neurodegenerative disorder marked by motor symptoms such as tremors, bradykinesia, and stiffness. Accurate early diagnosis is crucial for effective management and treatment. This article presents a novel review of Machine Learning (ML) and Deep Learning (DL) techniques for PD detection and progression monitoring, offering new perspectives by integrating diverse data sources. We examine the public datasets recently used in studies, including audio recordings, gait analysis, and medical imaging. We discuss the preprocessing methods applied, the state-of-the-art models utilized, and their performance. Our evaluation included different algorithms such as support vector machines (SVM), random forests (RF), convolutional neural networks (CNN). These algorithms have shown promising results in PD diagnosis with accuracy rates exceeding 99% in some studies combining data sources. Our analysis particularly showcases the effectiveness of audio analysis in early symptom detection and gait analysis, including the Unified Parkinson’s Disease Rating Scale (UPDRS), in monitoring disease progression. Medical imaging, enhanced by DL techniques, has improved the identification of PD. The application of ML and DL in PD research offers significant potential for improving diagnostic accuracy. However, challenges like the need for large and diverse datasets, data privacy concerns, and data quality in healthcare remain. Additionally, developing explainable AI is crucial to ensure that clinicians can trust and understand ML and DL models. Our review highlights these key challenges that must be addressed to enhance the robustness and applicability of AI models in PD diagnosis, setting the groundwork for future research to overcome these obstacles.

In the medical field, accurate diagnosis of lung cancer is crucial for treatment. Traditional manual analysis methods have significant limitations in terms of accuracy and efficiency. To address this issue, this paper proposes a deep learning network framework based on the pre-trained MobileNetV2 model, initialized with weights from the ImageNet-1K dataset (version 2). The last layer of the model (the fully connected layer) is replaced with a new fully connected layer, and a softmax activation function is added to efficiently classify three types of lung cancer CT scan images. Experimental results show that the model achieves an accuracy of 95.2% on the test set, with significant improvements in feature extraction compared to traditional models. With the rapid development of artificial intelligence technologies, deep learning applications in medical image processing are bringing revolutionary changes to the healthcare industry. AI-based lung cancer detection systems can significantly improve diagnostic efficiency, reduce the workload of doctors, and occupy an important position in the global healthcare market. The potential of AI to improve diagnostic accuracy, reduce medical costs, and promote precision medicine will have a profound impact on the future development of the healthcare industry.

Improving lithofacies prediction in lacustrine shale by combining deep learning and well log curve morphology in Sanzhao Sag, Songliao Basin, China