An Intelligent Group Learning Framework for Detecting Common Tomato Diseases Using Simple and Weighted Majority Voting with Deep Learning Models

Identifying and detecting a plant disease is a primary challenge in the farming segment. Specifically, for tomato farming: Early Blight, Late Blight, Mosaic Virus, Target Spot, Yellow Leaf Curl Virus (YLCV), Bacterial Spot, Leaf mold, Septoria leaf spot and two-spotted spider mite are nine general diseases that severely affect the yield. In this work, we propose convolutional neural networks (CNNs) based deep learning (DL) model for the identification of tomato leaf diseases. In our study, we take the Tomato Leaf Disease Dataset (TLDD) consisting of 18,160 images of the infected and the healthy tomato leaves from PlantVillage. We first select the most suitable and accurate deep learning models for disease identification experiments. Four popular models viz. SqueezeNet, ResNet50, InceptionV3 and DenseNet are chosen for the analysis. Lastly, using ImageAI library on Google Colaboratory (Colab), we train all the four models on the collected tomato-leaf-image dataset to identify the presence of above mentioned nine common tomato leaf diseases. Results from our experiments on the comparative study of the selected deep learning models identify nine different tomato leaf diseases. We infer that the InceptionV3 model provides the highest accuracy of 99.64%. Our chosen model provides faster detection with higher accuracy as compared to the other models. In future work, we intend to modify the algorithm to develop our own model for disease identification for other crops as well.KeywordsDeep learningConvolutional neural networkTomato leaf diseaseImageAI

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. Among the research challenges on a global scale, the investigation of deep transfer learning (DTL) in the field of electricity load forecasting represents a fundamental effort that can inform artificial intelligence applications in general. In this paper, a comprehensive study is reported regarding day-ahead electricity load forecasting. For this purpose, three sequence-to-sequence (Seq2seq) deep learning (DL) models are used, namely the multilayer perceptron (MLP), the convolutional neural network (CNN) and the ensemble learning model (ELM), which consists of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL, emphasizing the way the datasets are trained and fine-tuned for higher forecasting accuracy. In order to implement the forecasting strategies using deep learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1–24 h) for each month of the year for the Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. Four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only the Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for the Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) involves the training of the DL models using the Lesvos dataset, and the testing period is performed directly on the Chios dataset without fine-tuning. The fourth strategy is a multi-task deep learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. The results obtained demonstrate that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, DTL Case 1 and 2 outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it is concluded that the MLP model presents the best monthly forecasts with MAPE values of 6.24% and 6.01% for the first two cases, the CNN model presents the best monthly forecasts with MAPE values of 5.57% and 5.60%, respectively, and the ELM model achieves the best monthly forecasts with MAPE values of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

Background: Tomatoes are extensively farmed as a vegetable or fruit in many regions of the country, and many forms of tomato pests and diseases are met over the whole life cycle of tomatoes; thus, early identification and diagnosis of these diseases is critical. The application of several deep learning approaches for identification of plant diseases has recently gained popularity, with encouraging results obtained for different diseases. Problem: The advancement of architectures based on Convolutional Neural Network (CNN) has considerably improved diagnostic accuracy of tomato diseases by using images of tomato leaves. The integration of CNN in the agricultural sector ensures an increased produce of tomato crop in a sustainable manner. However, complexity and performance time of CNN technique is a significant concern. Objective: In most deep learning models, all characteristics generated at various layers are given equal weighting. Significant characteristics should be learned and transferred to higher layers of the network for more exact classification. To improve the CNN performance, reuse and sharing of images (large dataset) is a great work required for tomato disease detection to get high accuracy. Methods: In this paper, we have presented a comprehensive review of twenty recent and notable works which employ CNN-based detection of tomato plant diseases. A comparative analysis of these works is given, taking accuracy as the metric. Results: A complete assessment of Bacterial Canker and Speck, Yellow Leaf Curl, Brown Rugose Fruit, Crown and Root Rot, Early Blight, Bunchy Top, Stolbur disease identification studies employing CNNs in this study. Conclusion: It is observed that CNN scan identify diseases with high accuracy when enough training data is provided. We anticipate that our study will be a useful resource for agricultural disease researchers employing technology for early disease diagnosis and management.

PurposeTo conduct a head-to-head comparison between deep learning (DL) and radiomics models across institutions for predicting microvascular invasion (MVI) in hepatocellular carcinoma (HCC) and to investigate the model robustness and generalizability through rigorous internal and external validation.MethodsThis retrospective study included 2304 preoperative images of 576 HCC lesions from two centers, with MVI status determined by postoperative histopathology. We developed DL and radiomics models for predicting the presence of MVI using B-mode ultrasound, contrast-enhanced ultrasound (CEUS) at the arterial, portal, and delayed phases, and a combined modality (B + CEUS). For radiomics, we constructed models with enlarged vs. original regions of interest (ROIs). A cross-validation approach was performed by training models on one center’s dataset and validating the other, and vice versa. This allowed assessment of the validity of different ultrasound modalities and the cross-center robustness of the models. The optimal model combined with alpha-fetoprotein (AFP) was also validated. The head-to-head comparison was based on the area under the receiver operating characteristic curve (AUC).ResultsThirteen DL models and 25 radiomics models using different ultrasound modalities were constructed and compared. B + CEUS was the optimal modality for both DL and radiomics models. The DL model achieved AUCs of 0.802–0.818 internally and 0.667–0.688 externally across the two centers, whereas radiomics achieved AUCs of 0.749–0.869 internally and 0.646–0.697 externally. The radiomics models showed overall improvement with enlarged ROIs (P < 0.05 for both CEUS and B + CEUS modalities). The DL models showed good cross-institutional robustness (P > 0.05 for all modalities, 1.6–2.1% differences in AUC for the optimal modality), whereas the radiomics models had relatively limited robustness across the two centers (12% drop-off in AUC for the optimal modality). Adding AFP improved the DL models (P < 0.05 externally) and well maintained the robustness, but did not benefit the radiomics model (P > 0.05).ConclusionCross-institutional validation indicated that DL demonstrated better robustness than radiomics for preoperative MVI prediction in patients with HCC, representing a promising solution to non-standardized ultrasound examination procedures.

We aimed at comparing intratumoral and peritumoral deep learning, radiomics, and fusion models in predicting KRAS mutations in rectal cancer using endorectal ultrasound imaging. This study included 304 patients with rectal cancer from Fujian Medical University Union Hospital. The patients were randomly divided into a training group (213 patients) and a test group (91 patients) at a 7:3 ratio. Radiomics and deep learning models were established using primary tumor and peritumoral images. In the optimally performing regions-of-interest, two fusion strategies, a feature-based and a decision-based model, were employed to build the fusion models. The Shapley additive explanation (SHAP) method was used to evaluate the significance of features in the optimal radiomics, deep learning, and fusion models. The performance of each model was assessed using the area under the receiver operating characteristic curve (AUC) and decision curve analysis (DCA). In the test cohort, both the radiomics and deep learning models exhibited optimal performance with a 10-pixel patch extension, yielding AUC values of 0.824 and 0.856, respectively. The feature-based DLRexpand10_FB model attained the highest AUC (0.896) across all study sets. In addition, the DLRexpand10_FB model demonstrated excellent sensitivity, specificity, and DCA. SHAP analysis underscored the deep learning feature (DL_1) as the most significant factor in the hybrid model. The feature-based fusion model DLRexpand10_FB can be employed to predict KRAS gene mutations based on pretreatment endorectal ultrasound images of rectal cancer. The integration of peritumoral regions enhanced the predictive performance of both the radiomics and deep learning models.

This study aimed to compare the axial cranial ultrasound images of normal and open neural tube defect (NTD) fetuses using a deep learning (DL) model and to assess its predictive accuracy in identifying open NTD.It was a prospective case-control study. Axial trans-thalamic fetal ultrasound images of participants with open fetal NTD and normal controls between 14 and 28 weeks of gestation were taken after consent. The images were divided into training, testing, and validation datasets randomly in the ratio of 70:15:15. The images were further processed and classified using DL convolutional neural network (CNN) transfer learning (TL) models. The TL models were trained for 50 epochs. The data was analyzed in terms of Cohen kappa score, accuracy score, area under receiver operating curve (AUROC) score, F1 score validity, sensitivity, and specificity of the test.A total of 59 cases and 116 controls were fully followed. Efficient net B0, Visual Geometry Group (VGG), and Inception V3 TL models were used. Both Efficient net B0 and VGG16 models gave similar high training and validation accuracy (100 and 95.83%, respectively). Using inception V3, the training and validation accuracy was 98.28 and 95.83%, respectively. The sensitivity and specificity of Efficient NetB0 was 100 and 89%, respectively, and was the best.The analysis of the changes in axial images of the fetal cranium using the DL model, Efficient Net B0 proved to be an effective model to be used in clinical application for the identification of open NTD. · Open spina bifida is often missed due to the nonrecognition of the lemon sign on ultrasound.. · Image classification using DL identified open spina bifida with excellent accuracy.. · The research is clinically relevant in low- and middle-income countries..

Deep learning breast cancer risk models demonstrate improved accuracy compared with traditional risk models but have not been prospectively tested. We compared the accuracy of a deep learning risk score derived from the patient's prior mammogram to traditional risk scores to prospectively identify patients with cancer in a cohort due for screening. We collected data on 119 139 bilateral screening mammograms in 57 617 consecutive patients screened at 5 facilities between September 18, 2017, and February 1, 2021. Patient demographics were retrieved from electronic medical records, cancer outcomes determined through regional tumor registry linkage, and comparisons made across risk models using Wilcoxon and Pearson χ2 2-sided tests. Deep learning, Tyrer-Cuzick, and National Cancer Institute Breast Cancer Risk Assessment Tool (NCI BCRAT) risk models were compared with respect to performance metrics and area under the receiver operating characteristic curves. Cancers detected per thousand patients screened were higher in patients at increased risk by the deep learning model (8.6, 95% confidence interval [CI] = 7.9 to 9.4) compared with Tyrer-Cuzick (4.4, 95% CI = 3.9 to 4.9) and NCI BCRAT (3.8, 95% CI = 3.3 to 4.3) models (P &lt; .001). Area under the receiver operating characteristic curves of the deep learning model (0.68, 95% CI = 0.66 to 0.70) was higher compared with Tyrer-Cuzick (0.57, 95% CI = 0.54 to 0.60) and NCI BCRAT (0.57, 95% CI = 0.54 to 0.60) models. Simulated screening of the top 50th percentile risk by the deep learning model captured statistically significantly more patients with cancer compared with Tyrer-Cuzick and NCI BCRAT models (P &lt; .001). A deep learning model to assess breast cancer risk can support feasible and effective risk-based screening and is superior to traditional models to identify patients destined to develop cancer in large screening cohorts.

To develop and evaluate static ultrasound images of ovaries-based radiomics and deep learning models for predicting antral follicle count (AFC) and anti-Müllerian hormone (AMH). A retrospective analysis was performed on 395 infertility patients who completed AFC through transvaginal ultrasonography and AMH test in two branches of the hospital. The data set was divided into training cohort (n = 210, Branch A), internal test cohort (n = 91, Branch A), and external test cohort (n = 94, Branch B). The AFC results of static ultrasound images (AFCstatic) and dynamic scan (AFCdynamic) were analysed for correlation and consistency. The radiomics, deep learning and combined models (Rad-DL model) were developed to quantitatively predict AFC and AMH respectively, and the ordered 3-class classification (AFCdynamic≤5,6≤AFCdynamic≤19 and 20≤AFCdynamic) prediction was further carried out. There was a high degree of correlation and consistency between AFCstatic and AFCdynamic in both branches. In the quantitative prediction of AFCdynamic, the R2 of the radiomics, deep learning and Rad-DL models in the external test cohort were 0.572, 0.541, 0.583, respectively. In the quantitative prediction of AMH, the R2 of the radiomics, deep learning and Rad-DL models in the external test cohort were 0.420, 0.352, 0.509, respectively. For the ordered 3-class classification prediction, the radiomics, deep learning and Rad-DL models demonstrated a good discrimination performance with overall AUCs of 0.816 (95%CI, 0.747–0.887), 0.843 (95%CI, 0.772–0.901), and 0.881 (95%CI, 0.816–0.931) in the external test cohort, respectively. Radiomics and deep learning models developed by using static ultrasound images of ovaries may quantitatively predict AFCdynamic to a certain extent, and accurately screen infertility patients with different ovarian reserve levels. This study lays the foundation for further break through the rigid antral follicle count and explore an intelligent non-invasive ovarian reserve evaluation method.

In distribution system state estimation (DSSE), the physics-based approach such as the weighted least squares (WLS) technique suffers from convergence issues, whereas the problem with conventional deep learning (DL) models is the lack of generalizability. To address these aspects, this paper proposes a physics-guided deep learning (PGDL) framework, which incorporates the power system physical laws into the deep learning models for DSSE. The proposed approach has two stages. The first stage leverages the DL models to understand the relation between the measurement data and system states, while the second stage involves physics-guided equations to decode the measurement data from the estimated states. Further, a loss function incorporating the estimated states and estimated measurements is derived to guide the learning process of the considered deep learning model. The required database for DL models is generated by carrying out power flow studies on a modified IEEE 37-node unbalanced distribution test system. Various deep learning models such as multi-layer perceptron (MLP), convolutional neural networks (CNN), and hybrid CNN-MLP are implemented in the proposed PGDL framework for DSSE and their performance metrics are evaluated and compared under different scenarios. The results show that the PGDL approaches achieve better performance compared with their conventional DL models and the basic WLS algorithm.

This paper takes the problems and ways of diversified curriculum construction of vocal music education in colleges and universities as the entry point and constructs a deep blended learning model of vocal music diversified curriculum based on the deep learning model. The deep evolutionary knowledge tracking model is constructed by combining the self-attention mechanism embedding model with vocal music knowledge evolution based on Transformer. To verify the effectiveness of the deep blended learning model constructed in this paper, model comparison experiments and empirical analysis were conducted. The results show that compared with the SAKT model, the DBL model in this paper has a 5.19% improvement in the average ROC-AUC value. The vocal posttest scores of the students in the experimental class were 5.09 points higher than those of the control class, with a two-tailed significance value of 0.027, which is less than 0.05 and a significant difference. This indicates that the deep learning model can effectively promote the innovative design of diversified curricula for vocal music education in colleges and universities and enhance students’ vocal music learning ability.

What's New in Spine Surgery.

To develop a deep learning (DL) model based on MRI to predict muscle-invasive bladder cancer (MIBC). A total of 559 patients, including 521 patients in our center and 38 patients in external centers were collected from 2012 to 2023 to construct the DL model. In this study, the DL model was utilized to differentiate between MIBC and NMIBC based on three-channel image inputs, including original T2WI images, segmented bladder, and regions of interest. Inception V3 was employed for model construction. The accuracy, sensitivity (SN), specificity (SP), positive predictive value (PPV) and negative predictive value (NPV) for predicting MIBC by DL model were 92.4%, 94.7%, 91.5%, 81.8% and 97.7% in the validation set and 92.1%, 86.8%, 94.6%, 88.5% and 93.8% in the internal test set. In the external test set, these values were 81.6%, 57.1%, 87.1%, 50.0% and 90.0%. Additionally, the accuracy, SN, SP, PPV, and NPV for predicting MIBC were 93.5%, 100%, 93.4%, 11.1%, and 100% in VI-RADS 2; 80.0%, 66.7%, 87.2%, 73.7% and 82.9% in VI-RADS 3; 90.3%, 91.7%, 85.7%, 95.7%, 75.0% in VI-RADS 4. The accuracy, SN, and PPV were 93.9%, 93.9%, and 100% in VI-RADS 5. The DL model based on T2WI can effectively predict MIBC and serve as a valuable complement to VI-RADS 3.

Early detection dramatically increases the survival rate of oral cancer (OC). Artificial intelligence (AI) technology has garnered more attention in the field of diagnostic medicine in present periods. This study set out to assess the available data regarding AI's efficacy in OC diagnosis critically. Artificial intelligence diagnostic accuracy and capacity to detect early phases of OC were highlighted. In this project, performance indicators will be measured and oral cancer will be divided and classified using intelligent computing techniques. The role of oral cancer classification and detection to achieve a high recognition rate while leveraging the best theoretical components of oral cancer images, a newly established region-based Convolutional Neural Network (RCNN-COA) and the Chimp Optimization Algorithm were used to improve a Deep Learning Method. Then, using the recommended Chimp Optimization Algorithm (COA), a region-based convolutional neural network (R-CNN) classifier was trained using the acquired theoretical properties and the innovative image. A comparison of many deep learning and machine learning models' performances has been reported in a study. The findings imply that the deep learning model is capable of managing the problematic task of early oral malignant tumor detection.

Leaves are one of the plant components that play a crucial role in plant productivity. Leaf disease in lemon plants can negatively impact both productivity and plant health. Therefore, a computer-based system for auto-matic classification was developed to efficiently and accurately identify dis-eases in lemon leaves. The automatic disease classification process in lemon leaves plays an important role for farmers, supporting timely and accurate decision-making. This study compared several deep learning and transformer models for disease classification of lemon leaves based on their images. The main objective of this study was to determine the performance of each deep learning and transformer architecture for disease classification in lemon leaves using image-based features. In evaluating various experiments, two deep learning models performed well: InceptionV3 and Xception, with accu-racies of 99.85% and 99.63%, respectively, and minimum loss values of 0.017% and 0.0018%, respectively. Then, the transformer model using the Vision Transformer architecture outperformed the two best deep learning models, achieving 99.89% accuracy and a loss of 0.0013. Overall, the experiment comparing the deep learning model and the transformer shows that the Vision Transformer outperforms the CNN. Consequently, the Vision Trans-former presents strong potential as an effective and robust approach for im-age-based leaf disease detection in lemon plants.