Performance Evaluation of Convolutional Neural Network (CNN) for Skin Cancer Detection on Edge Computing Devices

BackgroundIt is difficult for orthodontists to accurately predict the growth trend of the mandible in children with anterior crossbite. This study aims to develop a deep learning model to automatically predict the mandibular growth result into normal or overdeveloped using cephalometric radiographs.MethodsA deep convolutional neural network (CNN) model was constructed based on the algorithm ResNet50 and trained on the basis of 256 cephalometric radiographs. The prediction behavior of the model was tested on 40 cephalograms and visualized by equipped with Grad-CAM. The prediction performance of the CNN model was compared with that of three junior orthodontists.ResultsThe deep-learning model showed a good prediction accuracy about 85%, much higher when compared with the 54.2% of the junior orthodontists. The sensitivity and specificity of the model was 0.95 and 0.75 respectively, higher than that of the junior orthodontists (0.62 and 0.47 respectively). The area under the curve value of the deep-learning model was 0.9775. Visual inspection showed that the model mainly focused on the characteristics of special regions including chin, lower edge of the mandible, incisor teeth, airway and condyle to conduct the prediction.ConclusionsThe deep-learning CNN model could predict the growth trend of the mandible in anterior crossbite children with relatively high accuracy using cephalometric images. The deep learning model made the prediction decision mainly by identifying the characteristics of the regions of chin, lower edge of the mandible, incisor teeth area, airway and condyle in cephalometric images.

The widespread adoption of additive manufacturing (AM), also known as 3D printing, highlights the importance of maintaining stringent quality standards in 3D-printed parts. This work introduces an innovative approach integrating Industry 4.0 with AM, focusing on harnessing the Internet of Things (IoT) for feedback control to swiftly detect defects. Operating within the framework of AM as a service (AMaaS), the system efficiently manages multiple 3D printers to meet client demands. Utilizing Raspberry Pi (RPi) and advanced Python socket modules, a user-friendly graphical interface (GUI) enriched with live video streams enhances user interaction. Clients can securely upload STL files over the Internet, accessing the system via robust authentication mechanisms. Live video feeds from RPi high-quality (HQ) cameras offer real-time insights into the printing process, while a deep learning (DL)-based convolutional neural network (CNN) model accurately detects warpage defects. Trained on images captured by RPi cameras, the CNN model’s performance metrics are systematically explored. This research integrates Industry 4.0 principles with 3D printing, advancing AMaaS with proactive quality control and live monitoring, showcasing innovative DL-based defect detection. The framework contributes to smart AM practices, promising widespread applicability across industries.

Various Internet solutions take their power processing and analysis from cloud computing services. Internet of Things (IoT) applications started discovering the benefits of computing, processing, and analysis on the device itself aiming to reduce latency for time-critical applications. However, on-device processing is not suitable for resource-constraints IoT devices. Edge computing (EC) came as an alternative solution that tends to move services and computation more closer to consumers, at the edge. In this letter, we study and discuss the applicability of merging deep learning (DL) models, i.e., convolutional neural network (CNN), recurrent neural network (RNN), and reinforcement learning (RL), with IoT and information-centric networking which is a promising future Internet architecture, combined all together with the EC concept. Therefore, a CNN model can be used in the IoT area to exploit reliably data from a complex environment. Moreover, RL and RNN have been recently integrated into IoT, which can be used to take the multi-modality of data in real-time applications into account.

Destructive cyber-attacks and cybercriminals are increasing with the increase in IoT (Internet of Things) devices globally. This ha/s led to the need for increase in security in IoT systems. Innovative and novel techniques are used by the intruders to accomplish malicious goals effectively through cyber-attacks. An Intrusion Detection System (IDS) is used for classification of attacks in IoT networks based on anomaly detection and machine learning techniques. Inefficiency is observed in the conventional machine learning models and intrusion detection techniques as the network technologies are unpredictable. Accurate identification of various anomalies is possible with deep learning models in several research segments. The input data along with its prominent characteristics may be categorized automatically for classification and anomaly detection using convolutional neural networks (CNN). Faster computations are enabled due to the performance efficiency of CNN. For IoT networks, an intrusion detection model based on anomaly detection is designed and developed in this paper. A multiclass classification framework is created initially using a CNN model. Further, 3D CNN is used for implementation of the proposed model. Various intrusion detection datasets from IoT networks are used for validation of the proposed CNN model. Pre-trained multiclass CNN model is used for implementation of multiclass and binary classification based on transfer learning. When compared to the conventional deep learning models, the proposed multiclass and binary classification framework has attained improved F1 score, recall, precision and accuracy.

Excessive withdrawal of groundwater for agricultural irrigation can cause seawater intrusion into coastal aquifers. Such a case will in turn results in deterioration of irrigation water quality. Determination of irrigation water quality with traditional methods is a time-consuming and costly process. However, machine learning algorithms can be useful tools for modeling and estimating groundwater quality used for irrigation water purposes. In this study, TDS, PS, SAR, and Cl parameters of groundwater were estimated with models based on EC and pH variables. For this purpose, prediction performances of two different deep learning methods (convolutional neural network (CNN) and deep neural network (DNN)) and two different classical machine learning (Random Forest (RF) and extreme gradient boosting (XGBoost)) methods were compared. In addition, predictive uncertainty of the models was determined by quantile regression (QR) analysis. Performance criteria and results of uncertainty analysis revealed that CNN (in testing phase, NSE = 0.95 for TDS, NSE = 0.96 for PS, NSE = 0.67 for SAR and NSE = 0.93 for CI) and DNN (in testing phase, NSE = 0.91 for TDS, NSE = 0.91 for PS, NSE = 0.57 for SAR and NSE = 0.94 for Cl) models had quite a close performance in estimation of TDS, PS, SAR, and Cl parameters and higher than the other two classical machine learning methods. As a result, the CNN model can be considered the best performing model in estimating all quality parameters due to the highest NSE and lowest RMSE values. In addition, the Taylor diagram showed that the values estimated using the CNN model had the highest correlation with the measured data. It was determined that the model with the lowest uncertainty based on the PICP statistics was DNN, followed by the CNN model. However, the CNN model has predicted outliers more accurately. Present findings proved that deep learning models could offer efficient tools for predicting irrigation water quality parameters.

Due to the continuous growth and advancement of technology, an enormous volume of text data is generated daily across various sources including social media platforms, websites, search engines, healthcare records, and news articles. Extracting meaningful patterns from text data, such as viewpoints, related theories, journal distribution, facts, and the development of online news text, is a challenging task due to the varying lengths of the texts. One issue arises from the length of the text data itself, and another challenge lies in extracting valuable features, especially in news articles. In the deep learning models, the convolutional neural networks (CNNs) are capable of capturing local features in text data, but unable to capture the structural information or semantic relationships between words. Consequently, a sole CNN network often yields poor performance in text classification tasks, whereas the Gated Recurrent Unit (GRU) is adept at effectively extracting semantic information and understanding the global structural relationships present in textual data. This paper presents a solution to the problem by introducing a new text classification that integrates the strengths of CNN and GRU. The proposed hybrid models incorporate word vectorization and word dispersion in parallel. Initially, the model trains word vectors using the Word2vec model and then leverages the GRU model to capture semantic information from text sentences. Subsequently, the CNN method is employed to capture crucial semantic features, leading to classification using the SoftMax layer. Experimental findings demonstrated that the proposed hybrid GRU_CNN model outperformed and achieved accuracy 97.73% as compared to individual CNN, LSTM, and GRU models in terms of classification effectiveness and accuracy.

Bone cancer is a significant health issue that leads to severe complications and deaths worldwide. Early detection can significantly improve patient outcomes, often resulting in a complete cure. Traditional approaches to managing bone cancer can be augmented with technology-driven methods, particularly those enabled by artificial intelligence. Convolutional Neural Networks (CNNs) and their variants have proven effective in medical data analysis. However, deep learning techniques require enhancements to improve performance in cancer detection across various medical imaging modalities. In this paper, we propose a deep-learning framework that utilizes advanced CNN models for the automatic screening of bone cancer. We have enhanced both the CNN model and the ResNet-50 model, which are integral components of the proposed framework. Additionally, we introduced an algorithm called Learning-based Bone Cancer Detection (LbBCD), designed to optimize the utilization of these enhanced deep learning models to improve bone cancer detection efficiency. Our research emphasizes a Region of Interest (ROI) based approach to enhance the screening process for bone cancer. Using a benchmark dataset known as the Bone CT Scan dataset, our empirical study demonstrated that the proposed deep learning framework, integrated with enhanced CNN and ResNet-50 models, achieved remarkable performance. Specifically, the enhanced CNN model reached an accuracy of 90.90%, while the enhanced ResNet-50 model achieved an accuracy of 92.20%, outperforming state-of-the-art deep learning models. Therefore, this proposed system can be integrated into healthcare applications for automatically screening bone cancer, contributing to a clinical decision support system for healthcare professionals.

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

Understanding the learning mechanism of convolutional neural networks in spectral analysis

Emotions expressed by humans can be identified from facial expressions, speech signals, or physiological signals. Among them, the use of physiological signals for emotion classification is a notable emerging area of research. In emotion recognition, a person’s electrocardiogram (ECG) and galvanic skin response (GSR) signals cannot be manipulated, unlike facial and voice signals. Moreover, wearables such as smartwatches and wristbands enable the detection of emotions in people’s naturalistic environment. During the COVID-19 pandemic, it was necessary to detect people’s emotions in order to ensure that appropriate actions were taken according to the prevailing situation and achieve societal balance. Experimentally, the duration of the emotion stimulus period and the social and non-social contexts of participants influence the emotion classification process. Hence, classification of emotions when participants are exposed to the elicitation process for a longer duration and taking into consideration the social context needs to be explored. This work explores the classification of emotions using five pretrained convolutional neural network (CNN) models: MobileNet, NASNetMobile, DenseNet 201, InceptionResnetV2, and EfficientNetB7. The continuous wavelet transform (CWT) coefficients were detected from ECG and GSR recordings from the AMIGOS database with suitable filtering. Scalograms of the sum of frequency coefficients versus time were obtained and converted into images. Emotions were classified using the pre-trained CNN models. The valence and arousal emotion classification accuracy obtained using ECG and GSR data were, respectively, 91.27% and 91.45% using the InceptionResnetV2 CNN classifier and 99.19% and 98.39% using the MobileNet CNN classifier. Other studies have not explored the use of scalograms to represent ECG and GSR CWT features for emotion classification using deep learning models. Additionally, this study provides a novel classification of emotions built on individual and group settings using ECG data. When the participants watched long-duration emotion elicitation videos individually and in groups, the accuracy was around 99.8%. MobileNet had the highest accuracy and shortest execution time. These subject-independent classification methods enable emotion classification independent of varying human behavior.

Among the many deep learning methods, the convolutional neural network (CNN) model has an excellent performance in image recognition. Research on identifying and classifying image datasets using CNN is ongoing. Animal species recognition and classification with CNN is expected to be helpful for various applications. However, sophisticated feature recognition is essential to classify quasi-species with similar features, such as the quasi-species of parrots that have a high color similarity. The purpose of this study is to develop a vision-based mobile application to classify endangered parrot species using an advanced CNN model based on transfer learning (some parrots have quite similar colors and shapes). We acquired the images in two ways: collecting them directly from the Seoul Grand Park Zoo and crawling them using the Google search. Subsequently, we have built advanced CNN models with transfer learning and trained them using the data. Next, we converted one of the fully trained models into a file for execution on mobile devices and created the Android package files. The accuracy was measured for each of the eight CNN models. The overall accuracy for the camera of the mobile device was 94.125%. For certain species, the accuracy of recognition was 100%, with the required time of only 455 ms. Our approach helps to recognize the species in real time using the camera of the mobile device. Applications will be helpful for the prevention of smuggling of endangered species in the customs clearance area.

Accurately identifying epileptogenic zone (EZ) using high-frequency oscillations (HFOs) is a challenge that must be mastered to transfer HFOs into clinical use. We analyzed the ability of a convolutional neural network (CNN) model to distinguish EZ and non-EZ HFOs. Nineteen medically intractable epilepsy patients with good surgical outcomes 2 years after surgery were studied. Five-minute interictal intracranial electroencephalogram epochs of slow-wave sleep were selected randomly. Then 5 s segments of ripples (80–200 Hz) and fast ripples (FRs, 200–500 Hz) were detected automatically. The EZs and non-EZs were identified using the surgery resection range. We innovatively converted all epochs into four types of images using two scales: original waveforms, filtered waveforms, wavelet spectrum images, and smoothed pseudo Wigner–Ville distribution (SPWVD) spectrum images. Two scales were fixed and fitted scales. We then used a CNN model to classify the HFOs into EZ and non-EZ categories. As a result, 7,000 epochs of ripples and 2,000 epochs of FRs were randomly selected from the EZ and non-EZ data for analysis. Our CNN model can distinguish EZ and non-EZ HFOs successfully. Except for original ripple waveforms, the results from CNN models that are trained using fixed-scale images are significantly better than those from models trained using fitted-scale images (p < 0.05). Of the four fixed-scale transformations, the CNN based on the adjusted SPWVD (ASPWVD) produced the best accuracies (80.89 ± 1.43% and 77.85 ± 1.61% for ripples and FRs, respectively, p < 0.05). The CNN using ASPWVD transformation images is an effective deep learning method that can be used to classify EZ and non-EZ HFOs.

I. ABSTRACT Fire hazards pose a significant threat to life and property, making early detection crucial for minimizing damage. This project focuses on AI-based fire detection and alarming using computer vision and deep learning techniques. The system employs CCTV cameras or laptop cameras to capture real-time video feeds, which are analysed using Python, OpenCV, and deep learning models to detect fire accurately. A Convolutional Neural Network (CNN) or YOLO (You Only Look Once) object detection model is trained on fire datasets to distinguish fire from non-fire scenarios, reducing false alarms. Once fire is detected, the system triggers an alarm sound and can also send notifications via SMS, email, or IoT-based alerts to concerned authorities. This AI-powered solution is designed for high accuracy and efficiency, making it suitable for smart surveillance, industrial safety, and residential fire monitoring. The integration of edge computing devices like Raspberry Pi or Jetson Nano can further enhance real-time processing. The proposed system aims to improve fire safety measures by providing automated, real-time fire detection, reducing response time, and preventing large-scale disasters. II. KEYWORDS Fire Detection, Real-time Fire Monitoring, Computer Vision (CV).

Deep learning models for short-term travel speed prediction on urban expressways, such as the convolutional neural network (CNN), still present several limitations in multiscale spatiotemporal feature extraction. Hence, in this paper, three hybrid CNN models are proposed to improve the basic CNN model with regard to three target aspects for short-term (i.e., 5 min) travel speed prediction on urban expressways. More specifically, long short-term memory (LSTM), AutoEncoder (AE), and Inception module are incorporated into the basic CNN model to capture multiscale spatiotemporal features of travel speed data effectively and improve the accuracy and robustness of the basic CNN model. Based on loop detector data collected on the Yan&#x2019;an expressway in Shanghai, the proposed hybrid CNN models are trained and tuned. To validate the improvements on the target aspects, a comprehensive comparison is conducted using a classical statistical model (i.e., autoregressive integrated moving average), a typical shallow neural network model (i.e., artificial neural network), and two basic deep learning models (i.e., recurrent neural network and CNN). Results show that the prediction accuracies of all the proposed hybrid CNN models exceed 96&#x0025; and the mean absolute errors are less than 2.5 km/h, which are superior to other models. In terms of target improving aspects, two new metrics were introduced, and the proposed models, especially the AE&#x2013;CNN model, showed better robustness under various input data structures and traffic states. The LSTM&#x2013;CNN model outperformed the other models in learning time-series features, and the Inception&#x2013;CNN model is superior in reproducing the dynamics of traffic congestion patterns on urban expressways.

The performance of convolutional neural networks (CNNs) in image classification and object detection has been remarkable, even though they contain millions and billions of parameters. This over‐parameterization of CNN makes them both memory‐intensive and computationally complex and exhaustive. This greatly hinders the application of CNNs in resource‐constrained environments such as Internet of things (IoT) and edge devices. This poses a critical challenge for CNNs in deploying these powerful computer vision tools to mobile devices, which needs immediate attention. In this study, we have proposed a novel technique based on non‐convex optimization, max‐norm regularization. The max‐norm will structurally prune the number of parameters without compromising the model's performance. The proximal gradient descent algorithm is used for network optimization while using this non‐convex regularizer. The max‐norm is combined with the channel pruning to achieve more sparse CNN networks. Later, the pruned network can be easily deployed in the resource‐constrained application environment. The proposed technique is tested on several benchmark datasets for validation. In addition, in this study, the sparsified CNNs are used for biomedical image analysis using the BRAIN MRI dataset. This sparsely trained CNN model can later serve as the best lightweight model applicable in the IoT healthcare sector for detecting and classifying three types of brain tumours, one of the most life‐threatening diseases whose early detection can save the costly lives of human beings. This is the first paper to propose the novel max‐norm regularizer to enforce sparse learning through CNNs. The paper provides a detailed analysis of convex and non‐convex regularizers before presenting the proposed novel max‐norm regularizer. Finally, the paper compares the proposed max‐norm regularizer with existing regularization methods using state‐of‐the‐art CNN models.