A robust video zero-watermarking based on deep convolutional neural network and self-organizing map in polar complex exponential transform domain

This paper contrasts the implementation of several chaos-based digital image watermarking techniques in terms of imperceptibility, robustness, security and complexity. Most spatial and transform domains methods have been used namely Least Significant Bit (LSB), Discrete Cosine Transform (DCT), Discrete Wavelet Transform (DWT) and Redundant Discrete Wavelet Transform (RDWT) with Singular Value Decomposition (SVD) mathematical tool which has enhanced embedding capability. Both continuous and discrete chaotic maps namely Arnold's Chaotic Map (ACM), Logistic Chaotic map (LCM) and Lorenz Chaotic Map (LoCM) are included to result in secure schemes. Exhaustive series of tests have been performed along with a range of evaluation metrics for imperceptibility evaluation. In addition, Robustness of all the techniques has also been confirmed by applying a variety of attacks on the resulting images. This study will help to adopt the most suitable methods for a given application as sufficient number of test images have been utilized.

Brain tumors are formed due to the abnormal growth of the cells that get multiplied and become in uncontrollable perspective. Tumors can damage brain cells by pressing down the skull, which consociate begins in, which negatively affects human health. In advanced stages, a brain tumor is a more dangerous infection that cannot be relieved. Brain tumor detection and early prevention are necessary in today's world. An extreme learning machine (ELM) is a widely adopted algorithm in machine learning. It is proposed to use classification models in brain tumor imaging. This classification is based on the techniques implemented: Convolutional Neural Networks(CNN) and Generative Adversarial Networks(GAN). CNN efficiently solves the convex optimization problem and is faster, requiring less human effort. The algorithmic architecture of GAN uses two neural networks, pocking one against the other. These networks are implemented in various fields to classify brain Tumor images. The present study mainly aims to introduce a new proposed classification system of preschool children brain imaging with Hybrid Convolutional Neural Networks and with the techniques of GAN. The proposed technique is compared with the existing hybrid-CNN and hybrid-GAN techniques. The outcomes are encouraging because the loss is deduced, and the accuracy facet increases. The proposed system achieved a training accuracy of 97.8% and a validation accuracy of 89%. The outcomes of the studies show that ELM in the platform of GAN for preschool children brain imaging classification has achieved higher predictive performance than the traditional classification mechanisms in increasingly complex scenarios. Time elapsed for training brain images samples finds inference value for training samples and time elapsed value increased by 28.9855%. Approximation ratio for cost based on probability, finding Approximation ratio for low probability range is increased by 88.1%. The combination of CNN, GAN and hybrid-CNN, hybrid-GAN, and hybrid CNN + GAN, compared with the proposed hybrid system, increased Detection latency for low range learning rate by 3.31%.

This study aims to evaluate the effectiveness of the Convolutional Neural Network ( CNN ) method combined with Support Vector Machine ( SVM ) in detecting URLs.Phishing.Phishing is one of the significant cyber threats, where attackers try to trick users into providing sensitive information through fake websites.With the increasing number of phishing attacks , there is a need for effective methods to detect and prevent this threat.In this study, a dataset containing URLs phishing and non-phishing data were used to train the CNN -SVM model .The training process involved feature extraction from URLs using CNN , which is capable of capturing complex patterns in the data, followed by classification using SVM , which is known for its ability to handle high-dimensional data.Testing was conducted across nine different scenarios to evaluate the performance of the model under various conditions.The test results showed that the hybrid CNN -SVM model achieved a precision of 95%, a recall of 92%, and an F1-Score of 93%, with an overall accuracy of 94%.These results indicate that the model is not only effective in detecting URLs phishing , but also has a good balance between precision and recall.This study indicates that the combination of CNN and SVM can be an effective solution for detecting URLs phishing , making a significant contribution to the development of better cyber security systems.

During the past five years, there has been an increasing trend of weakly supervised crowd counting methods being developed since such methods just rely on count-level annotations and avoid a laborious labeling process. But, the existing weakly supervised methods usually fail to achieve comparable counting performance to the fully supervised methods. To improve the accuracy of crowd counting tasks, we propose to combine the convolutional neural network (CNN) and Transformer frameworks. Since CNN focuses on capturing local detail information and Transformer can effectively extract global context information, we believe that the combination of CNN and Transformer could learn more efficient feature representations for crowd images. Our proposed framework is named CrowdCCT (Crowd Counting via CNN and Transformer), and it is composed of a CNN feature extraction part, a Transformer feature extraction part, and a counting regression part. In the CNN part, we utilize DenseNet121 to learn rich semantic features with its inherent dense connection structure. In the Transformer part, we introduce two attention modules, Multi-Scale Dilated Attention (MSDA) and Location-Enhanced Attention (LEA), working together to extract more expressive features. The output features are then fed into the regression part to generate the predicted counting results. Experiments on four crowd counting benchmark datasets demonstrate that our proposed CrowdCCT can achieve superior performance. Also, the experimental results validate the feasibility and effectiveness of combining CNN and Transformer for weakly supervised counting tasks. Our work could be expected to promote further combination research on CNN and Transformer.

Watermarking has become a crucial technique for protecting copyright and verifying the authenticity of images due to the rapid distribution of digital images and the ease and reliability of image content modification. In this research, we introduce a hybrid digital picture watermarking method that is both secure and resilient. This would use the discrete wavelet transform (DWT), the discrete cosine transforms (DCT), singular value decomposition (SVD), and cryptographic systems such as RSA and chaotic maps. Hence, this method tries to balance the tradeoff of robustness, security, and imperceptibility. We first encrypt the watermark using RSA, and then a chaotic logistic map (CLM) scrambles the already designed encrypted watermark to further enhance its robustness. By putting the watermark in the host image's separately calculated DWT-DCT coefficients, the proposed method works well even when compression, noise addition filtering, and geometric attacks are used. The test results demonstrate that the suggested method does better than other methods in Structural Similarity Index (SSIM), Normalized Correlation (NC), and Peak Signal-to-Noise Ratio (PSNR). Regardless of the nature of the attack, our proposed method consistently generates PSNR values above 55 dB and NC values above to 0.90, indicating correct watermark extraction and excellent image perception. We use cryptographic methods to secure the watermark from retrieval and modification by unauthenticated users. In addition, our approach is superior to the current watermarking methods in robustness and unobtrusiveness. In further works, we plan to improve the robustness of the approach against more complex geometric attacks and apply it for watermarking video and 3D content.

Objects and processes classification is a common experimental problem. Its solution, first of all, is needed in automatic diagnosis systems, for example, to determine the equipment operation state through the diagnostic signal or to identify abnormalities with medical images. With the development of convolutional neural networks, new prospects for solving such problems have risen up. However, the classification accuracy that can be achieved on these networks is not sufficient enough for all diagnosis issues. It is subject to, for example, timely diagnosis of the onset of transient phenomena. At the same time, another type of neural network, Kohonen self-organizing maps, has a conceptual property for training on unclassified set of classes, that is, giving the opportunity to solve such an issue. Therefore, the accuracy enhancement of the classification on the basis of Kohonen networks implementation in the architecture of convolutional networks is a relevant objective and has practical significance. The article analyzes the means of improving the accuracy of convolutional neural networks and arising problems solution. The ways of increasing the proportion of correct clustering on Kohonen networks due to the ‘growth’ of its grid shape in determining new classes in the learning process are also given. It is this property that makes it possible to recognize transient phenomena. It is determined that the existing solutions of the combination of Kohonen networks and convolutional networks are aimed at improving the efficiency of only self-organizing maps, with the purpose to improve the accuracy of classification by convolutional networks, it became necessary to develop a new architecture. The paper provides a description of this issue. Since the initial information of the Kohonen networks is the weighting matrix values of the grid shape neurons, it was necessary to associate it with the representation of the images in order to process the diagnostic images. The paper proposes the concept of a built-in associative array block based on Kohonen networks. According to the proposed method, a software implementation of a hybrid neural network is developed. The formulation and results of computational experiments are presented. The efficiency of the proposed method is experimentally proved. Keywords: convolutional neural networks, CNN, Kohonen self-organizing maps, SOM, signal classification, image classification.

Accurate and stable estimation of the state of health (SOH), which is one of the critical indicators to characterize the ability of lithium-ion (Li-ion) batteries to store and release energy, is critical in the stable driving of electric vehicles. In this paper, a novel SOH estimation method based on the aging factors of battery, which combines convolutional neural network (CNN), wavelet neural network (WNN), and wavelet long short-term memory (WLSTM) named CNN–WNN–WLSTM, is designed. The proposed CNN–WNN–WLSTM estimation scheme inherits both the fast convergence and robust stability of the WNN, as well as the ability of long short-term memory neural network (LSTM) to extract the time series features of the data; moreover, using CNN can make the proposed algorithm extract the data features from the original battery data automatically, and the WNN–WLSTM is then adopted to produce the final SOH estimation by exploiting the features from the CNN. To further speed and achieve global optimization, the RMSprop optimizer, instead of the usually used Adagrad optimizer, is chosen as the solver of the CNN–WNN–WLSTM network. Experimental results on data set from the NASA Ames Prognostics Center of Excellence show that the proposed algorithm can be commendably used for Li-ion battery health management by quantitative comparison with other commonly used machine learning methods, such as back-propagation neural network, WNN, LSTM, WLSTM, convolutional neural network–long short-term memory neural network (CNN–LSTM), and Gaussian process regression.

Recently, monkeypox virus is slowly evolving and there are fears it will spread as COVID-19. Computer-aided diagnosis (CAD) based on deep learning approaches especially convolutional neural network (CNN) can assist in the rapid determination of reported incidents. The current CADs were mostly based on an individual CNN. Few CADs employed multiple CNNs but did not investigate which combination of CNNs has a greater impact on the performance. Furthermore, they relied on only spatial information of deep features to train their models. This study aims to construct a CAD tool named "Monkey-CAD" that can address the previous limitations and automatically diagnose monkeypox rapidly and accurately. Monkey-CAD extracts features from eight CNNs and then examines the best possible combination of deep features that influence classification. It employs discrete wavelet transform (DWT) to merge features which diminishes fused features' size and provides a time-frequency demonstration. These deep features' sizes are then further reduced via an entropy-based feature selection approach. These reduced fused features are finally used to deliver a better representation of the input features and feed three ensemble classifiers. Two freely accessible datasets called Monkeypox skin image (MSID) and Monkeypox skin lesion (MSLD) are employed in this study. Monkey-CAD could discriminate among cases with and without Monkeypox achieving an accuracy of 97.1% for MSID and 98.7% for MSLD datasets respectively. Such promising results demonstrate that the Monkey-CAD can be employed to assist health practitioners. They also verify that fusing deep features from selected CNNs can boost performance.

Convolutional neural networks (CNNs) have become the state-of-the-art in automatic feature learning which has led to outstanding performance on pattern recognition applications. On the other hand, methodologies for discriminant analysis on multiclass problems have been proposed to determine the discriminant contribution of each feature. In this paper, we combine the capabilities of CNN and multi-class discriminant analysis to propose a general data-driven methodology for feature learning and discriminability for texture classification. The whole pipeline has two main blocks: (a) An approach that understands intrinsic patterns in small image patches using CNNs customized for the focused problem; (b) A multi-class discriminant analysis technique, fed with the CNN output, to select the most discriminant features for classification tasks. Our experimental results have shown that the feature spaces generated by the combination of CNN and discriminant analysis allow higher recognition rates using very much less CNN features in five-class granite image analysis

Human Activity Recognition (HAR) based on data from wearable sensors has become an attractive research topic thanks to its applications in different fields such as healthcare and smart environments. Recently, the advancement of deep learning with capability to perform automatically high-level feature extraction has achieved promising results. However, the performance of the deep learning models depends deeply on the characteristics of the datasets such as the number of classes, the inter-similarity and intra-variation. Therefore, directly comparing these models has become difficult since a wide variety of experimental protocols, evaluation metrics, and datasets are employed. In this paper, for the first time, a systematic evaluation of several deep learning models for HAR from wearable sensors is provided. In particular, three models named Convolutional Neural Network (CNN) [1], DeepConvLSTM - a combination of CNN and Long Short Term Memory (LSTM) [2], and SensCapsNet - a Capsule Neural Network for wearable sensor-based HAR [3] were implemented and evaluated on three benchmark datasets that are 19NonSens, CMDFall, and UCI-HAR dataset. Moreover, to have an intuitive explanation of deep learning models, a visualization of features learnt from these models is given. The evaluation codebase and results will be made publicly available for community use.

This paper proposes a novel deep learning architecture involving combinations of Convolutional Neural Networks (CNN) layers and Recurrent neural networks (RNN) layers that can be used to perform segmentation and classification of 5 cardiac rhythms based on ECG recordings. The algorithm is developed in a sequence to sequence setting where the input is a sequence of five second ECG signal sliding windows and the output is a sequence of cardiac rhythm labels. The novel architecture processes as input both the spectrograms of the ECG signal as well as the heartbeats' signal waveform. Additionally, we are able to train the model in the presence of label noise. The model's performance and generalizability is verified on an external database different from the one we used to train. Experimental result shows this approach can achieve an average F1 scores of 0.89 (averaged across 5 classes). The proposed model also achieves comparable classification performance to existing state-of-the-art approach with considerably less number of training parameters.

- In recent months, the rise of free, deep learning- based software tools has significantly simplified the creation of highly realistic face-swapped videos, commonly known as "Deep Fakes" (DFs). While video manipulation through visual effects has been practiced for decades, recent advancements in deep learning have drastically enhanced the realism and accessibility of such synthetic content. Creating DFs using AI tools has become relatively straightforward; however, detecting these manipulations remains a major challenge. This is due to the complexity involved in training algorithms to recognize subtle and often imperceptible signs of tampering. In this work, we present a deep learning-based approach that combines Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to detect Deep Fake videos. Our system employs CNNs to extract spatial features at the frame level, which are then passed to an RNN that captures temporal inconsistencies between frames introduced during Deep Fake generation. We evaluate our method on a large dataset of manipulated videos and demonstrate that our approach achieves competitive results using a relatively simple architecture. Key Words: Deep fake video detection, Convolutional neural networks(CNN), Recurrent neural networks(RNN)

An analysis of machine learning models for sentiment analysis of Tamil code-mixed data

This paper puts forward an approach that combines Convolutional Neural Networks (CNNs) and Genetic Algorithm (GA) to detect accurately and quickly the diseases that affect potato leaves swiftly and accurately. The model of the CNN is employed for automated feature extraction from the images of leaves which are pivotal in differentiating between the healthy and the infected leaves. Optimization of CNN hyper parameters, like learning rate, the number of layers, and dimensions of filters, is not only time-consuming but also challenging to find optimal values, and genetic algorithms for the optimal values of the parameters of the Convolutional Neural Network. A genetic algorithm uses an iterative search process that aims to optimize a population of models of Convolutional Neural Networks over several generations. It achieves this through the use of optimal models to perform crossover and mutation hence efficiently searching for the optimal configuration of hyperparameters. The above combine will improve the performance of the model which leads to better performance in detecting the variety of diseases attacking the potato leaves, such as early blight and late blight. In this paper CNN model utilizing a genetic algorithm attains an accuracy of 98.3% in 50 epochs.

Bolt loosening is a significant concern in structural health monitoring (SHM), and the nonlinear wave modulation (NWM) technique shows promise for its detection. However, temperature variations affect piezoelectric sensors, complicating detection. This study examines thermal stress effects on NWM-based damage detection by simulating a beam with boundary loosening under thermal stress. A temperature compensation method was developed to mitigate these effects. A multibolt structure was also analyzed using a hybrid deep learning model combining convolutional neural networks (CNNs) and Dezert-Smarandache Theory (DSmT) for multisensor data fusion. Results show that thermal stress significantly reduces classification accuracy. At 60 °C, the Damage Index dropped to zero, and CNN classification accuracy fell from 87.5% (at 25 °C) to 27.08%. Applying the compensation algorithm restored CNN accuracy to 87.27%. Statistical tests confirmed the compensated results at 60 °C were comparable to those at 25 °C. The DSmT-based fusion model achieved 98.92% accuracy on average, and even at 60 °C, maintained 98.80% accuracy with compensation for a multibolted plate. It combines the probabilistic outputs of multiple CNNs using the PCR6 rule, which redistributes conflicting evidence to improve decision reliability. This fusion strategy effectively handles uncertainty across sensors and significantly enhances classification robustness under temperature variations. In conclusion, thermal stress adversely impacts SHM damage detection, but the proposed compensation method effectively restores performance. Moreover, integrating multisensor fusion with DSmT greatly enhances accuracy, offering a robust solution for SHM in varying thermal environments.