DeepFakes Detection in Videos using Feature Engineering Techniques in Deep Learning Convolution Neural Network Frameworks

In pattern recognition, identifying Kannada handwritten numerals are a complex knot. This paper portrays an avenue that pikes us to attain a most potent Kannada Numerals recognition process. In this, handwritten Kannada characters are captivated in document fashion and are subjected to Pre-processing and attribute extraction processes. Pre-processing entails steps like noise removal, binarization, normalization, skew amendment, and thinning. Features are extricated by exploiting strategies like Drift Length Count, Direction related progression code, DWT and Curvelet Transfiguration Wrapping. For an impressive classification process deep convolution neural network classifier is preferred. Isolation accuracy of Kannada numeral aimed here will outsource 96% of accuracy.

This paper highlights the ability of residual convolutional neural network (ResNet) at classifying railway shelling defect dataset without the requirement for handcrafted features. A 41-convolutional layers ResNet with the residual learning block is introduced. Bottleneck architecture of three convolutional layers is used in ResNet to decrease the computation cost. VGG convolutional neural network (VGGNet) classifier and Support Vector Machine (SVM) classifiers based on Histogram of Oriented Gradient (HOG), Local Binary Patterns (LBP) and Scale-invariant Feature Transform (SIFT) are compared with ResNet classifier at classifying our dataset. The performance of ResNet presented in this paper achieves 95% TOP-1 accuracy in testing dataset. In comparison, the result of ResNet is better than VGGNet with 92% TOP-1 accuracy and HOG (42.88%), LBP (52.26%), SIFT (60.69%). In the context of designing neural computing models for ResNet analysis, this paper shows that ResNet used in our experiment is able to not only achieve the high accuracy in railway shelling defect testing dataset, but also has a faster testing speed than the other classifiers.

4D digital tomosynthesis (DTS) techniques for image-guided radiation therapy (IGRT) are able to reduce radiation dose, scan and reconstruction time compared to 4D cone-beam computed tomography (CBCT). In spite of these benefits, the 4D DTS techniques cause the degradation of image quality due to an intrinsic imaging strategy and consequently reduce treatment accuracy. In this study, a deep learning-based convolutional neural network (CNN) framework was proposed for 4D DTS imaging. The proposed CNN framework consisted of the data restoration network based on a U-Net and the denoising network combined with a 2D wavelet transform, and the network training was implemented with clinical images. The quality of the 4D DTS images obtained from the proposed model was evaluated in terms of quantitative accuracy, spatial resolution and noise property. The results showed that the proposed CNN framework improved the quantitative accuracy of 4D DTS images by 3–19%, and the spatial resolution and noise for the proposed CNN framework were reduced by 2.24–7.33% and 8.92–40.07%, respectively, in comparison to other imaging models. These results represented that the degradation of the 4D DTS image quality can be recovered using the proposed CNN framework, and the proposed model is suitable for maintaining spatial resolution as well as suppressing noise and artifacts. In conclusion, the proposed CNN framework can be potentially used to improve the quality of 4D DTS images for the IGRT.

In a near of wide spread technological change that has givena positive impact to the society andhelpedinbuildingauser-friendly environment, object detection framework, an importantpart of Computer Vision (CV) plays a vital role. Starting fromasimpleautomaticattendancesystemforstudentsusingfacedetection, recognizing the presence of tumors in medical images,helping with automatic surveillance of cctv cameras to identifypeoplewhobreakstrafficrulescausingroadaccidentstobeingthecentral mechanism behind self-driving cars, object detection haswide range of applications and assist building an easy to cope withsmart environments. This in turn urges the need to evaluate theperformanceofthetechniquesbehindtheseframeworks.Thecentralideabehindthemodern-dayobjectdetectionandclassification is Convolutional Neural Network (CNN) which triesto mimic the occipital lobe, the visual cortex of the human brain.CNNhaswiderangeofvariationsandhascomethroughalongwaystarting from basic CV techniques like Scale Invariant FeatureTransform(SIFT),HistogramsofOrientedGradientsn(HOG)tillRegionbasedCNN’s(R-CNN).Theperformanceofeachandeverymethodthathas led throughthe evolutionofobjectdetectionmethods, its advantages and the disadvantages which has pavedway for the innovation of next technique has been discussed andrepresentedindetail.

In a cognitive wireless powered communication network (CWPCN), implantable medical devices play an important role in screening patients via wireless communication. The key elements for multiple-input multiple-output (MIMO) framework appropriate for Internet of Things (IoT) applications are reliable in the behavior, consume less power, and less computational complication with reconfigurable models is the major challenge in design. This model enhances remote communications at the frontline of wireless research. Cloud model provides essential environment for software support, sharable network, and much more. Some limitations are present on the geological structure and multi hop-based network. To address these, fog computing is brought to tackle the addressing needs and enhancement of the computing service. The problem during cloud integration with IoT can be handled effectively by fog computing. For data identification and decoding, multiple antenna frameworks rely on details of channel state information at the receiver. As a consequence, an efficient and vigorous evaluation of wireless channels is critical for the consistent recovery of data. As a result, constructing an implantable MIMO antenna for IoT-based wearable healthcare applications is proposed. The main goal is to improve the antenna’s capacity parameters using effective chicken swarm optimization technique and deep learning-based convolution neural network approaches for efficient data transmission between the CWPCN in the healthcare field. A cooperative antenna selection neural network classifier is used to make the classification. The implemented technique’s behavior is linked with that of conventional techniques in terms of gain, mutual coupling, specific absorption rate, bandwidth, and efficiency. The results are analyzed and compared to existing approaches, and the proposed system is shown to be more efficient for health data transfer.

Sign language is used as a primary means of communication by millions of people who suffer from hearing problems. The unhearing people used visual language to interact with each other, Represented in sign language. There are features that the hearing impaired use to understand each other, which are difficult for normal people to understand. Therefore, deaf people will struggle to interact with society. This research aims to introduce a system for recognizing hand gestures in Arabic Sign Language (ArSL) through training the Convolutional Neural Network (CNN) on the images of ArSL gestures launched by the University of Prince Mohammad Bin Fahd, Saudi Arabia. A Scale Invariant Feature Transform (SIFT) algorithm is used for creating the feature vectors that contain shape, finger position, size, center points of palm, and hand margin by extracting the Important features for images of ArSL and transforming them to points of the vector. The accuracy of the proposed system is 97% using the SIFT with CNN, and equal to 94.8% nearly without SIFT. Finally, the proposed system was tried and tested on a group of persons and its effectiveness was proven after considering their observations.

White blood cells (WBCs) are the most diverse types of cells observed in the healing process of injured skeletal muscles. In the recovery process, WBCs exhibit a dynamic cellular response and undergo multiple changes of the protein expression. The progress of healing can be analyzed by the number of WBCs or by the number of specific proteins observed in light microscopy images obtained at different time points after injury. We propose a deep learning quantification and analysis system called DeepQuantify to analyze WBCs in light microscopy images of uninjured and injured muscles of female mice. The DeepQuantify system features in segmentation using the localized iterative Otsu's thresholding method, masking postprocessing, and classification of WBCs with a convolutional neural network (CNN) classifier to achieve a high accuracy and a low manpower cost. The proposed two-layer CNN classifier designed based on the optimization hypothesis is evaluated and compared with other CNN classifiers. The DeepQuantify system adopting these CNN classifiers is evaluated for quantifying CD68-positive macrophages and 7/4-positive neutrophils and compared with the state-of-the-art deep learning segmentation architectures. DeepQuantify achieves an accuracy of 90.64% and 89.31% for CD68-positive macrophages and 7/4-positive neutrophils, respectively. The DeepQuantify system employing the proposed two-layer CNN architecture achieves better performance than those deep segmentation architectures. The quantitative analysis of two protein dynamics during muscle recovery is also presented.

Geometric correction is used to correct the registration errors in remotely sensed images. These images are often compared to ground control points (GCPs) either by using an accurate map (image to map) or using another geo-referenced image (image to image) and then resampled. Accordingly, the exact locations and the appropriate pixel values can be calculated in more accurate, time-wise and effortless manner. In the traditional methods, the GCPs are manually selected and then the transformation models are applied which yield time consuming and less accurate processes. The objective of this work is to develop an automatic approach for image registration based on another geo-referenced image using five feature extraction models. They are Scale Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), Discrete Wavelet Transforms (DWT), (SIFT & DWT), and (SURF & DWT). The GCPs were selected based on the least-squares adjustments as the basis for improving the spatial accuracy of all the linking points in both images. The obtained results showed that models have higher accuracy in image registration with Root Mean Square Error (RMSE) less than 0.5. The developed automated image registration method provides more accurate results and saves time, money and effort.

COVID-DSNet: A novel deep convolutional neural network for detection of coronavirus (SARS-CoV-2) cases from CT and Chest X-Ray images

Background: Modern diagnostic pathology workflows involve the integration of histomorphologic, immunohistochemical (IHC), and molecular data to reach a final diagnosis. Recently, advances in deep learning have revolutionized pathology by providing the prospect for expert-level autonomous image analysis tools. Despite recent innovations in deep learning, integrating histomorphologic and molecular information found on respective H&E- and IHC-stained tissue sections still remains a challenge. Here, we aim to address this issue by incorporating computer vision tools, including deep learning and scale-invariant feature transform (SIFT), to align H&E-stained sections with accompanying IHC studies for automated subclassification of gliomas. Methods: To test the workflow, we trained the publicly available VGG19 convolutional neural network (CNN) using patches of pathologist-annotated H&E-stained WSIs to recognize histological patterns of 16 common tissue and brain tumor classes, including diffuse glioma, meningioma, metastatic carcinoma, and schwannoma. To complement the histomorphologic analysis, we optimized several deep learning classifiers, including Mask R-CNN, to recognize various IHC markers, such as Ki-67, IDH1-R132H and ATRX, relevant for molecular subclassification of gliomas. For the integrated analysis, we employed SIFT to align lesional regions of H&E and IHC images. Results: The histomorphologic classifier excelled at classification with accuracies of 100% for glioma, meningioma and metastatic carcinoma, and 93% for schwannoma (n = 125). The Mask R-CNN was tested on 147 images generated from 34 brain tumor Ki-67 WSIs and showed a high concordance with aggregate pathologists’ estimates (n = 3 assessors; y = 0.9712x -1.945, r = 0.9750). Using the deep learning classifiers and SIFT, we were able to identify tumor regions from the H&E images and align them to their corresponding IHC images. This resulted in significant improvement of ATRX and IDH1-R132H quantification compared to unaligned WSIs. Finally, SIFT and partially sampling the lesional regions decreased computational time significantly without compromising accuracy. Conclusion: SIFT can work in concert with deep learning tools to help examine the histomorphologic and molecular patterns of various brain tumors and provide a framework for integrating deep learning tools to provide automated diagnoses. Citation Format: Michael K. Lee, Kevin Faust, Madhumitha Rabindranath, Phedias Diamandis. Automating integration of histomorphologic and immunohistochemistry data using computer vision tools [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2022; 2022 Apr 8-13. Philadelphia (PA): AACR; Cancer Res 2022;82(12_Suppl):Abstract nr 455.

BackgroundThe images of different flower species had small inter-class variations across different classes as well as large intra-class variations within a class. Flower classification techniques are mainly based on the features of color, shape and texture, however, the procedure always involves too many heuristics as well as manual labor to tweak parameters, which often leads to datasets with poor qualitative and quantitative measures. The current study proposed a deep architecture of convolutional neural network (CNN) for the purposes of improving the accuracy of identifying the white flowers of Fragaria × ananassa from other three wild flower species of Androsace umbellata (Lour.) Merr., Bidens pilosa L. and Trifolium repens L. in fields.ResultsThe explored CNN architecture consisted of eightfolds of learnable weights including 5 convolutional layers and 3 fully connected layers, which received a true color 227 × 227 pixels flower image as its input. The developed CNN detector was able to classify the instances of flowers at overall average accuracies of 99.2 and 95.0% in the training and test procedure, respectively. The state-of-the-art CNN model was compared with the classical models of the scale-invariant feature transform (SIFT) features and the pyramid histogram of orientated gradient (PHOG) features combined with the multi-class support vector machine (SVM) algorithm. The proposed model turned out to be much more accurate than the traditional models of SIFT + SVM at overall average accuracies of 82.9 and 55.6% in the training and test procedure and PHOG + SVM at overall average accuracies of 78.3 and 63.1%, respectively.ConclusionsThe proposed state-of-the-art CNN method demonstrates that artificial intelligence is capable of precise classification of the white flower images, whose accuracy is comparable to traditional algorithms. The presented algorithm can be further used for the discrimination of white wild flowers in fields.

In this paper, a robust hybrid watermarking method based on discrete wavelet transform (DWT), discrete cosine transform (DCT), and scale-invariant feature transformation (SIFT) is proposed. Indeed, it is of prime interest to develop robust feature-based image watermarking schemes to withstand both image processing attacks and geometric distortions while preserving good imperceptibility. To this end, a robust watermark is embedded in the DWT-DCT domain to withstand image processing manipulations, while SIFT is used to protect the watermark from geometric attacks. First, the watermark is embedded in the middle band of the discrete cosine transform (DCT) coefficients of the HL1 band of the discrete wavelet transform (DWT). Then, the SIFT feature points are registered to be used in the extraction process to correct the geometric transformations. Extensive experiments have been conducted to assess the effectiveness of the proposed scheme. The results demonstrate its high robustness against standard image processing attacks and geometric manipulations while preserving a high imperceptibility. Furthermore, it compares favorably with alternative methods.

Bengali text document categorization based on very deep convolution neural network

Anomaly detection in crowd surveillance videos is a critical task for ensuring public safety and security. In this research paper, we propose a comprehensive framework for anomaly detection using deep learning techniques, specifically Recurrent Neural Networks (RNNs), Convolutional Neural Networks (CNNs), and Generative Adversarial Networks (GANs). Our objective is to narrow the gap between computational complexity and detection effectiveness while satisfying the demand for explainability in anomaly detection systems. The proposed framework leverages the UCSD Ped2 dataset and focuses on incorporating spatial constraints to enhance anomaly detection performance. We introduce novel approaches for feature extraction and anomaly detection using GANs, aiming to capture essential spatial and temporal information while reducing computational complexity. Specifically, we develop encoders within the GAN framework to map input data to a lower-dimensional latent space and perform anomaly detection based on the similarity between latent codes. Through extensive experimentation and evaluation, we compare the performance of RNNs, CNNs, and GANs in detecting anomalies in crowd surveillance videos. Various evaluation metrics, including precision, recall, F1 score, ROC-AUC, and PR-AUC, is considered to assess the effectiveness of each approach. Additionally, they studied hyperparameters such as learning rate, batch size, network architecture, and GAN-specific parameters to optimize anomaly detection performance. Our results demonstrate the usefulness of the proposed framework in achieving robust and explainable anomaly detection in crowd surveillance videos. By combining advanced deep learning techniques with spatial constraints and explainability considerations, our research contributes to the development of more reliable and interpretable anomaly detection systems for real-world applications.

Image classification is a fundamental problem in computer vision, which deserves much attention in the past decade. To provide a comprehensive recall for the image classification task based on the deep learning algorithms, this paper first provides a brief history of computer vision and convolutional neural networks. Then, the current state of research and the direction of development of deep learning-based convolutional neural network models for image classification are examined. In addition, the basic model structure, convolution feature extraction, and pooling operations of standard and convolutional neural networks are also introduced. This paper summarizes the development of convolutional neural network models in recent years. In summary, based on the review of the development of image classification algorithms at home and abroad, the current mainstream image classification algorithms and frontier progress are summarized and analyzed, and the existing problems and future development directions of image classification are summarized and prospected. It can be concluded that deep learning-based methods has a great potential in this case.