Automatic Classification of Spider Images in Natural Background

Aiming at the problem of objects in image recognition rectangle, but objects which are input into convolutional neural networks square, the object recognition model was put forward which was based on BING method to realize object estimate, used vectorization of convolutional neural networks to realize input square image in convolutional networks, therefore, built joint convolution neural networks, which achieve multiple size image input. Verified by experiments, the accuracy of multi-object image recognition was improved by 6.70% compared with single vectorization of convolutional neural networks. Therefore, image recognition method of joint convolutional neural networks can enhance the accuracy in image recognition, especially for target in rectangular shape.

Text recognition in natural scene images is a challenging problem in computer vision. Different than the optical character recognition (OCR), text recognition in natural scene images is more complex due to variations in text size, colors, fonts, orientations, complex backgrounds, occlusion, illuminations and uneven lighting conditions. In this paper, we propose a segmentation-free method based on a deep convolutional recurrent neural network to solve the problem of cursive text recognition, particularly focusing on Urdu text in natural scenes. Compared to the non-cursive scripts, Urdu text recognition is more complex due to variations in the writing styles, several shapes of the same character, connected text, ligature overlapping, stretched, diagonal and condensed text. The proposed model gets a whole word image as an input without pre-segmenting into individual characters, and then transforms into the sequence of the relevant features. Our model is based on three components: a deep convolutional neural network (CNN) with shortcut connections to extract and encode the features, a recurrent neural network (RNN) to decode the convolutional features, and a connectionist temporal classification (CTC) to map the predicted sequences into the target labels. To increase the text recognition accuracy further, we explore deeper CNN architectures like VGG-16, VGG-19, ResNet-18 and ResNet-34 to extract more appropriate Urdu text features, and compare the recognition results. To conduct the experiments, a new large-scale benchmark dataset of cropped Urdu word images in natural scenes is developed. The experimental results show that the proposed deep CRNN network with shortcut connections outperform than other network architectures. The dataset is publicly available and can be downloaded from <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://data.mendeley.com/datasets/k5fz57zd9z/1</uri> .

In recent years, convolutional neural networks have been widely used in image processing and have shown good results. Particularly useful was their ability to automatically extract image features (textures and shapes of objects). The article proposes a method that improves the accuracy and speed of recognition of an ultra-precise neural network based on image recognition of people’s faces. At first, a recurrent neural network is introduced into the convolutional neural network, thereby studying the characteristics of the image more deeply. Deep image characteristics are studied in parallel using a convolutional and recurrent neural network. In line with the idea of skipping the ResNet convolution layer, a new ShortCut3- ResNet residual module is built. A double optimization model is created to fully optimize the convolution process. A study of the influence of various parameters of a convolutional neural network on network performance is demonstrated, also analyzed using simulation experiments. As a result, the optimal parameters of the convolutional neural network are established. Ex- periments show that the method presented in this paper can study various images of people’s faces regardless of age, gender, and also improves the accuracy of feature extraction and image recognition ability.

Cancer centers have an urgent and unmet clinical and research need for AI that can guide patient management. A core component of advancing cancer treatment research is assessing response to therapy. Doing so by hand, for example, as per RECIST or RANO criteria, is tedious and time-consuming, and can miss important tumor response information. Most notably, the prevalent response criteria often exclude lesions, the non-target lesions, altogether. We wish to assess change in a holistic fashion that includes all lesions, obtaining simple, informative, and automated assessments of tumor progression or regression. Because genetic sub-types of cancer can be fairly specific and patient enrollment in therapy trials is often limited in number and accrual rate, we wish to make response assessments with small training sets. Deep neuroevolution (DNE) is a novel radiology artificial intelligence (AI) optimization approach that performs well on small training sets. Here, we use a DNE parameter search to optimize a convolutional neural network (CNN) that predicts progression versus regression of metastatic brain disease. We analyzed 50 pairs of MRI contrast-enhanced images as our training set. Half of these pairs, separated in time, qualified as disease progression, while the other 25 image pairs constituted regression. We trained the parameters of a CNN via "mutations" that consisted of random CNN weight adjustments and evaluated mutation "fitness" as summed training set accuracy. We then incorporated the best mutations into the next generation's CNN, repeating this process for approximately 50,000 generations. We applied the CNNs to our training set, as well as a separate testing set with the same class balance of 25 progression and 25 regression cases. DNE achieved monotonic convergence to 100% training set accuracy. DNE also converged monotonically to 100% testing set accuracy. We have thus shown thatDNE can accurately classify brain metastatic disease progression versus regression. Future work will extend the input from 2D image slices to full 3D volumes, and include the category of "no change." We believe that an approach such as ours can ultimately provide a useful and informative complement to RANO/RECIST assessment and volumetric AI analysis.

In recent years Neural Networks and especially Deep Neural Networks (DNN) have seen a rise in popularity. DNNs have increased the overall performance of algorithms in applications such as image recognition and classification, 2D and 3D pose detection, natural language processing, and time series forecasting. Especially in image classification and recognition, so-called Convolutional Neural Network (CNN) have gained high interest as they can reach a high accuracy, which makes them a viable solution in cancer detection or autonomous driving. As CNNs are widely used in image tasks, different visualizations techniques have bee developed to show how their internals are working. Apart from image tasks, CNNs are applicable to other problems, e.g., time series classification, time series forecasting, or natural language processing. CNNs in those contexts behave similarly, allowing for the same visualization techniques to make them more interpretable. In this chapter, we adapt image visualization algorithms to time series problems, allowing us to build granular, intuitively interpretable feature hierarchies to make a time series forecast as understandable as an image recognition task. We do so by using our previous work on power time series forecasting using CNN Auto Encoders (AEs) and applying typical CNN visualization techniques to it. Thus, we guid computer scientists to provide better interpretable figures for a time series forecasting task to application domain experts.KeywordsVisualizationConvolutional neural networksTime series data

Deep convolutional neural networks have achieved great success in recent years. They have been widely used in various applications such as optical and SAR image scene classification, object detection and recognition, semantic segmentation, and change detection. However, deep neural networks rely on large-scale high-quality training data, and can only guarantee good performance when the training and test data are independently sampled from the same distribution. Deep convolutional neural networks are found to be vulnerable to subtle adversarial perturbations. This adversarial vulnerability prevents the deployment of deep neural networks in security-sensitive applications such as medical, surveillance, autonomous driving and military scenarios. This paper first presents a holistic view of security issues for deep convolutional neural network-based image recognition systems. The entire information processing chain is analyzed regarding safety and security risks. In particular, poisoning attacks and evasion attacks on deep convolutional neural networks are analyzed in detail. The root causes of adversarial vulnerabilities of deep recognition models are also discussed. Then, we give a formal definition of adversarial robustness and present a comprehensive review of adversarial attacks, adversarial defense, and adversarial robustness evaluation. Rather than listing existing research, we focus on the threat models for the adversarial attack and defense arms race. We perform a detailed analysis of several representative adversarial attacks on SAR image recognition models and provide an example of adversarial robustness evaluation. Finally, several open questions are discussed regarding recent research progress from our workgroup. This paper can be further used as a reference to develop more robust deep neural network-based image recognition models in dynamic adversarial scenarios.

This study developed a new method of image pre-processing for use in automated object recognition systems, allowing for increased accuracy, reliability, and speed of recognition under varying lighting conditions and other external influences. The proposed method is based on contrast-limited adaptive histogram equalization (CLAHE) and gamma correction. To enhance illumination, the method employs a novel adaptive cutoff point to equalize the histogram based on the texture information of image blocks. To address issues such as halo artifacts, under-gain, and over-gain, a first gamma correction function is proposed for integration into the CLAHE structure, which enhances the overall variation of gray shades in the image. A second gamma correction function is proposed to mitigate the negative impact of varying illumination on dark and light regions. For the development of a new image pre-processing method based on a convolutional neural network, a unique layer arrangement is proposed, featuring several layers of convolution, activation, pooling, and normalization. Experimental tests have demonstrated the effectiveness of the developed method, which achieved an accuracy coefficient of 93.74%. This was evaluated by comparing its performance with other image pre-processing methods within an automated face recognition system based on Local Binary Patterns (LBP) and the Support Vector Machine (SVM). The results confirmed that the developed method can improve existing object recognition systems or serve as a foundation for creating new automated software applications requiring high reliability in image recognition.

In Cassini ISS (Imaging Science Subsystem) images, contour detection is often performed on disk-resolved objects to accurately locate their center. Thus, contour detection is a key problem. Traditional edge detection methods, such as Canny and Roberts, often extract the contour with too much interior details and noise. Although the deep convolutional neural network has been applied successfully in many image tasks, such as classification and object detection, it needs more time and computer resources. In this paper, a contour detection algorithm based on H-ELM (Hierarchical Extreme Learning Machine) and DenseCRF (Dense Conditional Random Field) is proposed for Cassini ISS images. The experimental results show that this algorithm’s performance is better than both traditional machine learning methods, such as Support Vector Machine, Extreme Learning Machine and even deep Convolutional Neural Network. The extracted contour is closer to the actual contour. Moreover, it can be trained and tested quickly on the general configuration of PC, and thus can be applied to contour detection for Cassini ISS images.

Chest X-ray is the commonly used method to diagnose pneumonia. How to correctly interpret the image information is always the main challenge faced by doctors. Convolution Neural Network (CNN) is a popular deep learning algorithm with excellent image recognition performance, and has been used widely in automatic recognition and diagnosis of medical images. This paper studies the classification of normal and pneumonia with more than 5000 chest X-ray images by employing three CNN models of VGG16, VGG19 and Inception_V3. The performances of each model for classification was evaluated and compared.

Convolutional Neural Networks (CNNs) have recently been utilized in a wide range of applications, including image and pattern identification, voice recognition, biometric embedded vision, food recognition, and video analysis for surveillance, industrial robots, and autonomous vehicles. Convolutional neural networks (CNNs) are gaining popularity for a variety of reasons. Feature extractors are created by hand in classic image recognition models. The weights of the convolutional layer utilized for feature extraction, as well as the fully connected layer, are used for classification in CNNs, and these weights are set throughout the training phase. The goal of this study is to evaluate a few convolutional neural network (CNN) learning machine approaches for image recognition. Furthermore, machine learning algorithms are used extensively in contemporary approaches to picture recognition. This article focuses on the development trend of convolution neural network (CNNs) model owing to various learning methods in image recognition during the 2000s, which is largely introduced from the angles of capturing, verification, and clustering, based on twenty five journals that have been reviewed. As a result, deep convolutional neural networks (DCNNs) have been very effective in a variety of machine learning and computer vision problems because they provide a large quality gain at a low computational cost. This training approach also enables models with many processing layers to learn different degrees of abstraction for data representation.

At present, the clear license plate recognition algorithm has been mature, but for the blurred license plate which cannot be recognized by the human eye, the recognition rate of the traditional license plate recognition algorithm is too low. In view of this, a license plate character recognition algorithm based on convolutional neural network structure is proposed. In this study, a large number of training samples of fuzzy characters are constructed, and a convolutional neural network is trained for blind segmentation of fuzzy license plate characters. By calling the trained convolutional neural network, we can recognize the characters after blind segmentation. The experimental results show that the training set accuracy is close to 100%, and the accuracy of the test set is more than 93%. It can recognize the license plate characters which cannot be recognized by the human eye.

Medical image segmentation is an essential process in disease analysis and diagnosis, in which medical images are divided into specific areas of anatomic or pathological structures. However, this process has challenges, such as the quality, variability, and complexity of medical images. Thus, we propose a medical image segmentation method using the Convolutional Neural Network (CNN) and the Histogram Equalization (HE) image preprocessing. We evaluated medical image segmentation using 2 secondary datasets, namely Lung CT-Scan and Chest X-Rays, with 267 and 3616 images, respectively. The HE method uses an averaging of the optimal cumulative distribution function (CDF) values with a range of 0 to 39. The experimental results show that adding the HE method can increase the accuracy of CNN on the Lung CT-Scan and Chest X-rays data sets, respectively, by 0.73 percentage points from 91.28% to 92.08 % and 1.23 percentage points from 95.56% to 96.85% for the training process. The results of the testing process (validation) have an increase in accuracy of 2.82 percentage points from 89.77% to 92.59% and 0.91 percentage points from 96.06% to 96.97%. Implementing the HE method increases accuracy in CNN medical image segmentation based on the value of dice similarity coefficient (DSC) and structural similarity index measurement (SSIM) close to 0.95.

Small sample image recognition using improved Convolutional Neural Network

Convolutional neural network (CNN) is a promising image recognition technique for winter road surface condition (RSC), a measure that is crucial for winter maintenance operations. In the past, researchers have designed RSC CNN models that displayed acceptable results but did so focusing solely on obtaining high classification accuracy without any consideration for efficiency. Furthermore, when it comes to model development itself, architecture design requires expertise in CNN as well as rich knowledge in the investigated problem itself. To rectify these issues, this paper proposes an innovative approach to automatically design RSC CNN architecture without compromising classification accuracy. The proposed approach uses a weighted sum method, which provides the freedom of choosing relative importance level between accuracy and efficiency. Once the relative importance has been set, one of the most successful and widely adopted heuristics, namely, simulated annealing (SA), is employed to generate (sub)optimal solutions. Results show that both accuracy and efficiency of the automatically generated CNNs are better or at least comparable to the two selected state-of-the-art CNN models, ResNet50 and MobileNet, achieving as high as 93.44% classification accuracy. Ultimately, the outcome of this study fills the gap in existing CNN design methods that do not consider the tradeoff between accuracy and efficiency while providing insight into the effect varying architectures have on CNN model performance.

Deep Learning algorithms are designed in such a way that they mimic the function of the human cerebral cortex. These algorithms are representations of deep neural networks i.e. neural networks with many hidden layers. Convolutional neural networks are deep learning algorithms that can train large datasets with millions of parameters, in form of 2D images as input and convolve it with filters to produce the desired outputs. In this article, CNN models are built to evaluate its performance on image recognition and detection datasets. The algorithm is implemented on MNIST and CIFAR-10 dataset and its performance are evaluated. The accuracy of models on MNIST is 99.6 %, CIFAR-10 is using real-time data augmentation and dropout on CPU unit.