Convolutional Neural Networks with Neural Cascade Classifier for Pedestrian Detection

Detection of metastasis of mediastinal lymph nodes in lung cancer patients with an artificial intelligence model.

Abstract. Pedestrian detection and tracking remains a highlight research topic due to its paramount importance in the fields of video surveillance, human-machine interaction, and tracking analysis. At present time, pedestrian detection is still an open problem because of many challenges of image representation in the outdoor and indoor scenes. In recent years, deep learning, in particular Convolutional Neural Networks (CNNs) became the state-of-the-art in terms of accuracy in many computer vision tasks. The unsupervised learning of CNNs is still an open issue. In this paper, we study a matter of feature extraction using a special activation function. Most of CNNs share the same architecture, when each convolutional layer is followed by a nonlinear activation layer. The activation function Rectified Linear Unit (ReLU) is the most widely used as a fast alternative to sigmoid function. We propose a bounded randomized leaky ReLU working in such manner that the angle of linear part with the highest input values is tuned during learning stage, and this linear part can be directed not only upward but also downward using a variable bias for its starting point. The bounded randomized leaky ReLU was tested on Caltech Pedestrian Dataset with promising results.

Deep learning theory demonstrates its great power in the complicated data processing field. As a prevalent deep learning technology, convolutional neural network (CNN) has achieved some successful applications in the field of fault detection and classification in the complicated industrial systems because of its strong nonlinear feature extraction capability. However, the basic CNN views all the features equally and can not highlight these features which play a more important role in the fault classification procedure. To deal with this problem, this paper proposes an improved CNN model, called multi-head attention CNN (MACNN), to distinguish the importance of different features for better fault classification performance. In the MACNN framework, the raw training data are firstly analyzed by the multiple convolutional layers for feature extraction. Then, the features obtained by the convolution layers are used as the input of the multi-head attention (MA) layers. The introduction of the MA mechanism can help exploit more meaningful information by emphasizing the important features. Lastly, the softmax classifier is utilized to classify the fault patterns. To test the method performance, one case study on the benchmark Tennessee Eastman industrial system is performed and the results show that MACNN gives the better fault classification results than the traditional feedforward neural network (FNN) and CNN models.

More than 80% of video surveillance systems are used for monitoring people. Old human detection algorithms, based on background and foreground modelling, could not even deal with a group of people, to say nothing of a crowd. Recent robust and highly effective pedestrian detection algorithms are a new milestone of video surveillance systems. Based on modern approaches in deep learning, these algorithms produce very discriminative features that can be used for getting robust inference in real visual scenes. They deal with such tasks as distinguishing different persons in a group, overcome problem with sufficient enclosures of human bodies by the foreground, detect various poses of people. In our work we use a new approach which enables to combine detection and classification tasks into one challenge using convolution neural networks. As a start point we choose YOLO CNN, whose authors propose a very efficient way of combining mentioned above tasks by learning a single neural network. This approach showed competitive results with state-of-the-art models such as FAST R-CNN, significantly overcoming them in speed, which allows us to apply it in real time video surveillance and other video monitoring systems. Despite all advantages it suffers from some known drawbacks, related to the fully-connected layers that obstruct applying the CNN to images with different resolution. Also it limits the ability to distinguish small close human figures in groups which is crucial for our tasks since we work with rather low quality images which often include dense small groups of people. In this work we gradually change network architecture to overcome mentioned above problems, train it on a complex pedestrian dataset and finally get the CNN detecting small pedestrians in real scenes.

A bearing fault diagnosis method based on an improved convolutional neural network(CNN) is proposed to address the problem of low accuracy of traditional convolutional neural network for rolling bearing fault identification. First, the convolutional kernels of the first convolutional layer of the original network are widened to accommodate the bearing fault signal with one-dimensional input. Then, the number of convolutional kernels is reduced while maintaining the feature extraction capability of the network to ensure the deepening of the network while strongly suppressing the overfitting phenomenon of the network. Finally, the batch normalization(BN) layer is added after the convolutional and fully connected layers of the convolutional neural network to accelerate the convergence of the network and prevent the network from gradient disappearance or gradient explosion. Experimental results demonstrate that the proposed method achieves higher diagnostic accuracy and stability than traditional convolutional neural network.

With the development of artificial intelligence, pedestrian detection has become an important research topic in the field of intelligent video surveillance. Fish-eye camera is a useful tool for video monitoring. However, due to the edge distortion of the fish-eye image, which puts higher requirements and challenges on the pedestrian detection technology of fish-eye images. In this paper, an effective method is proposed by rotating cutting to address the problem, a fish-eye image is divided into an edge portion and a center portion. The effectiveness and performance of our method is verified by the traditional pedestrian detection method HOG+SVM and the Faster R-CNN based on convolutional neural network. The experimental results demonstrate the efficacy of the proposed approach, and Faster R-CNN achieves better performance than traditional method.

A new multi-data-driven spatiotemporal PM2.5 forecasting model based on an ensemble graph reinforcement learning convolutional network

Many classical methods have been used in automatic sleep stage classification but few methods explore deep learning. Meanwhile, most deep learning methods require extensive expertise and suffer from a mass of handcrafted steps which are time-consuming. In this paper, we propose an efficient convolutional neural network, Sle-CNN, for five-sleep-stage classification. We attach each kernel in the first layers with a trainable coefficient to enhance the learning ability and flexibility of the kernel. Then, we make full use of the genetic algorithm’s heuristic search and the advantage of no need for the gradient to search for the sleep stage classification architecture. We verify the convergence of Sle-CNN and compare the performance of traditional convolutional neural networks before and after using the trainable coefficient. Meanwhile, we compare the performance between the Sle-CNN generated through genetic algorithm and the traditional convolutional neural networks. The experiments demonstrate that the convergence of Sle-CNN is faster than the normal convolutional neural networks and the Sle-CNN generated by genetic algorithm outperforms the traditional handcrafted counterparts too. Our research suggests that deep learning has a great potential on electroencephalogram signal processing, especially with the intensification of neural architecture search. Meanwhile, neural architecture search can exert greater power in practical engineering applications. We conduct the Sle-CNN with the Python library, Pytorch, and the code and models will be publicly available.

The point source target (PST) can provide high object and image positioning accuracy and is expected to play an important role in the precise geometric processing of optical remote sensing sensors in the future. This paper proposes a method for intelligently recognizing PST image control points (ICPs) from satellite imagery, which can improve the intelligent level of geometric processing of optical remote sensing sensors. Two deep convolutional neural networks (DCNNs), Faster R-CNN and CenterNet are selected to complete the recognition task. Due to the lack of training data, a large number of simulated samples are generated considering the PST image characteristics. The simulated and real PST ICPs are then used to test the trained DCNNs. The two DCNNs complete the recognition task on the simulated dataset successfully. The Recall and Precision values of the two DCNNs are close to 100%. The performance of the two DCNNs on real PST ICPs is worse than that on the simulated data, but the recognition task is also well completed when the quality of PST ICPs is good. The Recall values of both models are above 95%, and the Precision values are close to 100%. Experiment results also show that the performance of CenterNet is better than Faster R-CNN and the image quality has a great impact on the recognition performance.KeywordsPoint source target (PST)Image control point (ICP)Deep convolutional neural networks (DCNNs)Faster R-CNNCenterNet

<p class="Normal1">Medicinal plants have been found and utilized in traditional medical practices from ancient times. Many medicinal plants play a vital role in curating many life threatening diseases. Very few of the medicinal herbs are commercially cultivated. Many plant diseases are there which destroys these medicinal plants. Early detection of plant diseases can prevent the huge loss of these medicinal plants. Here, we presented a hybrid model that makes use of SVM along with the traditional convolutional neural network (CNN) for predicting <em>Basil</em> plants leaves diseases. We transformed the conventional CNN model by adding a classification layer Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) after feature extraction and this approach tends to perform better than traditional CNN as we make the dataset balanced by data augmentation and SVN and KNN tend to perform better in case of balanced samples. CNN is used for training, SVM/KNN is used for classification. The advantages of CNN and SVM are used in proposed the CNN and SVM and KNN model. It is assumed that such a combined model would incorporate the benefits of CNN and SVM. Here, we identified the four types of diseases that affect <em>basil</em> plant leaves as Leaf spot, Downy mildew, Fusarium wilt, Fungal, and Healthy. Since there isn’t a standard dataset for <em>basil</em> leaves, we created our own 803 picture data set and used various machine learning techniques to train and evaluate the model. However, over other existing algorithms, our hybrid model i.e., CNN+SVM has produced more accurate results. For five classes of <em>basil</em> plant leaves, the proposed model produced 95.02% accuracy of for leaf diseases.</p>

In this paper, we will study the basic flow and the principle of state-of-the-art object detection technique (i.e. Faster R-CNN) and improve it further with the inclusion of two strategies into it. Firstly, we propose a multi-layer features merging strategy by using a concatenation layer. Secondly, we introduce a contextual learning scheme for Faster R-CNN. Previously, Faster R-CNN just uses regional features. Contextual features are added with the regional features for the classification and detection task. Our improvement on Faster R-CNN shows promising results. We call our improved Faster R-CNN network as ID-CNN (Intelligent Detection Using Convolutional Neural Network) as its detection accuracy is better. Therefore, we call it as an intelligent detector. We use a deep VGG-16 model as our base model, as Faster R-CNN did. We evaluated our ID-CNN on Pascal VOC public datasets. Experimental results show that ID-CNN can effectively improve the object detection average precision to some extent. On VOC 2007 and 2012, we achieved a mean average precision (mAP) of 74.7% and 71.9%, respectively. ID-CNN is also end-to-end trainable with the same alternating fine-tuning optimization scheme of Faster R-CNN. Finally, we compared ID-CNN with Faster R-CNN on ImageNet object detection dataset and we achieved mAP of 48.1% compared with 46.2% for Faster R-CNN.

Rolling bearing is an essential part of various rotating machines, and its signal is the typical nonlinear signal. Traditional fault diagnosis usually relies on manual experience to extract the features of signals first. Deep convolutional neural networks (DCNN) can make fuller use of time series than traditional convolutional neural networks (CNN). Because of the low accuracy rate, fault diagnosis using gated recurrent unit (GRU) alone is not unsatisfactory. In order to improve the temporality of one-dimensional convolutional neural networks (1D-CNN) and enhance the accuracy of GRU, a novel fault diagnosis method called deep convolutional neural networks - gated recurrent unit (DCNN-GRU) is first put forward, which combines DCNN with GRU. The original signals without preprocessing are input into the DCNN, and the outputs of DCNN are input into the GRU consequently. Then the faults of rolling bearing can be diagnosed effectively. As the post-processing method, the t-distributed stochastic neighbor embedding (t-SNE) method is applied to visualize the fault diagnosis results. Six different network models, including the DCNN-GRU, are used to train the same fault dataset for comparison. The simulation results show that the proposed method can reach more than 99.9% accuracy stably for the given dataset, which can verify the feasibility and effectiveness of proposed method. And the DCNN-GRU can also be verified with good generalization ability using different dataset.

Gait recognition is a noncontact biometric procedure that determines the identity or health status of a person by analyzing his or her walking posture and habits, including skeletal and joint movements. The most remarkable feature of this method is the possibility of conducting recognition without demanding much cooperation from participants. Therefore, this recognition technique has attracted much attention from scholars. Additionally, because of the rapid development of graphics processing unit technology, related hardware and computation performance, the applications of deep-learning technology are considerably enhanced. The objective of this study was to apply a deep neural network (DNN), which employs deep-learning technology, to achieve gait-based automatic pedestrian detection and recognition. In contrast to using wearable devices to precisely capture skeletal and joint movements, pedestrian color-image sequences were used as input in this study. Subsequently, a pretraining convolutional neural network (CNN) was employed to capture pedestrian location and extract pedestrian dense optical flow to serve as concrete low-level feature inputs. Then, a finely-tuned DNN based on the wide residual network was employed to extract high-level abstract features. In addition, to overcome the difficulty of obtaining local temporal features by using a 2D CNN, part of the 3D convolutional structure was introduced into the CNN. This design enabled use of limited memory to acquire more effective features and enhance the DNN performance. The experimental results show that the proposed method has exceptional performance for pedestrian detection and recognition.

本文在传统的依靠RGB通道模板和卷积神经网络的行人检测框架下，提出了结合多通道模板和卷积神经网络的行人检测方法。主要工作是：一是采用运动侦测方法初步检测感兴趣区域，提高行人检测效率和降低虚警。二是采用多通道模板和最大值融合策略，降低单纯依靠RGB通道模板可能存在的行人漏检现象。 In this paper, based on the traditional pedestrian detection framework of RGB channel template and convolution neural network, a pedestrian detection method combining multi-channel tem-plate and convolution neural network is proposed. The main contribution is: firstly, the motion detection method is used to detect the interest area, improve pedestrian detection efficiency and reduce the false alarm. Secondly, multi-channel template and maximum fusion strategy are adopted to reduce the possible pedestrian leakage detection based on RGB channel template.

This composition bargains with the Tomato leaf infection discovery and classification utilizing different strategies like Convolutional Neural Network (CNN), Regions with CNN (R-CNN), Fast R-CNN and Faster R-CNN. The main issue in the agricultural sector is leaf diseases, which have an impact on crop yield and financial gain. Early detection of leaf diseases in plants is essential to prevent losses to the agricultural sector. There are several tomato leaf diseases that affect the crop's leaves, including the Mosaic virus, Early Blight, Healthy, Septoria leaf, and Bacterial spot. Using deep learning algorithms and image processing methods, we can identify the diseases in tomato leaves using developing deep learning approaches. The implementation procedures in our proposed work involves data collection, pre-processing, training, feature extraction, testing, and classification utilising the Visual Geometry Group (VGG 16) to identify damaged or healthy leaves. VGG 16 is incorporated to categorise the leaves as healthy or diseased based on the data and Regression's boundary box method is adopted. Therefore, using Faster RCNN, a model is created to identify and categorise diseases from every image of a tomato leaf that is used as an input, providing a forecast with a considerably greater degree of accuracy. We obtain an accuracy of approximately 98% after fitting the collected features into the neural network over 20 iterations.