LEVERAGING FEEDFORWARD NEURAL NETWORKS FOR IMAGE PROCESSING: AN OVERVIEW AND ANALYSIS

The rise of deep learning has accelerated the application of neural network in image processing. As the nearest neural network model to human biological cell system, spiking neural network (SNN) has shown great potential in image processing and pattern recognition. In this paper, a method of applying spiking neural network to image processing is proposed. Recent advances in neuroanatomy have provided favorable conditions for the application of local connections. By analyzing the connection modes of different sparsity of spiking neurons in space, spiking neural network can effectively perform robust image processing tasks. The experiment shows that the pre-set spiking neural network can acquire image features quickly and effectively without training.

Single-hidden-layer feed-forward quantum neural network based on Grover learning

This paper describes that under certain operations, the parallel pulse transmission behavior of unit-linking PCNN (pulse coupled neural network) for image processing, which we have developed from PCNN based on biological experimental results, is equal to the open operation of mathematic morphology. The open operation of unit-linking PCNN based on its parallel pulse transmission behavior can be efficiently used for image processing, such as reducing the pulse noise of binary images. A new pulse-noise-reducing approach based on the open operation of unit-linking PCNN is proposed in this paper. The results of computer simulations show that the visual effects of retrieval images of binary pulse-noise images based on the open operation of unit-linking PCNN are better than those based on the median filter, a tradition approach for reducing image pulse noise. For binary images polluted by any other kinds of noise, such as white Guassian noise, after having turned the original noisy images into binary noisy images, using the approach proposed in this paper also can reduce the noise. This paper bridges the gap between image processing based on mathematical morphology and image processing based on unit-linking PCNN.

In today’s world, the need for computers and their logics is critical for the development of any system. This paper is for those people who have little or no knowledge about Artificial Neural Networks (ANNs). Various advances have been made in creating intelligent systems, some enlivened by biological neural networks. Analysts from numerous logical orders are outlining artificial neural networks (ANNs) to take care of a variety of problems in design recognition, prediction, optimization, associative memory, and control. And will be discussing some of the algorithms of ANNs such as image segmentation using edge detection, image enhancement using multiscale retinex and technique combining sharpening and noise reduction and some practical applications such as diagnosing liver disease and face detection systems.

Presents experimental results which show that feedforward neural networks are suitable for analog IC fault diagnosis. The results suggest that feedforward networks provide a cost-efficient method for IC fault diagnosis in large-scale production. The authors compare the diagnostic accuracy and the computational requirements of a simple feedforward network against that of Gaussian maximum likelihood and K-nearest neighbors classifiers. The feedforward network was found to provide an order-of-magnitude improvement in diagnostic speed while consistently performing as well as or better than any of the other classifiers in terms of accuracy.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

A feed forward neural network (FFNN) is developed for tropical cyclone (TC) intensity prediction, where intensity is defined as the maximum 1-min average 10-m wind speed. This deep learning model incorporates a real-time operational estimate of the current intensity and predictors derived from Hurricane Weather Research and Forecasting (HWRF; 2017 version) Model forecasts. The FFNN model is developed with the operational constraint of being restricted to 6-h-old HWRF data. Best track intensity data are used for observational verification. The forecast training data are from 2014 to 2016 HWRF reforecast data and cover a wide variety of TCs from both the Atlantic and eastern Pacific Ocean basins. Cross validation shows that the FFNN increasingly outperforms the operational observation-adjusted HWRF (HWFI) in terms of mean absolute error (MAE) at forecast lead times from 3 to 57 h. Out-of-sample testing on real-time data from 2017 shows the HWFI produces lower MAE than the FFNN at lead times of 24 h or less and similar MAEs at later lead times. On the other hand, the 2017 data indicate significant potential for the FFNN in the prediction of rapid intensification (RI), with RI defined here as an intensification of at least 30 kt (1 kt ≈ 0.51 m s−1) in a 24-h period. The FFNN produces 4 times the number of hits in HWFI for RI. While the FFNN has more false alarms than the HWFI, Brier skill scores show that, in the Atlantic, the FFNN has significantly greater skill than the HWFI and probabilistic Statistical Hurricane Intensity Prediction System RI index.

Objective.Major depressive disorder (MDD) is a widespread mental disorder that affects health. Many methods combining electroencephalography (EEG) with machine learning or deep learning have been proposed to objectively distinguish between MDD and healthy individuals. However, most current methods detect depression based on multichannel EEG signals, which constrains its application in daily life. The context in which EEG is obtained can vary in terms of study designs and EEG equipment settings, and the available depression EEG data is limited, which could also potentially lessen the efficacy of the model in differentiating between MDD and healthy subjects. To solve the above challenges, a depression detection model leveraging transfer learning with the single-channel EEG is advanced.Approach.We utilized a pretrained ResNet152V2 network to which a flattening layer and dense layer were appended. The method of feature extraction was applied, meaning that all layers within ResNet152V2 were frozen and only the parameters of the newly added layers were adjustable during training. Given the superiority of deep neural networks in image processing, the temporal sequences of EEG signals are first converted into images, transforming the problem of EEG signal categorization into an image classification task. Subsequently, a cross-subject experimental strategy was adopted for model training and performance evaluation.Main results.The model was capable of precisely (approaching 100% accuracy) identifying depression in other individuals by employing single-channel EEG samples obtained from a limited number of subjects. Furthermore, the model exhibited superior performance across four publicly available depression EEG datasets, thereby demonstrating good adaptability in response to variations in EEG caused by the context.Significance.This research not only highlights the impressive potential of deep transfer learning techniques in EEG signal analysis but also paves the way for innovative technical approaches to facilitate early diagnosis of associated mental disorders in the future.

In this paper, a fault tolerant CNN (cellular neural network) using a small world network connection for image processing in embedded systems is described. In embedded systems, there are problems such as compactness, power consumption, reliability and speed, so new processor architecture is required. In this paper, we apply a small world network connection to cellular neural networks. The small world network features small links to the destination from the place of origin using local connection information of a random nature. The concept is derived from sociology. We then provide neural image processing algorithms suitable for CNN with the small world network model. Special attention has been given to typical neural algorithms for image processing, such as noise reduction and edge extraction. Further, we are proposing a fault tolerant architecture for the CNN, using majority voting.

Ultrasound (US) imaging is the initial phase in the preliminary diagnosis for the treatment of kidney diseases, particularly to estimate kidney size, shape and position, to give information about kidney function, and to help in diagnosis of abnormalities like cysts, stones, junctional parenchyma and tumors which is shown in Figs. 7–9. This study proposes Grey Level Co-occurrence Matrix (GLCM)-based Probabilistic Principal Component Analysis (PPCA) and Artificial Neural Network (ANN) method for the classification of kidney images. Grey Wolf Optimization (GWO) is used to update the current positions of abnormal kidney images in the discrete searching space, thus getting the optimal feature subset for better classification purposes based on Feed Forward Neural Network (FFNN). The scanned image is pre-processed and the required features are extracted by GLCM, among those, some features are selected by PPCA. Feed Forward Back propagation Neural Network (FFBN) is used to classify the normalities and abnormalities in the part of kidney images. The proposed methodology is implemented in MATLAB platform and the analyzed result produces 98% accuracy using GWO-FFBN technique.

The adoption of wind energy has grown significantly in recent years. New, cost-effective technologies have been developed, led by customer awareness of green technologies and a legal framework proposed at the European Union level. The stochastic nature of wind speed is transferred to wind turbine output, making wind energy difficult to predict. The main scope of predicting wind energy production is to be proactive in balancing and reserving energy to meet demand. When the prediction identifies a potential gap between supply and demand, additional energy from other sources must be generated and supplied. Creating a synergy of physical devices through advanced sensing capabilities, software, storage and analytics capabilities, the Industrial Internet of Things is enabling the effective transition to wind energy through automation by removing many of the disadvantages in a way that has recently become accessible. This research focuses on the data analytics, proposing a fast univariate network-based approach for wind energy prediction, using Feed Forward Neural Networks, Recurrent Neural Networks, Long-Short Term Memory, Gated Recurrent Unit, and Convolutional Neural Networks. Moreover, by introducing the theoretical fundamentals, the implementation method and the hyperparameters of the final models, this article becomes unique in the context of wind energy. At the time of this study, no prior research studies have presented a direct comparison between feedforward, recurrent, and convolutional neural networks ? these being the most important in the field of supervised learning.

This study aims to analyze the effects of noise, image filtering, and edge detection techniques in the preprocessing phase of character recognition by using a large set of character images exported from MNIST database trained with various sizes of neural networks. Canny edge detection algorithm was deployed to smooth the edges of the images while the Sobel edge detection algorithm was used to detect the edges of the images. Skeletonization algorithm was applied to re-shape the structural shapes. In the context of the image filtering, the Laplacian filter was utilized to enhance the images and High pass filtering was used to highlight the fine details in blurred images. Gaussian noise, image noise with Gaussian intensity, function in Matlab with the probability density function P was deployed on character images of MINST. Pattern recognition neural networks are widely used in optical character recognition. Feedforward neural networks are deployed in this study. A comprehensive analysis of the above-mentioned image processing techniques is included during character recognition. Improved accuracy is observed with character recognition during the prediction phase of the neural networks. A sample of unknown characters is tested with the application of High pass filtering + feedforward neural network and 89%, the highest, average output prediction accuracy was obtained. Other prediction accuracies were also tabulated for the reader’s attention.

In present days, real time navigation depends on Kalman filter to fuse data from Global Positioning System (GPS) and Inertial Navigation System (INS). But there exist drawbacks like long design time, requirement of prior knowledge in fusing data from GPS and INS using Kalman Filter. In order to overcome the drawbacks of Kalman filter, GPS and INS integration are done using Artificial Neural Networks (ANN) like FFNNs. But still there exists certain drawbacks like less accuracy in FFNNs for GPS and INS data integration. Therefore, this paper introduces Higher Order Neural Networks (HONNs) approach for INS and GPS data integration to overcome the drawback. A higher order feed forward neural network architecture with optimum number of nodes is used. In the given architectures, the replacement of summation at each node by multiplication results in more powerful mapping, because of its capability of processing higher-order information from training data. Performance comparison of HONNs with FFNNs shows that the proposed architecture provides satisfactory results in terms of error rate and number of epochs. The HONNs like Multiplicative Neural Network (MNN) module and Sigma-Pi-ANN module and Traditional Feed Forward Neural Networks(FFNNs) like Radial Basis Function Neural Network (RBF) module and Back propagation Neural Network (BPN) module are trained to predict the INS position error and provide accurate position of the moving aircrafts. Sigma-Pi ANN is found to be the best in terms of accuracy, number of epochs and execution time among the two HONNs.

Reliability estimation of electric parts by using CCD camera and neural network is described. Breakdown of carbon film resistors in reliability test is estimated from image features by feedforward neural network. In general, degradation of electric device should be detected for constantaneous operation of every machines. Image processing techniques plays an important role in many engineering applications, developments and more efficient quality control. This paper describes some experimental results on reliability estimation using a neural network and image processing for reliability test. Performance degradation of carbon film resistor is estimated from their colour images. By using the sequence of images of the tested carbon filmed resistors, we attempt to find an appropriate estimated fault time for tested carbon film resistors, in order to establish a convinient method for reliability estimation. We first discuss some essential issues to be considered in reliability problems. It is shown that the image processing and neural network approach give a good results compared with real measured results. Furthermore, the efficiency of the method is indicated by applying to image data for calculation of mean time to failure.

On the Circuit Complexity of Sigmoid Feedforward Neural Networks

The global increase in greenhouse gas emissions from automobiles has brought about the manufacture and usage of large quantities of electric vehicles (EVs). However, to ensure proper integration of EVs into the grid, there is a need to forecast the charging demand of EVs accurately. This paper presents a short-term electric vehicle charging demand forecast using a feedforward artificial neural network optimized with a modified local leader phase spider monkey optimization (MLLP-SMO) algorithm, a proposed variant of spider monkey optimization. A proportionate fitness selection is employed to improve the update process of the local leader phase of the spider monkey optimization. The proposed algorithm trains a feedforward neural network to forecast electric vehicle charging demand. The effectiveness of the proposed forecasting model was tested and validated with electric vehicle public charging data from the United Kingdom Power Networks Low Carbon London Project. The model's performance was compared to a feedforward neural network trained with particle swarm optimization, genetic algorithm, classical spider monkey optimization, and two conventional forecasting models, multi-linear regression and Monte Carlo simulation. The performance of the proposed forecasting model was assessed using the mean absolute percentage error of forecast and forecasting accuracy. The model produced a forecast accuracy and mean absolute percentage error of 99.88% and 3.384%, respectively. The results show that MLLP-SMO as a trainer predicted better than the other forecasting models and met industry standard forecast accuracy.