Automatic black and white film colorization using texture features and artificial neural networks

State estimation is used currently in wide area electrical systems for real time analysis. Studies have shown that in HV transmission networks, where system-wide synchronized phasor measurement units are installed, voltage angle measurements can be included in the input measurements data set, with the result of improving the estimation precision. The authors developed in previous papers a SE algorithm based on Multilayer Perceptron Artificial Neural Networks. This paper extends this research by using PMU voltage magnitude and angle measurements in the input data for the ANN estimator, and shows in a case study that the estimation precision is improved. The development of advanced electricity markets in Europe and North America changed the operation and dispatch rules of power systems. In the United States and Canada, the ISO/RTO model is used to manage grid operation for approximately a half of North American Continent (1), while in Europe continuous efforts are made for coupling the national and regional electricity markets into a common market, markets supplying 75% of the demand using now a common day-ahead price mechanism and cross-border capacity management (2). High-performance tools are required for real time monitoring and control of such large systems. Enhanced state estimation (SE) algorithms are robust tools used today by system operators. Phasor measurement units (PMU) are used for synchronizing measurements used in state estimation analyses for systems covering wide geographical territories (3), and the trend is to generalize their deployment also at distribution level (4,5). Other approaches use distributed estimation, by splitting one large system in several areas estimated locally (6). The two approaches can be also combined (7). Recent research also use artificial neural networks (ANN) for state estimation (8,9). The authors proposed in (10) a SE approach which uses Multilayer Perceptron (MLP) artificial neural networks. A case study performed on a section of the Romanian HV distribution system was carried out, and the estimation results have shown a good precision. This paper extends the study by including PMU measurements into the measurement input set to improve the previous estimation results. The expected results are the improvement of estimation, a behaviour similar to classic algorithms.

Image retrieval is the process of finding images in the database that are similar to the query image by measuring how close the feature values of the query image are to other images. Image retrieval is currently dominated by approaches that combine several different representations or features. The optimal weight of each feature is needed in combining the image features such as color features, texture features, and shape features. In this study, we use a multi-layer perceptron artificial neural network (MLP) method to obtain feature weights automatically and simultaneously look for optimal weights. The color moment is used to find nine color features, Gray Level Co-occurrence Matrix (GLCM) to find four texture features, and Hu Moment to find seven shape features totaling 20 neurons and all of these features become the input layer in our MLP network. Three neurons in output layers become the automatic weight of each feature. These weights are used to combine each feature's role in obtaining the relevant image. Euclidean Distance is used to measure similarity. The average precision values obtained using automatic feature weights are 93.94% for the synthetic dataset, 91.19% for the Coil-100 dataset, and 54.31% for the Wang dataset. These results have an average difference of 5.06% with the target so automatic feature weighting works well. This value is obtained at a hidden layer size of 11 and a learning rate of 0.1. In addition, the use of automatic feature weighting gives more accurate results compared to manual feature weighting.

An artificial neural network (ANN) model was developed to monitor the density of rigid foam PVC on-line during the extrusion process using an ultrasound sensor mounted on the extruder die. Acoustic properties of the polymer melt, measured by multiple ultrasound echoes propagating through the polymer melt, were used to train a multilayer perceptron (MLP) artificial neural network to estimate the density of the extruded foam. The foam density was varied by varying the processing conditions, i.e. heating zones and screw speed, during the extrusion process. A high correlation was found to exist between the acoustic properties of the polymer melt and the foam density using a three-layer multilayer perceptron artificial neural network.

The relationships between physico-chemical and rheological properties are considered complex nonlinear systems. Thus, the artificial neural network (ANN) and regression models were used for the rheological characterization of Brazilian honeys, based on low-cost measurements of water content and temperature. The steady shear viscosity (η) performed well when measured in the test phase in a 2-12-1 neuron multilayer perceptron (MLP) ANN (model 1) with a root mean square error (RMSE) and correlation coefficient (r) equal to 0.0430 and 0.9681, respectively. The parameter loss modulus (G″), storage modulus (G′) and complex viscosity (η*) were predicted in the temperature sweep test by small amplitude oscillatory shear (SAOS) measurements during heating and cooling, and the MLP ANNs with architectures of 2-9-3 (model 2) and 2-3-3 (model 3) showed RMSE values equal to 0.0261 and 0.0387 in the test phase, respectively. For all the determined parameters, non-linear exponential models showed similar results to models 1, 2 and 3. An ANN with 3-9-3 architecture (model 4) showed RMSE and r for G′ equal to 0.0158 and 0.7301, for G″ equal to 0.0176 and 0.9581, and for η* equal to 0.0407 and 0.9647, respectively, in the test phase for date of the frequency sweep test obtained by SAOS. These results were far superior to those obtained by second-order multiple linear models. The acquisition of all models is an important application for the processing of honey and honey-based products, since these properties are essential in engineering calculations and quality control of products.

In recent years, artificial intelligence has been widely used in the field of meteorology. However, it is perhaps less known that AI-based tools have been used for over 30 years in the modeling of pollutant dispersion in the atmosphere.In the early 1990s, Slovenia and other parts of Europe faced significant air pollution problems caused by SO₂ emissions from coal-fired power plants without desulfurization systems. Due to the highly complex terrain, simple physical Gaussian dispersion models were not suitable for reconstructing the dispersion of SO₂ in the atmosphere, while complex numerical Lagrangian particle dispersion models were still in development.Therefore, as early as 1992, we modeled air pollution using a Multilayer Perceptron Artificial Neural Network (MLPANN). We developed the world's first comprehensive method for selecting training samples, features, and the topology of the neural network, enabling the model to learn from measured meteorological variables and pollutant concentrations around the power plant to predict SO₂ concentrations at a selected location in advance.This type of artificial neural network remains the foundation for various derived structures used for machine learning from data even today.In the following decades, we expanded the use of MLPANN to ozone prediction. Researchers from other Slovenian research groups also worked on this topic. Meanwhile, the use of these and similar tools in pollutant dispersion modelling began to grow on a global scale.Together with Brazilian researchers, we successfully applied MLPANN for predicting diffuse solar radiation. In this field, we also managed to develop a spatially transferable model, which is not a common capability for artificial neural network-based models.For the classification of wind fields based on measurements from ground-based meteorological stations, we used a Kohonen neural network.Later, we added another tool called "Gaussian processes" (which, like MLPANN, is a universal approximator) and the tool "decision trees." We expanded the use to point-based forecasting of basic meteorological variables. In recent years, with high computational capabilities available even without supercomputers, we have been using these tools for surrogate models that can represent or predict pollutant concentration fields in the atmosphere, not only for individual points but for entire areas around pollution sources.Other Slovenian groups from Slovenian Meteorological Agency, the Department of Meteorology, and the Faculty of Computer Science have, in recent years, used machine learning for global medium-range forecasts of daily averages of meteorological variables and for post-processing weather forecasts from physical models.In the presentation, we will explain the basic principles of building models based on artificial neural networks in a way that is understandable to laypeople. For experts in the field, we will showcase numerous examples of their application. For the latter group, we hope these examples will inspire others to expand the use of these modern tools even further.

Regional modeling of the ionosphere using adaptive neuro-fuzzy inference system in Iran

Super-resolution reconstruction of noisy gas-mixture absorption spectra using deep learning

Skin color is a robust cue in human skin detection. It has been widely used in various human-related image processing applications. Although many researches have been carried out for skin color detection, there is no consensus on which color space is the most appropriate for skin color detection because many researchers do not provide strict justification of their color space choice. In this paper, a comprehensive comparative study using the Multilayer Perceptron artificial neural network (MLP), which is a universal classifier, is carried out to evaluate the overall performance of different color-spaces for skin detection. It aims at determining the most optimal color space using color and color-texture features separately. The study has been carried out using images of different databases. The experimental results showed that the YIQ color space gives the highest separability between skin and non-skin pixels among the different color spaces tested using color features. Combining color and texture eliminates the differences between color spaces but leads to much more accurate and efficient skin detection.

An approach towards building robust neural networks models using multilayer perceptron through experimentation on different photovoltaic thermal systems

Considering that damages and forces to the fruit cause quantitative and qualitative changes in the fruit, in this study, the effects of three levels of loading force (wide and thin edges) (15, 30, and 45 N), 2 fixed positions on the Instron fixed jaw (vertical and horizontal), and 3 storage periods on Hayward kiwi were investigated. Experiments were analyzed as a completely randomized factorial design using SAS statistical software and data were analyzed for prediction using a multilayer perceptron artificial neural network. Statistical results showed that weight, volume, and density of kiwi fruit were decreased for loading of wide and thin edges, and according to the results, it can be concluded that weight loss in wide edge loading was more than loading of thin edges. Also, the weight, volume, and density of the fruit decreased significantly when the fruit was extensively loaded. For neural networks the best R value for weight, volume, and density were 0.9992, 0.99840, and 0.997, respectively, and for RMSE which should be the lowest among the networks, 0.22584, 3091.13 and 0.0049, respectively. Overall, it can be stated that the neural network was capable of predicting weight, volume, and density for both types of loading. But for the wide edge, equivalent, geometric, and arithmetic diameters, and for the thin edge of the aspect ratio and rationality coefficient have had a far greater impact on artificial neural network improvement and data prediction. In brief, for loading the thin edge of the network with loading force input, storage period, loading direction, spherical coefficient, spherical coefficient, aspect ratio coefficient, length, width, and thickness (network 2) and for loading wide edge, loading force, storage period, loading direction, equivalent diameter, geometric diameter, arithmetic diameter, length, width, and thickness were the best in terms of accuracy and error.

• The hourly wind speed prediction is an important problem. • A feed-forward (FF) multi-layer perceptron (MLP) artificial neural network (ANN) is used for prediction. • The FF MLP ANN is optimized by 9 state-of-art metaheuristic algorithms. • In the experiments, 38 years of hourly wind data belonging to 5 cities were used. • Grey Wolf Optimizer produced best results in terms of mean square error (MSE). The growing population has tremendously increased the daily energy demand all around the world. India is the second-most crowded nation in the world with approximately 1.4 billion people. New and renewable energy is on the agenda of India and in 2021 India possesses the fourth-largest installed capacity of wind power. Accurate prediction of wind speed is vital in wind farm design and operation. In this work, an hourly wind speed prediction with an artificial neural network optimized by a metaheuristics approach is conducted. A feed-forward (FF) multi-layer perceptron (MLP) artificial neural network (ANN) is used for the prediction of the hourly wind speed. In this study, 38 years of hourly wind data belonging to 5 cities (Ambur, Hosur, Kumbakonam, Nagapattinam, and Pudukottai) were used. These cities have different specific properties such as latitude, longitude, and altitude. The FF MLP ANN is optimized by 9 state-of-art metaheuristic algorithms. In this work, Artificial Bee Colony (ABC), Ant Colony Optimization (ACO), Biogeography Based Optimization (BBO), Evolutionary Strategy (ES), Genetic Algorithm (GA), Grey-Wolf-Optimizer (GWO), Population-Based Incremental Learning (PBIL), Particle Swarm Optimization (PSO), Tree-Seed Algorithm (TSA) have been used to optimize the weights of the ANN. GWO outperforms other metaheuristic algorithms in the prediction of wind speed with a FF MLP ANN model, with a success percentage rate of approximately 3% to 10,000%.

The evolution of machine learning (ML) algorithms provides researchers and engineers with state-of-the-art tools to dynamically model complex relationships. The design and operation of municipal solid waste (MSW) management systems require accurate estimation of generation rates. In this study, we applied rapid, non-linear and non-parametric data driven ML algorithms independently, multi-layer perceptron artificial neural network (MLP-ANN) and support vector regression (SVR) models to predict annual MSW generation rates in Bahrain. Models were trained and tested with MSW generation data for period of 1997-2019. The population, gross domestic product, annual tourist numbers, annual electricity consumption and total annual CO2 emissions were selected as explanatory variables and incorporated into developed models. The zero score normalization (ZSN) and minimum maximum normalization (MMN) methods were utilized to improve the quality of data and subsequently enhances the performance of ML algorithms. Statistical metrics were employed to discriminate performance of MLP-ANN and SVR models. The linear, polynomial, radial basis function (RBF) and sigmoid kernel functions were investigated to find the optimal SVR model. Results showed that RBF-SVR model with R2 value of 0.97% and 4.82% and absolute forecasting error (AFE) for the period of 2008 and 2019 exhibits superior prediction and robustness in comparison to MLP-ANN. The efficacy of MLP-ANN model was also reasonably successful with R2 value of 0.94. It was shown that MMN pre-processing generated optimal MLP-ANN model while ZSN pre-processing produced optimal RBF-SVR model. This work also highlights the importance of application of ML modelling approaches to plan and implement their roadmap for waste management systems by policymakers.

The purpose of this study is to assess the vulnerability of urban blocks to earthquakes for Tehran as a city built on geological faults using an artificial neural network—multi-layer perceptron (ANN-MLP). Therefore, we first classified earthquake vulnerability evaluation criteria into three categories: exposure, sensitivity, and adaptability capacity attributed to a total of 16 spatial criteria, which were inputted into the neural network. To train the neural network and compute an earthquake vulnerability map, we used a combined Multi-Criteria Decision Analysis (MCDA) process with 167 vulnerable locations as training data, of which 70% (117 points) were used for training, and 30% (50 points) were used for testing and validation. The Mean Average Error (MAE) of the implemented neural network was 0.085, which proves the efficacy of the designed model. The results showed that 29% of Tehran’s total area is extremely vulnerable to earthquakes. Our factor importance analysis showed that factors such as proximity to fault lines, high population density, and environmental factors gained higher importance scores for earthquake vulnerability assessment of the given case study. This methodical approach and the choice of data and methods can provide insight into scaling up the study to other regions. In addition, the resultant outcomes can help decision makers and relevant stakeholders to mitigate risks through resilience building.

The main purpose of this contribution is to develop realistic prediction digital soil maps in order to increase their visuality, and to evaluate and compare the performance of different modeling techniques: a) Kriging, b) Artificial Neural Network – Multilayer Perceptron (ANN-MLP) and c) Multiple Polynomial Regressions (MPR). The following criteria were used to determine selection of the testing site for the modeling: (1) intensive metal ore mining and metallurgical processing; (2) geomorphological natural features; (3) regular geological setting, and (4) the remaining minefields. The success of Digital Soil Mapping and the plausibility of prediction maps increases with the availability of spatial data, the availability of computing power for processing data, the development of data-mining tools, geographical information systems (GIS) and numerous applications beyond geostatistics. Advanced prediction modeling techniques, ANN-MLP and MPR include geospatial parameters sourced from Digital Elevation Models (DEM), land use and remote sensing, applied in combination with costly and time-consuming soil measurements, developed and finally incorporated into the models of spatial distribution in the form of 2D or 3D maps. Innovative approaches to modeling assist us in the reconstruction of different processes that impact the entire study area, simultaneously. This holistic approach represents a novelty in contamination mapping and develops prediction models to help in the reconstruction of main distribution pathways, to assess the real size of the affected area as well as improving the data interpretation.

Near-infrared (NIR) spectroscopy for motor oil classification: From discriminant analysis to support vector machines