<title>Support vector machines for broad-area feature classification in remotely sensed images</title>

Bond rating is regarded as an important event for measuring financial risk of companies and for determining the investment returns of investors. As a result, it has been a popular research topic for researchers to predict companies' credit ratings by applying statistical and machine learning techniques. The statistical techniques, including multiple regression, multiple discriminant analysis (MDA), logistic models (LOGIT), and probit analysis, have been traditionally used in bond rating. However, one major drawback is that it should be based on strict assumptions. Such strict assumptions include linearity, normality, independence among predictor variables and pre-existing functional forms relating the criterion variablesand the predictor variables. Those strict assumptions of traditional statistics have limited their application to the real world. Machine learning techniques also used in bond rating prediction models include decision trees (DT), neural networks (NN), and Support Vector Machine (SVM). Especially, SVM is recognized as a new and promising classification and regression analysis method. SVM learns a separating hyperplane that can maximize the margin between two categories. SVM is simple enough to be analyzed mathematical, and leads to high performance in practical applications. SVM implements the structuralrisk minimization principle and searches to minimize an upper bound of the generalization error. In addition, the solution of SVM may be a global optimum and thus, overfitting is unlikely to occur with SVM. In addition, SVM does not require too many data sample for training since it builds prediction models by only using some representative sample near the boundaries called support vectors. A number of experimental researches have indicated that SVM has been successfully applied in a variety of pattern recognition fields. However, there are three major drawbacks that can be potential causes for degrading SVM's performance. First, SVM is originally proposed for solving binary-class classification problems. Methods for combining SVMs for multi-class classification such as One-Against-One, One-Against-All have been proposed, but they do not improve the performance in multi-class classification problem as much as SVM for binary-class classification. Second, approximation algorithms (e.g. decomposition methods, sequential minimal optimization algorithm) could be used for effective multi-class computation to reduce computation time, but it could deteriorate classification performance. Third, the difficulty in multi-class prediction problems is in data imbalance problem that can occur when the number of instances in one class greatly outnumbers the number of instances in the other class. Such data sets often cause a default classifier to be built due to skewed boundary and thus the reduction in the classification accuracy of such a classifier. SVM ensemble learning is one of machine learning methods to cope with the above drawbacks. Ensemble learning is a method for improving the performance of classification and prediction algorithms. AdaBoost is one of the widely used ensemble learning techniques. It constructs a composite classifier by sequentially training classifiers while increasing weight on the misclassified observations through iterations. The observations that are incorrectly predicted by previous classifiers are chosen more often than examples that are correctly predicted. Thus Boosting attempts to produce new classifiers that are better able to predict examples for which the current ensemble's performance is poor. In this way, it can reinforce the training of the misclassified observations of the minority class. This paper proposes a multiclass Geometric Mean-based Boosting (MGM-Boost) to resolve multiclass prediction problem. Since MGM-Boost introduces the notion of geometric mean into AdaBoost, it can perform learning process considering the geometric mean-based accuracy and errors of multiclass. This study applies MGM-Boost to the real-world bond rating case for Korean companies to examine the feasibility of MGM-Boost. 10-fold cross validations for threetimes with different random seeds are performed in order to ensure that the comparison among three different classifiers does not happen by chance. For each of 10-fold cross validation, the entire data set is first partitioned into tenequal-sized sets, and then each set is in turn used as the test set while the classifier trains on the other nine sets. That is, cross-validated folds have been tested independently of each algorithm. Through these steps, we have obtained the results for classifiers on each of the 30 experiments. In the comparison of arithmetic mean-based prediction accuracy between individual classifiers, MGM-Boost (52.95%) shows higher prediction accuracy than both AdaBoost (51.69%) and SVM (49.47%). MGM-Boost (28.12%) also shows the higher prediction accuracy than AdaBoost (24.65%) and SVM (15.42%)in terms of geometric mean-based prediction accuracy. T-test is used to examine whether the performance of each classifiers for 30 folds is significantly different. The results indicate that performance of MGM-Boost is significantly different from AdaBoost and SVM classifiers at 1% level. These results mean that MGM-Boost can provide robust and stable solutions to multi-classproblems such as bond rating.

The Sixth International Symposium on Neural Networks (ISNN 2009)

The inclusion in workplaces of video display terminals has brought multiple benefits for the organization of work. Nevertheless, it also implies a series of risks for the health of the workers, since it can cause ocular and visual disorders, among others. In this research, a group of eye and vision-related problems associated with prolonged computer use (known as computer vision syndrome) are studied. The aim is to select the characteristics of the subject that are most relevant for the occurrence of this syndrome, and then, to develop a classification model for its prediction. The estimate of this problem is made by means of support vector machines for classification. This machine learning technique will be trained with the support of a genetic algorithm. This provides the training of the support vector machine with different patterns of parameters, improving its performance. The model performance is verified in terms of the area under the ROC curve, which leads to a model with high accuracy in the classification of the syndrome.

Smoothing methods, extensively used for solving important mathematical programming problems and applications, are applied here to generate and solve an unconstrained smooth reformulation of the support vector machine for pattern classification using a completely arbitrary kernel. We term such reformulation a smooth support vector machine (SSVM). A fast Newton–Armijo algorithm for solving the SSVM converges globally and quadratically. Numerical results and comparisons are given to demonstrate the effectiveness and speed of the algorithm. On six publicly available datasets, tenfold cross validation correctness of SSVM was the highest compared with four other methods as well as the fastest. On larger problems, SSVM was comparable or faster than SVMlight (T. Joachims, in Advances in Kernel Methods—Support Vector Learning, MIT Press: Cambridge, MA, 1999), SOR (O.L. Mangasarian and David R. Musicant, IEEE Transactions on Neural Networks, vol. 10, pp. 1032–1037, 1999) and SMO (J. Platt, in Advances in Kernel Methods—Support Vector Learning, MIT Press: Cambridge, MA, 1999). SSVM can also generate a highly nonlinear separating surface such as a checkerboard.

Recently, there has been a remarkable growth in Artificial Intelligence (AI) with the development of efficient AI models and high-power computational resources for processing complex datasets. There has been a growing number of applications of machine learning in satellite remote sensing image data processing. In this work, machine learning methods were applied for crop classification of temporal multi- spectral satellite image to achieve better prediction of crop-wise area statistics. In India, agriculture has a huge impact on the national economy and most of the critical decisions are dependent on agricultural statistics. Sentinel-2 satellite image data for the Guntur district region of Andhra Pradesh, India has been used as the study area. The main reason for selecting this region is the diversity of agricultural crops and the availability of ground truth. As a baseline, the performance of machine learning models like Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT), and K-Nearest Neighbor (KNN) on crop classification was evaluated on 2016 single time multi-spectral satellite image. SVM performed well with an F1 score of 0.94. Further, the performance of SVM, RF, 1D and 2D Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) and RNN with Gated Recurrent Unit (GRU) on 2018 Kharif season temporal multi-spectral satellite image has been evaluated for estimation of crop areas. The results show that SVM has the best F1 score of 0.99 and achieved a 95.9% agreement with the ground surveyed crop areas.

Support vector machine (SVM) is gaining much popularity as a powerful machine learning technique. SVM was originally developed for pattern classification and later extended to regression. One of main features of SVM is that it generalizes the maximal margin linear classifiers into high dimensional feature spaces through nonlinear mappings defined implicitly by kernels in the Hilbert space so that it may produce nonlinear classifiers in the original data space. On the oilier hand, the authors developed a family of various SVMs using multi-objective programming and goal programming (MOP/GF) techniques. This paper extends the family of SVM for classification to regression, and discusses their performance through numerical experiments.

Invasive plants are causing massive economic and environmental troubles for our societies worldwide. The aim of this study is to employ a set of machine learning classifiers for detecting invasive plant species using remote sensing data. The target species is Kudzu vine, which mostly grows in the south-eastern states of the US and quickly outcompetes other plants, making it a relevant and threatening species to consider. Our study area is Atlanta, Georgia and the surrounding area. Five different algorithms: Boosted Logistic Regression (BLR), Naive Bayes (NB), Neural Network (NN), Random Forest (RF) and Support Vector Machine (SVM) were tested with the aim of testing their performance and identifying the most optimal one. Furthermore, the influence of temporal, spectral and spatial resolution in detecting Kudzu was also tested and reviewed. Our finding shows that random forest, neural network and support vector machine classifiers outperformed. While the achieved internal accuracies were about 97%, an external validation conducted over an expanded area of interest resulted in 79.5% accuracy. Furthermore, the study indicates that high accuracy classification can be achieved using multispectral Sentinel-2 imagery and can be improved while integrating with airborne visible/infrared imaging spectrometer (AVIRIS) hyperspectral data. Finally, this study indicates that dimensionality reduction methods such as principal component analysis (PCA) should be applied cautiously to the hyperspectral AVIRIS data to preserve its utility. The applied approach and the utilized set of methods can be of interest for detecting other kinds of invasive species as part of fulfilling UN sustainable development goals, particularly number 12: responsible consumption and production, 13: climate action, and 15: life on land.

Lithological mapping using satellite images, particularly hyperspectral data, helps in effectively defining the best initial targets for regional exploration. In this study, ZY1-02D hyperspectral image (HSI) data with moderate spectral and very high spatial resolution were employed for lithological mapping using spectral indices along with support vector machine (SVM) machine learning and spatial–spectral transformer (SSTF) deep learning methods in the Kohat–Pothohar Plateau at the eastern edge of the Main Boundary Thrust (MBT) in Pakistan. The research was accomplished using spectral profiles of minerals accompanied by false color composite (FCC), principal component analysis (PCA), SVM, and SSTF methods for classifying the main lithological units. The lithological discrimination map derived from the ZY1-02D data matched well with the known deposits and field inspections. The principal component analysis (PCA) obtained the highest eigenvalues and provided a significant discrimination of lithologies, particularly with hyperspectral data. The results revealed lithological units, three of which contained limestone and gypsum, while other lithological units were defined as sandstone, clay, and conglomerates. Field investigation and laboratory sample analysis through X-ray diffraction (XRD), photomicrographs, and spectral analysis confirmed the occurrence of limestone, gypsum, and sandstone, which are useful in identifying lithological units in the study area. This study will assist in more accurate geological discrimination and play a vital role in identifying oil and gas reservoirs, coal, gypsum, uranium, salt, and limestone deposits. Furthermore, the results of the SVM and SSTF techniques were quantitatively compared with the geological boundaries mapped in the field, showing an accuracy of nearly 89.7% and 92.1%, respectively. Overall, the methodology adopted showed great performance and strong potential for mapping alteration areas and lithological discriminations applied on the ZY1-02D hyperspectral data.

Breast cancer is among the leading causes of cancer death among women. The occurrence of breast cancer is similar both in developed countries and in underdeveloped and developing nations, although mortality is higher in underdeveloped countries due to late detection. Even though mammography is the most used technique for the differential diagnosis of breast cancer, breast thermography can be used as a complementary technique, more accurate than self-examination but accurate enough to guide the use of a mammogram. However, thermal imaging is still difficult for radiologists to understand. Machine learning can help improve this scenario. Deep Wavelet Neural Networks are convolutional neural networks that do not necessarily learn, as they may have predefined filter banks as their neurons. In this work, we propose a deep hybrid architecture to support breast thermography imaging diagnosis based on five-layer Deep-Wavelet Neural Networks, to extract attributes of regions of interest from mammograms, and linear kernel support vector machines for final classification. Classical classifiers such as Bayesian classifiers, single hidden layer multilayer perceptrons, decision trees, Random Forests, and support vector machines were tested. The results showed that it is possible to detect and classify injuries with an average accuracy of 99% and an average kappa of 0.99, employing a 5-layer deep-wavelet network and a linear kernel support vector machine as the final classifier. Using a deep neural network with prefixed weights from the Wavelets Transform filter bank, it was possible to extract attributes and thus take the problem to a universe where it can be solved with relatively simple decision boundaries like those composed by linear kernel support vector machines. This shows that these new deep networks can be important in building complete solutions to improve breast thermography imaging results to support clinical diagnosis.

Tropical cyclones (TCs) are an extreme weather hazard that can have major impacts on coastal and inland populations. Surveillance by meteorological satellites has essentially mitigated the problem of TC detection; however, estimating TC intensity via remote sensing techniques is more challenging. Exploring different sensor frequencies and developing novel ways to interrogate that data are essential steps toward improving the intensity analysis of TCs. This study employs a convolutional neural network (CNN) machine learning method trained on previously unexplored 183-GHz microwave imagery to estimate TC intensity. A CNN can identify two-dimensional features in satellite imagery that are indicative of a TC’s current intensity. The novel approach, coined “D-MINT183,” is similar to an earlier version [Deep Multispectral Intensity of TCs estimator (D-MINT)] in that it uses infrared imagery and environmental scalar predictors, but D-MINT183 uses 183-GHz microwave imagery, while D-MINT uses legacy 37 and 89 GHz. The D-MINT183 model intensity estimates are calculated for different types of low-Earth-orbiting (LEO) meteorological satellites: conical scanning and cross-track scanning, and the experimental TROPICS CubeSats. Results show that D-MINT183 TC intensity estimates from conical scanning satellites are generally as skillful as D-MINT. For cross-track scanning satellites and TROPICS, when D-MINT is not available, TC intensity estimates from D-MINT183 are more skillful than Deep infrared (IR) Intensity of TCs estimator (D-PRINT), a CNN which does not use microwave imagery. Thus, D-MINT183 can increase the frequency of more accurate, microwave-based estimates of TC intensity. This work also demonstrates the importance of explainable artificial intelligence, with examples highlighting the situationally dependent impacts of 183-GHz imagery on the D-MINT183 intensity estimates. Significance Statement This study develops a machine learning method to estimate tropical cyclone (TC) intensity using novel satellite observations. The resultant model uses a convolutional neural network (CNN) which can identify two-dimensional features in 183-GHz microwave imagery along with geostationary infrared imagery that are indicative of the current TC intensity. Model performance shows that in several TC basins, the inclusion of the previously unexplored (but operationally available) 183-GHz water vapor channels on current and future low-Earth-orbiting (LEO) satellites can provide information that can complement alternative satellite-based estimates of TC intensity. This is significant since G-band frequencies can provide suitable spatial resolutions with much smaller antenna size requirements and lower costs, meaning the data are likely to be more common on emerging and planned LEO CubeSat constellations.

Coordinated development degree of county socio-economic system analysis and prediction play an important role in urban agglomeration coordinated development and improve benefit of regional coordinated development in China. According to the county socio-economic system data which is large scale and imbalance, this paper presented a support vector machine (SVM) model to predict coordinated development degree of county socio-economic system. In order to improve the discrimination precision of SVM in classification, a Genetic Algorithm (GA) was used to optimize SVM parameters in the solution space. The method was compared with artificial neural network, decision tree, logistic regression and naive Bayesian classifier regarding coordinated development degree of county socio-economic system prediction for Guanzhong urban agglomeration. It is found that the method has the best accuracy rate, hit rate, covering rate and lift coefficient, and provides an effective measurement for coordinated development degree of county socio-economic system classification and prediction.

Using information technology such as search engine for collecting and monitoring of network public opinion is a practical and effective method. This paper puts forward an improved algorithm of SVM classifier based on incremental learning online, and then implements a topic crawler system for network public opinion and to grab the public opinion.

Though large amounts of work with artificial intelligence are used in typhoon rainfall forecasting, the predictive skills of existing models are unsatisfactory. To address this problem, this study aims to propose an improved cluster‐wise typhoon rainfall forecasting model that integrates the grid‐search cross‐validation method with machine learning and deep learning (DL) models including support vector machine (SVM), random forest (RF), adaptive boosting (AdaBoost), convolutional neural network (CNN), and long short‐term memory (LSTM). Grid‐search cross‐validation is a modified parameterization technique that helps to find the best parameters for machine/DL models. In the first stage, a second‐order polynomial regression model was used to cluster the typhoon track; and in the second stage, cluster‐wise typhoon rainfall was recognized within a 500 km radius from each typhoon center. After that, a modified cluster‐wise typhoon rainfall forecasting model was proposed using cluster‐wise antecedent hourly typhoon rainfall within this distance for 1–6 hr lead time. Results show that the proposed model based on the SVM, RF, AdaBoost, CNN, and LSTM is capable of providing more accurate forecasts (the efficiency of the forecast is increased by 45%–90%) than the existing typhoon rainfall forecasting models that are based on SVM with a genetic algorithm, RF, artificial neural network, multilayer perceptron network, and deep neural network. Therefore, the current study recommends using cluster‐wise typhoon rainfall forecasting model with a grid‐search cross‐validation method for disaster prevention and mitigation.

This paper addresses processing of spectrophotometric array signals based on genetic algorithms (GA) least square support vector machines (LS-SVM) regression to provide a powerful model for machine learning and data mining. The key to complete LS-SVM regression is to choose its optimal parameters. Due to their outstanding ability in solving global optimization problems in complex multidimensional search space, GA are used in this study to obtain the optimal parameter combination of the LS-SVM model. Experimental results showed the GA-LS-SVM method to be successful for simultaneous multicomponent determination even where severe overlap of spectra was present. KeywordsLeast squares support vector machines; Genetic algorithms; Spectrophotometric array signals; Overlapping spectra; Artificial intelligence Nowadays, with the application of photometric diode array detector and computers, rapid scanning commercial spectrophotometers are capable of quickly generating huge data consisting of hundreds and even thousands of absorbance values per spectrum. The array data named fullspectrum contain sufficient information to be able to determine the contents of various compounds. The main drawback of ultraviolet-visible (UV-VIS) is its poor selectivity because in many cases UV-VIS spectra display strong overlaps, especially some less specific and selective chromagenic reagents often give rise to strongly overlapped spectra in many cases. The combination of artificial intelligence methods with the computer-controlled spectrophotometers was proven to be effective in overcoming this difficulty [1-3]. Artificial neural network (ANN) is a form of artificial intelligence that mathematically simulates biological nervous system [4, 5]. However, ANN often has slow convergence, is prone to the existence of many local minima during training, and has a tendency of overfitting. Recently, a promising technology called support vector machines (SVM) has been used for classification and regression problems. SVM pioneered by Vapnik is a kind of machine learning method based on modern statistical learning theory and has notable properties including absence of local minima and high generalization ability [6, 7]. Suykens and his coworkers [8] introduced a modified version of SVM called least square SVM (LS-SVM) , which requires solving a set of linear equations instead of a quadratic programming problem and is much easier and computationally simpler than SVM. SVM and LS-SVM represent relatively recent artificial intelligence method and have found some applications in image analysis, classification and disease diagnosis etc. [9, 10]. It is worth mentioning that the success of LS-SVM model is highly dependent on the optimum choice of two parameters, the relative weight of regression error γ and the kernel width σ of radial basis function (RBF). Genetic algorithms (GA) [11, 12] introduced by John Holland are probabilistic optimization techniques based on natural evolution and genetics and Darwin’s theory of survival of the best. With their efficient and robust global search ability, GA are used to search two optimal parameters for the LS-SVM model simultaneously and automatically. The LS-SVM model then performs the regression task using these optimal parameters.

The management and monitoring of land use in geothermal fields are crucial for the sustainable utilization of water resources, as well as for striking a balance between the production of renewable energy and the preservation of the environment. This study primarily compared Support Vector Machine (SVM) and Random Forest (RF) machine learning methods, using satellite imagery from Landsat 8 and Sentinel 2 between 2021 and 2023, to monitor land use in the Patuha geothermal area. The objective is to improve sustainable water management practices by accurately categorizing different land cover types. This comparative analysis assessed the efficacy of these techniques in upholding water sustainability in geothermal regions. This study examined the application of SVM and RF machine learning techniques, with particular emphasis on parameter refinement and model assessment, to enhance land use classification accuracy. By employing Kernlab and e1071 for algorithm comparison, the research sought to produce a precise Land Use Model Map, which underscores the significance of advanced analytical techniques in environmental management. This approach was of utmost importance in improving land use monitoring and reinforcing sustainable practices. The comparative evaluation of SVM and RF methods for land use classification demonstrates the superiority of RF in terms of accuracy, stability, and precision, particularly in intricate urban settings, hence establishing it as the preferred model for tasks demanding high reliability. The application of SVM and RF for monitoring land use in geothermal areas is in alignment with Sustainable Development Goals (SDGs) 6 and 15, as it fosters sustainable water management and the conservation of ecosystems. Doi: 10.28991/HEF-2024-05-02-06 Full Text: PDF