Wine quality identification based on data mining research

In this research, a new method for spectral-spatial classification of hyperspectral images based on hierarchical segmentation algorithm is introduced. Among the various spectral-spatial classification algorithms, the marker-based hierarchical segmentation algorithm has so far achieved the best results in combination with the support vector machine (SVM) classification algorithm. In the proposed method adopted in this research, the dimensions of the hyperspectral image were reduced via the minimum noise fraction (MNF) algorithm. Then, five spatial/texture features of wavelet transform, Gabor transform, mean, entropy, and contrast were extracted from the obtained bands. Later on, the multi-layer perceptron (MLP) neural network and SVM classification algorithms were applied to the obtained spectral and texture features, and their results were combined. The resulting map was then used to select the markers and to combine them with the marker-based hierarchical segmentation algorithm using the majority voting rule. The proposed method was applied to three hyperspectral images, Pavia, Telops, and Washington DC Mall. The results of the experiments demonstrate the superiority of the proposed method over the initial marker-based hierarchical algorithm. Quantitatively, it was better by 8, 12, and 9% for the Pavia, Telops, and Washington DC Mall datasets regarding the Kappa coefficient parameter, respectively.

Today, the amount of biological data types obtained are increasing every day. Among these data types are micro arrays that play an important role in cancer diagnosis. The data analysis that are carried out through traditional approaches have proven unsuccessful in delivering efficient results on data types where data complexity is high and where sampling is low. For this reason, using a hybrid algorithm by merging the effective features of two distinct algorithms will yield effective results. In this study, a classification process was performed firstly by dimension reduction on micro array data that were obtained from the tissues from patients with a tumor in their central nervous system and then by using an artificial neural network algorithm that was optimized through Fire Fly Algorithm (FF), a hybrid approach. The data obtained were compared to K Nearest Neighbors (KNN), Support Vector Machine (SVM) and Artificial Neural Networks (ANN) classification algorithms, which are frequently used in the literature. Also, the results were compared to the findings that were obtained from artificial neural networks, which are reinforced by Genetic Algorithm (GA), another hybrid approach. Then the results were shared. The performance results obtained show that hybrid approaches present a highly precise and more efficient classification process but they show a slower performance than basic classification algorithms.

An intelligent prosthetic arm force control method based on surface electromyography signal (sEMG) is proposed. The time-frequency characteristics of sEMG signal under different maximum voluntary contraction (MVC) forces were analyzed. The muscle force's signal was extracted and normalized. Root mean square (RMS) value and median frequency (MF) are used as time domain characteristic and frequency domain characteristic respectively. The relationship between sEMG signal eigenvalues and muscle forces was recognized and analyzed by BP neural network (BPNN) classifier. The control model of the relationship between sEMG signal characteristic and output force of intelligent prosthetic arm was established, which satisfied the muscle force identification better. An experimental system based on light weight intelligent upper arm prototype combined with pressure sensor was designed and accuracy of intelligent prosthetic arm force control method was verified by comparing the output force of human upper arm and the output force of intelligent prosthetic arm.

Hyperspectral data is gaining tremendous popularity in mapping tree species in the recent past. This is due to its ability to distinguish between individual tree species. However, its cost is prohibitive especially for developing economies. This paper focuses on the possibility of using the recently launched free optical sensors for mapping tree species in the Ngangao Forest of Taita Hills in Kenya. The AISA Eagle hyperspectral data was used to 10 tree species (six indigenous and four exotic species). The hyperspectral data reflectance was then used to derive Worldview 2 and Sentinel 2 data. A total 2504 training sites were used for the classification AISA Eagle data. The same training sites were used for the classification of the Worldview 2 and Sentinel 2 but after downscaling due to coarse resolution of the two sensors resulting into 638 and 23 training sites respectively. Spectral angle mapper, neural network and support vector machine classification algorithms were tested in this study. The three algorithms resulted into accuracies 49.24%, 79.47% and 80.15% respectively for the AISA Eagle data. However, only neural network algorithm was able to classify Worldview 2 and Sentinel 2 images resulting into overall accuracies of 56.43% and 47.22% with Kappa coefficient of 0.48 and 0.33 respectively.

The identification of key information hidden in non-stationary signals is challenging in various fields such as logistics and transportation, biomedicine, and fault diagnosis. To facilitate this identification, we propose a back propagation neural network (BPNN) classification and recognition algorithm based on wavelet threshold denoising (WTD) and manta ray foraging optimization (MRFO) algorithm for the first time. The algorithm first performs WTD on the original signals to obtain denoised signals. Subsequently, the MRFO algorithm is utilized to optimize the initial weights and thresholds of the BPNN. On the base of this, the optimization model is finally obtained to classify and recognize the key information in the non-stationary signals. The comparative experimental results indicate that the proposed WTD-MRFO-BPNN algorithm can be utilized to availably recognize the key information hidden in non-stationary signals. The recognition accuracy reaches 97.25%.

To solve the problem that traditional multi-label support vector machine (SVM) classification algorithm adopting nonlinear kernel has been severely restricted from being used on large-scale data sets, we propose fast multi-label low-rank-linearized SVM classification algorithm based on approximate extreme points (AEML-LLSVM). First, it adopts the approximate extreme points' method to obtain representative sets from the training data set. Then, the approximate extreme points' low-rank-linearized SVM (AELLSVM) is trained on the representative sets. The AELLSVM integrates the advantages of approximate extreme points' method and LLSVM. Experimental results on three large-scale multi-label data sets have proven that the training and the testing speed of AEML-LLSVM classification algorithm are greatly improved under the premise that its classification performance is similar to that of ML-LIBSVM classification algorithm and superior to that of other fast multi-label SVM classification algorithms.

With the advent of the era of network, video surveillance technology is more and more integrated into the IT emerging technologies. Big data technology in the field of video surveillance has shown a broad development path. The research of surveillance video data mining based on big data is committed to achieve a perfect fusion of the big data technology and video surveillance business, in order to create a solution of intelligent video surveillance in big data era. In this paper, based on the application requirements of video surveillance on big data, we designed the framework of big data analysis for surveillance video, and study the key technology of storage and processing for surveillance video data based on big data and the value of data mining. The study on real-time intelligence analysis and data mining, progresses the video surveillance from manual sampling to efficiently advance warning, post analysis, realization of intelligent information analysis, forecasting. It brings profound changes in the field of video surveillance business development.

PurposeThe purpose of this study is to explore to which extent data mining research would be associated with the library and information science (LIS) discipline. This study aims to identify data mining related subject terms and topics in representative LIS scholarly publications.Design/methodology/approachA large set of bibliographic records over 38,000 was collected from a scholarly database representing the fields of LIS and the data mining, respectively. A multitude of text mining techniques were applied to investigate prevailing subject terms and research topics, such as influential term analysis and Dirichlet multinomial regression topic modeling.FindingsThe findings of this study revealed the relationship between the LIS and data mining research domains. Various data mining method terms were observed in recent LIS publications, such as machine learning, artificial intelligence and neural networks. The topic modeling result identified prevailing data mining related research topics in LIS, such as machine learning, deep learning, big data and among others. In addition, this study investigated the trends of popular topics in LIS over time in the recent decade.Originality/valueThis investigation is one of a few studies that empirically investigated the relationships between the LIS and data mining research domains. Multiple text mining techniques were employed to delineate to which extent the two research domains would be associated with each other based on both at the term-level and topic-level analysis. Methodologically, the study identified influential terms in each domain using multiple feature selection indices. In addition, Dirichlet multinomial regression was applied to explore LIS topics in relation to data mining.

With the improvement of the material standard of living, the demand of the people for spiritual culture continues to increase. In terms of tourism, people have gradually shifted from simple tourism needs to integrated tourism needs. Tourism has become an effective way for people to expand their horizons and enrich their spiritual world. Tourism is one of the first industries to apply network technology. After long‐term exploration and innovation, tourism e‐commerce has developed rapidly. Coupled with the advent of the era of big data (EBD), the concept of customized tourism has gradually entered people’s lives. This paper mainly introduces the research on the impact of e‐commerce tourism on custom tourism in the EBD and intends to provide some ideas and directions for the good development of custom tourism. This paper proposes a research strategy on the impact of tourism e‐commerce on customized tourism in the EBD, including related theoretical research methods, random forest algorithms, support vector machine classification algorithms, and Bayesian estimation algorithms, which are used to customize tourism e‐commerce in the EBD, and research experiment on the impact of tourism. The experimental results show that 79.84% of customers are willing to purchase related products again after experiencing travel customization services using big data technology. By using the various characteristics of tourism big data for data mining and classification, it provides users with personalized travel search services. At the same time, big data technology can provide basic technical support for customized tourism development, which shows that it can also provide customized services for users.

There are many data mining algorithms and methodologies for various fields and various problematic. Each data mining researcher/practitioner should describe the intrinsic quality of the discovered models and patterns. In addition he/she is faced with assessing the performance of his/her own solution(s) in order to make –fair– comparisons with state of the art approaches. Which methodology, which benchmarks, which measures of performance, which tools, which measures of interest, which scenarios, etc., should be used, and why? Every one should answer these questions, and assessing the quality and the performance of a data mining process is a critical issue. Assessing the quality and the performance is a critical issue for classical situations and even more in the Big Data era where we can not manage this issue with classical and current approaches. Clearly, large scale data, complex data and streaming data bring new challenges (e.g. large scale inference, fake correlations, necessity of perpetual validation). In this setting, the Quality Issues, Measures of Interestingness and Evaluation of data mining models Workshop series provide an open forum for intensive discussions and the exchange of new ideas and best practices on quality issues among data mining researchers. QIMIE focuses on the theory, the techniques, the links between the discovery stage and the quality assessment stage, and the practices that can ensure that the discovered knowledge of a data mining process is of quality. It is organized with the IEEE Task Force on Evaluation and Quality issues (Data Mining and Big Data Analytics Technical Committee, IEEE Computational Intelligence Society).

Distributed Denial of Service (DDoS) attacks represent a significant danger in network security because they can lead to extensive service interruptions. With these attacks increasingly mirroring regular traffic, smart and effective detection systems are essential. This research seeks to assess the efficacy of the Support Vector Machine (SVM) classification algorithm in identifying DDoS attacks in network traffic. The data utilized is CICIDS2017, focusing on the subset Friday-WorkingHours-Afternoon-DDos.pcap_ISCX.csv, which contains both legitimate traffic and DDoS attacks like DoS-Hulk, DoS-GoldenEye, and DDoS. The preprocessing stage included eliminating duplicates and null entries, label binary encoding, normalization through Min-Max Scaler, and feature selection applying the Chi-Square technique. The data was divided into 80% for training and 20% for testing purposes. The Radial Basis Function (RBF) kernel was utilized to train the SVM model, and hyperparameter optimization was performed with GridSearchCV. The evaluation of the model's performance was conducted through accuracy, precision, recall, F1-score, confusion matrix, and visual representations including ROC and Precision-Recall Curves. The findings indicate that prior to tuning, the model reached an accuracy of 97%, which increased to 99% post-tuning, accompanied by an F1-score of 0.99. This shows that the SVM algorithm, when paired with appropriate preprocessing and optimization, is very efficient in identifying DDoS attacks within network traffic.

Cucumber, a common economic crop, occupies a large proportion of vegetable cultivation in China. Plant diseases and insect pests, especially the cucumber downy mildew, are important causes for the decrease in the yield of cucumbers. In order to reduce the losses caused by pests and diseases and achieve rapid automatic identification of plant diseases and insect pests, this paper studies machine vision system and disease image detection with support vector machine (SVM) classification algorithm, taking cucumber downy mildew for example. This paper carries out a method study in image acquisition, image preprocessing, feature parameter extraction, and pattern recognition, which obtains satisfactory results. The accuracy of cucumber downy mildew detection reaches 90%, significantly higher than that of artificial recognition.

The purpose of the work is to study the current problems and prospects of the solution for processing big data received or stored in the Internet (web data), as well as the possibility of practical realization of Data Mining technology for big web data on practical example. Materials and methods. The study included a review of bibliographic sources on big data analysis problems.Data Mining technology was used to analyze large web data, as well as computer modeling of a practical problem using the C # programming language and creating a DDL database structure for accumulating web data.Results. In the course of the work, the specifics of big data were described, the main characteristics of big data were highlighted, and modern approaches to processing big data were analyzed. A brief description of the horizontal-scalable architecture and the BI-solution architecture for big data processing is given. The problems of processing large web data are formulated: limiting the speed of access to data, providing access via network protocols through general-purpose networks.An example showing the approach to processing large web data was also implemented. Based on the idea of big data, the described complexities of web data processing and the methods of Data Mining, techniques were proposed for effectively solving the practical problem of processing and searching patterns in a large data array.The following classes have been developed in the C # programming language:Class of receiving web data via the Internet; Data conversion class;Intelligent data processing class;Created DDL script that creates a structure for the accumulation of web data.A single UML class diagram has been developed.The constructed system of data and classes allows to solve the main part of the problems of processing large web data and perform intelligent processing using Data Mining technology in order to solve the problem posed of identifying certain records in a large array. The combination of object-oriented approach, neural networks and BI-analysis to filter data will speed up the process of data processing and obtaining the result of the studyConclusion. According to the results of the study, it can be argued that the current state of technology for analyzing large web data allows you to efficiently process data objects, identify patterns, get hidden data and get full-fledged statistical data.The obtained results can be used both for the purpose of the initial study of big data processing technologies, and as a basis for developing an already real application for analyzing web data. The use of neural networks and the created universal classes-handlers makes the created architecture flexible and self-learning, and the class declarations and the base DDL structure will greatly simplify the development of program code.

We take a well log in petroleum exploration and development as an example of the big data mining, and adopt three regression and two classification algorithms: the multiple regression analysis (MRA), the error back-propagation neural network (BPNN), the regression of support vector machine ( R -SVM), the classification of support vector machine ( C -SVM), and the Bayesian successive discrimination (BAYSD). It is well known that MRA, BPNN and R -SVM are regression algorithms while C -SVM and BAYSD are classification algorithms, and only MRA is linear algorithm whereas the other four algorithms are nonlinear algorithms. From this case study, we can draw the following five major conclusions: a) Since C -SVM is the best classifier, it is employed as a data cleaning tool. b) Since MRA is a linear algorithm, its total mean absolute relative residual R * (%) can express the nonlinearity of studied problem. For this case study, R * (%)=52.14 showing the nonlinearity of the studied problem is strong. c) Since both MRA and BAYD can establish the order of dependence between a dependent variable and independent variables, each of MRA and BAYD could serve as a pioneering dimension-reduction tool in data mining. In the case study, since the nonlinearity of the studied problem is strong, the nonlinear algorithm BAYSD can serve as a pioneering dimension-reduction tool, but the linear algorithm MRA cannot. d) Since the nonlinearity of the case study is strong, BPNN and R -SVM are not applicable though they are nonlinear algorithms, whereas other two nonlinear algorithms C -SVM and BAYSD are applicable, indicating the nonlinear ability of C -SVM and BAYSD is higher than that of BPNN and R -SVM. e) Comparing the two applicable algorithms C -SVM and BAYSD for this case study, it is seen that R * (%) of C -SVM is less than that of BAYSD; BAYSD can serve as a pioneering dimension-reduction tool, but C -SVM cannot; it is easy to code the BAYSD program whereas it is very complicated to code the C -SVM program, so BAYSD is a good software for this case study when C -SVM is not available. Key words : Big data mining; Well log; Data cleaning; Dimension-reduction; Regression; Classification

With the development of the Internet, with the gradual increase of people's needs, more and more people are engaged in various activities on the Internet, such as online transactions. This article mainly studies the classification and mining algorithm of e-commerce big data based on BP neural network technology. Take user movie rating data as the object of analysis and mining, and use platform functions to complete the whole process of data from preprocessing to data mining to result data storage. According to the requirements of the platform design modules and functions, the construction process from the installation of the cluster dependent tool software, node communication, cluster configuration to the final operation monitoring was completed, and the experimental environment of the e-commerce big data platform was established. According to the real open source movie rating data, according to the BP neural network algorithm, relying on the function of the module, the whole recommendation task from data processing, algorithm mining to the final result generation is completed. Through the comparison of speedup, accuracy, recall and coverage indicators, it can be seen that when the experimental data set is 100K, the recommendation efficiency in the cluster environment is not improved. The results show that the BP neural network improves the efficiency of the e-commerce big data platform and the accuracy of task execution results.