Simulation Analysis on Network Topology Control of Wireless Sensor Based on Bias Quantile

The purpose of the workis to explore the current problems and prospects of mining solution, big web data in real time, as well as the possibility of practical implementation of Web Mining technology for big web data on a practical example.Materials and methods.The study included a review of bibliographic sources on big data mining. We used Web Mining technology for associative analysis of large web data, as well as computer modeling of the practical task of transaction analysis using a general-purpose scripting language (PHP).Results.During the work, the specifics of the Data Mining technology were described, and a modern approach to the analysis of large web data –Web Mining was analyzed. A brief classification of tasks solved using Web Mining technology is given. The problem of data mining of large web data in a general-purpose scripting language (PHP) has been solved: the lack of libraries for data mining, the difficult normalization of data to the form necessary for associative analysis, interaction with the database management system. Also, an example showing an approach to the mining of large web data was implemented. Based on the understanding of Web Mining technology and the described difficulties of analyzing web data in the PHP language, methods for effectively solving the practical problem of analyzing web data based on transactions committed in a dynamic web application have been proposed. A module for associative analysis of customer transactions in the programming language PHP was developed. The module includes an intelligent data processing class. The structural scheme of the module and system architecture were developed. The constructed module allows us to solve the main part of the problem of associative analysis of large web data using Web Mining technology in order to solve the problem of identifying patterns in a large array of web data. Associative analysis of web data is much faster because of the combination of a general-purpose scripting language and an object-oriented approach.Conclusion.According to the results of the study, it can be argued that the current state of the technology for the analysis of large web data allows efficiently process data objects, identify patterns, obtain hidden data and receive complete statistical data in real time. The results can be used both for the purpose of the initial research of technologies for analyzing large web data, and as an addition to the content management system for the intelligent analysis of web data. The usage of the technology of associative analysis and the created universal handler class makes the created module flexible, while the possibility of manual integration makes this module universal. With manual integration, the database management system is not important. Algorithm methods work with selected data. This factor greatly simplifies the further development of program code.

Recent advances in computing, communications, digital storage technologies, and high-throughput data-acquisition technologies, make it possible to gather and store incredible volumes of data. It creates unprecedented opportunities for large-scale knowledge discovery from huge database. Data mining (DM) technology has emerged as a means of performing this discovery. There are countless researchers working on designing efficient data mining techniques, methods, and algorithms. Many data mining methods and algorithms have been developed and applied in a lot of application fields [1]. Unfortunately, most data mining researchers pay much attention to technique problems for developing data mining models and methods, while little to basic issues of data mining [2]. In this talk, some basic issues of data mining are addressed. What is data mining? What is the product of a data mining process? What are we doing in a data mining process? What is the rule we should obey in a data mining process? Through analyzing existing data mining methods, and domain-driven (or user-driven) data mining models [3-5], we find that we should take a data mining process as a process of knowledge transformation. Based on this understanding of data mining, a conceptual data mining model of domain-oriented data-driven data mining (3DM) is proposed [2]. The relationship between traditional domain-driven (or user-driven) data mining models and our proposed 3DM model is also analyzed. Some domain-oriented data-driven data mining algorithms for mining such knowledge as default rule [6], decision tree [7], and concept lattice [8] from database are proposed. The experiment results for these algorithms are also shown to illustrate the efficiency and performance of the knowledge acquired by our 3DM data mining algorithms.

Big data analysis technology can be used to transform massive data of oil production engineering into knowledge that can be used to guide oilfield production. Due to the lack of suitable large data analysis tools, a large data analysis software system was developed to simplify the workload of data analysis. This paper illustrates the research and application of large energy consumption data analysis through the development of big data analysis methods, process improvement and software platform, then achieves the goal of reducing costs and improving efficiency.

PurposeIn accounting and finance, researchers have used many ways to detect manager’s fraud risk. Until now, many researchers have used some data mining methods in these two fields to detect this risk. The purpose of this paper is to compare the precision of two data mining methods in detecting such a risk.Design/methodology/approachFor this purpose, this paper analyzed the texts of board’s reports and used two methods including the convex optimization (CVX) method and least absolute shrinkage and selection operator (LASSO) regression method. In this way, the words of these reports, which have the greatest power in explaining the manager’s high fraud risk index, were identified. Using these words, this paper presented a model that could detect manager’s high fraud risk index in companies.FindingsThe results indicated that both methods can detect the manager’s high fraud risk index with a precision between 82.55 and 91.25 percent. The LASSO method was significantly more precise than the CVX method.Research limitations/implicationsThe lack of access to an official and reliable list of firms suspected to fraud and the lack of access to the Microsoft Word (MS Word) file of board’s reports were two of the most important limitations of this study.Practical implicationsRegulatory bodies and independent auditors can consider the proposed methods in this study for assessing the fraud risk for a firm or other legal parties.Originality/valueThis paper avoided using merely financial statements data to detect the manager’s fraud risk index and focused on texts of board’s reports for the detection process. The capabilities of data mining and text mining methods for detecting the manager’s fraud risk index using board’s reports were tested in this paper. By comparing CVX and LASSO results, this paper indicated that methods with a binary-dependent variable have more power and are more precise than methods with continuous-dependent variables for detecting fraud.

We want to carry out an effectively distributed method to process large power data. Large data of electricity is first classified by big industries, and then by small industries, and finally put to use clustering to distinguish electro-sort of customers. This paper employed a computational framework named Spark based memory computing to conduct distributed computing, and adopted supporting vector machine on the Spark's, lastly the results were analyzed. Ensuring the final effect of the test, solution speed is greatly improved.

Extremely large amount of data is being captured by today's organizations and is continue to increase. It becomes computationally inefficient to analyze such huge data. Researchers has addressed problem in discovering knowledge from these continuously growing large data sets. Quantity of available raw data has been increasing at a very high rate. The precious information is concealed in large databases. Data mining has become an interesting area to extract the embedded precious information from them. For many years it has been found its root in all kinds of application areas. Thus, gave evolution to many data mining methods which started to get applied in several real life fields. But not all the methods possess the capability to deal with and handle the huge collection of data. In recent years, numbers of computation and data intensive scientific data analyses are established. To perform the large scale data mining analyses so as to meet the scalability and performance requirements of big data, several efficient parallel and concurrent algorithms got applied. A lot of parallel algorithms are put into action using different parallelization techniques, such as-threads, MPI, MapReduce etc. Which yield different performance and usability characteristics. The MPI model works efficiently in computing rigorous problems but it is a complicated task to bring this model into the practical use. There is currently considerable enthusiasm around the MapReduce paradigm for large-scale data analysis. It is inspired by functional programming which allows expressing distributed computations on massive amounts of data. It is designed for large-scale data processing as it allows to run on clusters of commodity hardware. A prominent parallel data processing tool MapReduce is gaining significant momentum from both industry and academia as the volume of data to analyze grows rapidly. In this paper, we are going to work around MapReduce, its advantages, disadvantages and how it can be used in integration with other technology.

Today, metrology toolsets report out more information than ever. This information applies not only to process performance but also metrology toolset and recipe performance through various diagnostic metrics. This is most evident on the Critical Dimension Scanning Electron Microscope (CD-SEM). Today state of the art CD-SEMs report out over 250 individual data points and several images per measurement. It is typical for a state of the art fab with numerous part numbers to generate at least 20TB of information over the course of a year on the CD-SEM fleet alone pushing metrology toolsets into the big data regime. Most of this comes from improvements in throughput, increased sampling and new data outputs relative to previous generations of tools. Oftentimes, these new data outputs are useful for helping to determine if the process, metrology recipe or tool is deviating from an ideal state. Many issues could be missed by singularly looking at the key process control metric like the bottom critical dimension (CD) or a small subset of this available information. By leveraging the entire data set the mean time to detect and finding the root cause of issues can be significantly reduced. In this paper a new data mining system is presented that achieves this goal. Examples are shown with a focus on the benefits realized using this new system which helps speed up development cycles of learning and reducing manufacturing cycle-time. This paper concludes discussing future directions to make this capability more effective.

Big Data is driving radical changes in traditional data analysis platforms. To perform any kind of analysis on such voluminous and complex data, scaling up the hardware platforms becomes impending. With the entire buzz surrounding Big Data; it is being collected at an unprecedented scale. Big Data has potential to revolutionize much more than just research. Loading large data-sets is often a challenge. Another shift of this Big Data processing is the move towards cloud computing. As many communities begin to rely on cloud based data management, large shared data goes up extensively. Analysis of such large data on distributed processing system or cloud is a bit difficult task to handle. The aim of this chapter is to provide a better understanding of the design challenges of cloud computing and analytics of big data on it. The challenge is related to how a large extent of data is being harnessed, and the opportunity is related to how effectively it is used for analyzing the information from it.

The polynomial model and wood model have been extensively applied to predict the milk yield of cows, which aims to measure and partially explain the uncertainty under single factor condition. However, different sample data would affect the goodness of fit of the models. To investigate the milk yield regularities of the Chinese Holstein cows in Yunnan Standardized Pasture (YSP), data of cows with 1–3 parities using different observation periods were derived from the 401,497 records of 1,826 cows collected from YSP, and fitted in the BP neural network (BPNN) model, the Quadrinomial model and the Wood model. Prediction results of three models were compared. The results show that, for group data (mean), the Quadrinomial model was likely to over-fit under the single factor condition with small sample data, while the Wood model had a better goodness of fit; the BPNN model was more suitable for multi-factor and large sample data analysis.

Strategic decisions in early production planning phases have a high impact on various production aspects. Decision making is often based on vague expert knowledge due to lack of a reliable knowledge base. Implications of this problem are especially observable in the field of assembly planning, which integrates results from various planning disciplines. This paper introduces a new concept and the corresponding data model for application of Data Mining (DM) methods in the field of production assembly planning and product design. The approach contains the usage of existing planning data in order to extrapolate assembly processes. Especially linked product and process data allow the innovative usage of Data Mining methods. The concept presents assistance potentials for development of new products variants along the product emergence process (PEP). With this approach an early cost estimation of assembly processes in series production can be achieved using innovative Data Mining methods. Furthermore, design and planning processes can be supported effectively.

The way we learn has changed as a result of advances in science and technology and the growing influence of information technology on daily life. E-learning is a relatively new concept in educational settings, but it has progressively earned a spot in modern training techniques. Data mining methods are used in many applications, particularly in elearning. Comparing direct communications difficult to track the student involvement in online courses. To overcome the above mentioned issues the existing methods are analyzed various techniques of data mining and optimization methods which can be applied to bring out hidden knowledge from the educational data? In the e-learning work, preprocessing, feature selection and classification process are performed to improve the Kalboard 360 educational dataset accuracy significantly. This study focused on educational data mining (EDM) and employed decision trees, support vector machines (SVM), multilayer perceptrons, and the naive bayesian C4.5 algorithm among other classification techniques to assess the features for the prediction of students’ behaviour and academic achievement. This paper analyzes the advantages and shortcomings of each algorithm applied to data set on the basis of accuracy for various classification techniques like Multilayer Perceptron based ANN algorithm (MP-ANN), Decision Tree (DT) C4.5 and Hybrid Regression model with Multi Label Classification (HR-MLC) approach. The experimental result shows that the HR-MLC algorithm provides better performance in terms of higher accuracy, precision, recall and f-measure rather than the other existing methods.

Computing significant factors quantitatively is an imperative task in understanding the underlying reasons that contribute to a final outcome. In this paper, a case of e-Government ranking is studied by attempting to find the significance of each KPIs which leads to resultant rank of a country. Significant factors in this context are inferred as some degrees of relations between the input variables (which are the KPIs in this case) and the final outcome (the rank). In the past, significant factors were either acquired as first-hand information via direct questioning from users’ satisfaction survey or qualitative inference; typical question is ‘You are satisfied with a particular e-Government service’ by applying a multi-level Likert scale. Respondents answered by choosing one of the following: Strongly agree, Agree, Neutral, Disagree, and Strongly Disagree. The replies are then counted and studied using traditional statistical methods. In this paper, an alternative method by feature selection in data mining is proposed which computes quantitatively the relative importance of each KPI with respective to the predicted class, the rank. The main advantage of feature selection by data mining (FSDM) method is that it considers the cross-dependencies of the variables and how they contribute as a whole predictive model to a particular predicted outcome. In contrast, classical significant factor analysis such as correlogram tells only the strength of correlation between an individual pair of factor and outcome. Another advantage of using data mining method over simple statistic is that the inferred predictive model could be used as a predictor and/or what-if decision simulator; given some values of KPIs a corresponding rank could be guesstimated. A case study of computing significant factors in terms of KPIs that lead to the world rank in from the data of UN e-Government Survey 2010, is presented.

In today's conditions, customer loyalty has gained importance with the increase in the competitive environment between companies, the development of marketing strategies and the improvement of companies. Therefore, it is essential to acquire customers for a company to survive. Retaining an existing customer in the telecommunication sector is less costly than gaining a new customer. Customer churn analysis is the process of predicting customers with high abandonment requests by examining the offers and utilizable behaviors. Customer churn analysis provides services to develop various campaigns aiming to increase the company’s loyalty by predicting the customers who are planning to move to another company. In this way, it gives the company a competitive advantage. This study aims to make predictions by developing models for customer churns through data mining and machine learning methods in the telecommunication sector. In addition, we believe that the application in this article will contribute to data analysts and academicians who will want to analyze customer churn with different data sets in telecommunication and other sectors in the future. The analysis in this study is carried out on a data set obtained from an open-access database, including 20 transaction records for the customer from 7043 customers and whether the customer left the company. Among the data mining methods, Random Forest (RF), Support Vector Machines (SVM) and Multilayer Artificial Neural Networks (ANN) are modeled in open-source Phyton environment. The results have shown that ANN has fared better at classifying customers than other machine learning methods.

Big data is one of the important development direction of modern information technology, realizing the sharing and analysis of large data will bring immeasurable economic value, but also has a tremendous role in promoting the social. In the age of big data, unified the data representation, large data processing, query, analysis and visualization are the key problem to be solved urgently. In order to provide a standardized framework construction of the large data service platform, this paper designed a large data service oriented architecture user experience. Secondly, in the aspect of data model, in order to achieve high data service for non structured data, the design of the non structured data model based on subject behavior. In large data service model, algebraic model large data services and their composition was established by using process algebra. In large data service applications, detailed retrieval, process analysis and visualization services, and by improving the retrieval accuracy and efficiency of the service in two aspects of measures to achieve the high data service optimization.

In a company, inventory management is crucial due to the significant impact on various aspects of the business. Similarly, the Indonesian water supply company (PDAM) requires effective inventory management to ensure the supply of liquid aluminum sulfate chemicals. The probabilistic statistical inventory control (SIC) model is commonly used for inventory management. However, previous research on chemical inventory models in PDAMs often relied on simple linear regression to forecast demand data, which fails to capture the inherent volatility in demand. Therefore, this research aimed to predict demand data using the seasonal autoregressive integrated moving average (SARIMA) method and determine the optimal policy for supplying liquid aluminum sulfate chemicals. The results showed that the best demand forecasting model was SARIMA (2,1,2) (1,1,0)12 with a mean absolute percentage error (MAPE) value of 8.19%. The finding of the optimal inventory policy showed a safety stock value of 11,922.35 kg, a reorder point value of 49,511.20 kg, and an order quantity of 21,526.59 kg, leading to a total cost of IDR 11,132,034,145.45. The sensitivity test also showed that variations in lead time, price, μ, and σ parameters directly influence changes in total cost, reorder point, and safety stock. These calculations were conducted using Minitab and Python software.