Big Data Mining of Website Recruitment Data Based on Multi-source Data Fusion and Machine Learning Methods

This paper aims to design a method of multi-source data fusion in multi-target collaborative navigation. First, the respective features of GPS/INS/RS/MO data in the navigation process are clarified. Then a multi-source data fusion method is designed including GPS/INS data fusion with adaptive Kalman filter, RS/MO data fusion with ranging table matching of observation targets, and joint adjustment with fused GPS/INS and RS/MO data. Finally, a simulation experiment is carried out to verify the improvement in positioning efficiency and precision. The results show that collaborative navigation based on multi-source data fusion can increase the stability and accuracy of the navigation service.

In this paper, the sensor is applied to the collection of rock parameter data. Aiming at the classification and evaluation of stability (i.e. rock quality), an attribute recognition model for the classification and evaluation of surrounding rock quality of underground engineering is established. Using multi-source data fusion and orthogonal numerical simulation test methods, the effects of rock mechanics parameters on the horizontal convergence of the tunnel, the settlement of the vault and the plastic zone coefficient are studied. Six factors (elastic modulus, Poisson’s ratio, internal friction angle, tensile strength, cohesion and density) and three levels of orthogonal experimental solutions were selected. The method of defining similar weight by using similar number to determine the weight of evaluation index, so as to calculate the comprehensive attribute measure, and apply confidence criteria to identify the stability of rock samples. Through the analysis and evaluation of rock mass quality classification of underground engineering, the application of the model and the evaluation method of rock mass quality classification are explained. The test results match the orthogonal test results; Considering the stability of tunnel envelope, the horizontal convergence, vault settlement and plastic zone coefficient after excavation should be comprehensively considered.

With the development of science and technology, various kinds of data become more and more, it is increasingly important to obtain knowledge from data. The field of environmental monitoring is in the same situation. How to quickly and effectively dig out the useful information in large-scale multi-source data has become the biggest problem facing the environmental field. This paper focuses on multi-source data fusion methods, data Mining methods and existing cases, and proposed a multi-source data fusion framework for atmospheric environmental monitoring. The proposed framework effectively enhances the knowledge acquisition ability of environmental monitoring big data.

Multi-source Sensor Data Fusion and Deep Reinforcement Learning Anomaly Detection Method for Power UAV Inspection

Multisource and multimodal data fusion plays a pivotal role in large-scale artificial intelligence applications involving big data. However, the choice of fusion strategies for different scenarios is often based on experimental comparisons, which leads to increased computational costs during model training and suboptimal performance during testing. In this paper, we present a theoretical analysis of early fusion, late fusion, and gradual fusion methods. We derive equivalence conditions between early and late fusions within the framework of generalized linear models. Moreover, we analyze the failure conditions of early fusion in the presence of nonlinear feature-label relationships. Furthermore, we propose an approximate equation for evaluating the accuracy of early and late fusion methods as a function of sample size, feature quantity, and modality number. We also propose a critical sample size threshold at which the performance dominance of early fusion and late fusion models undergoes a reversal. Finally, we introduce a fusion method selection paradigm for selecting the most appropriate fusion method prior to task execution and demonstrate its effectiveness through extensive numerical experiments. Our theoretical framework is expected to solve the problems of computational and resource costs in model construction, improving the scalability and efficiency of data fusion methods.

Root zone soil moisture (RZSM) serves as a crucial metric for assessing water stored in the soil. Modeling approaches are commonly employed in estimating RZSM. However, modelled RZSM often deviate from true RZSM values due to errors from model input data and parameters. Machine learning methods and data fusion techniques can enhance simulation accuracy. In this study, we conducted a comparative analysis of three methods for RZSM data fusion: random forest (RF), extended triple collocation (ETC), and Bayes Three Cornered Hat (BTCH).Soil moisture observation data from 2018 to 2022 were collected at 2121 sites across China from the China Meteorological Administration (Fig.1). Daily average data were calculated by arithmetically averaging hourly data and used in the analysis. Six RZSM datasets were utilized, including SMAP Level 4, GLDAS-NOAH2.1, GLDAS-Catchment2.2, ERA5, MERRA2, and CRSR. All these data were resampled to 0.25° to maintain the same spatial resolution and were arithmetically averaged as daily averages. Additionally, some parameters related to soil, climate, and vegetation were used to build a machine learning model, specifically a random forest model. Fig. 1 Distribution of soil moisture sites and daily soil moisture (m3/m3) at depths ranging from 0–50 cm across China during the period from 2018 to 2019To investigate the impact of different inputs on the performance of the RF method, three groups of inputs were employed. The specifics of the inputs used for the three methods are outlined in Table 1. The evaluation of the RF method results was carried out using a five-fold cross-validation approach.Model Inputs RFmodel1 NOAH, SMAP, ERA5, MERRA2, CFSR, CLSM, LAI, Soil properties, Meteorological data RFmodel2 NOAH, LAI, Soil properties, Meteorological data RFmodel3 NOAH, SMAP, ERA5, MERRA2, CFSR, CLSM BTCH NOAH, SMAP, ERA5, MERRA2, CFSR, CLSM ETC NOAH, MERRA2, CLSM  The boxplots show RFmodel1 performs best, emphasizing the need for comprehensive information in machine learning models. RFmodel2, superior to RFmodel3, highlights the significance of LAI, soil properties, and meteorological data in RZSM estimation. ETC and BTCH outperform individual RZSM datasets, especially in the absence of true data. The superior performance of ETC over BTCH is attributed to ETC's inputs, namely NOAH, MERRA2, and CLSM, which exhibit better accuracy compared to SMAP, ERA5, and CFSR, the inputs used by BTCH.Fig.2 Boxplots of the Pearson coefficient (R), Root Mean Square Error (RMSE), and bias between in situ root zone soil moisture (RZSM) and its estimates from the three random forest models, Bayes Three Cornered Hat (BTCH), and Extended Triple Collocation (ETC) methodsIn summary, the random forest method outperforms BTCH and ETC in the fusion of root zone soil moisture (RZSM) data, highlighting the importance of including leaf area index (LAI), soil properties, and meteorological data in the construction of the random forest model. Both BTCH and ETC demonstrate utility in enhancing RZSM estimates, making them valuable options when true data is unavailable.

To improve the effect of college English teaching, combines multi-source data (MSD) fusion technology to build a college English blended teaching system. Moreover, through the research on the functions of smarter classrooms and the analysis and exploration of blended teaching, this paper designs a college English blended teaching system based on MSD fusion. In addition, this paper analyzes the bandwidth-tunable optical routing module of the interference-coupled series double-ring involved in multi-data fusion. Finally, this paper studies the working principle and structural design of the module, and constructs a college English blended teaching system structure based on MSD fusion. From the evaluation results, it can be seen that the college English blended teaching system based on MSD fusion proposed in this paper can effectively improve the quality of English teaching.

The precipitation oxygen isotopic composition is a useful environmental tracer for climatic and hydrological studies. However, the observed precipitation oxygen is limited at both temporal and spatial scales. Isotope-equipped general circulation models (iGCMs) can compensate for the temporal and spatial discontinuity of observation networks, but they suffer from coarse spatial resolutions and systematic biases. The objective of this study is to build a high-resolution precipitation oxygen isoscape in China for a period of 148 years by integrating observed and iGCMs-simulated precipitation oxygen isotope composition (δ18Op) using data fusion and bias correction methods. The temporal and spatial resolutions are month and 50–60 km for the isoscape, respectively. Prior to building the oxygen isoscape, the performance of two bias correction methods (BCMs) and three data fusion methods (DFMs) is compared after post-processing of eight iGCM simulations. Results show that the outputs of the Convolutional Neural Networks (CNN) fusion method exhibit the strongest correlation with observations with correlation coefficient mostly larger than 0.8, and the smallest bias with root mean square error mostly smaller than 2 ‰. The other two DFMs also perform slightly better than the two BCMs, which show similar performance. Thus, precipitation oxygen isoscape is generated by using the CNN fusion method for the 1969–2007 period in which all iGCMs have output and by using the bias correction methods for the remaining years. Based on the precipitation oxygen isoscape, the spatiotemporal patterns of δ18Op across China are investigated. The generated isoscape shows similar spatial and temporal distribution characteristics to observations. In general, the distribution pattern of δ18Op is consistent with the temperature effect in northern China, and with the precipitation amount effect in southern China, and be more specific in the Qinghai-Tibet Plateau of China. The δ18Op time series mirrors a fluctuating upward trend of the temperature or precipitation in most regions of China. The temporal and spatial distribution characteristics of the generated isoscape are consistent with the characteristics of atmospheric circulation and climate change, indicating successful assimilation and extension of the observed precipitation oxygen isotopes in time and space. Overall, the built isoscape is reliable and useful for providing strong support for tracking atmospheric and hydrological processes. The dataset is available in Zenodo at https://doi.org/10.5281/zenodo.5703811 (Chen et al., 2021).

The precipitation oxygen isotopic composition is a useful environmental tracer for climatic and hydrological studies. However, the observed precipitation oxygen is limited at both temporal and spatial scales. Isotope-equipped general circulation models (iGCMs) can compensate for the temporal and spatial discontinuity of observation networks, but they suffer from coarse spatial resolutions and systematic biases. The objective of this study is to build a high-resolution precipitation oxygen isoscape in China for a period of 148 years by integrating observed and iGCMs-simulated precipitation oxygen isotope composition (δ18Op) using data fusion and bias correction methods. The temporal and spatial resolutions are month and 50–60 km for the isoscape, respectively. Prior to building the oxygen isoscape, the performance of two bias correction methods (BCMs) and three data fusion methods (DFMs) is compared after post-processing of eight iGCM simulations. Results show that the outputs of the Convolutional Neural Networks (CNN) fusion method exhibit the strongest correlation with observations with correlation coefficient mostly larger than 0.8, and the smallest bias with root mean square error mostly smaller than 2 ‰. The other two DFMs also perform slightly better than the two BCMs, which show similar performance. Thus, precipitation oxygen isoscape is generated by using the CNN fusion method for the 1969–2007 period in which all iGCMs have output and by using the bias correction methods for the remaining years. Based on the precipitation oxygen isoscape, the spatiotemporal patterns of δ18Op across China are investigated. The generated isoscape shows similar spatial and temporal distribution characteristics to observations. In general, the distribution pattern of δ18Op is consistent with the temperature effect in northern China, and with the precipitation amount effect in southern China, and be more specific in the Qinghai-Tibet Plateau of China. The δ18Op time series mirrors a fluctuating upward trend of the temperature or precipitation in most regions of China. The temporal and spatial distribution characteristics of the generated isoscape are consistent with the characteristics of atmospheric circulation and climate change, indicating successful assimilation and extension of the observed precipitation oxygen isotopes in time and space. Overall, the built isoscape is reliable and useful for providing strong support for tracking atmospheric and hydrological processes. The dataset is available in Zenodo at https://doi.org/10.5281/zenodo.5703811 (Chen et al., 2021).

A multi-source heterogeneous spatial big data fusion method based on multiple similarity and voting decision

To promote the rapid development of the fertilizer industry, this paper reviewed the research on chemometric methods combined with analytical spectroscopy (including near-infrared spectroscopy, mid-infrared spectroscopy, Raman spectroscopy, laser-induced breakdown spectroscopy, and X-ray fluorescence spectroscopy) in the fertilizer industry over the past two decades. Five parts were described according to the applied spectroscopy. Finally, the paper provides an outlook for the future development of the fertilizer industry. (1) To enhance the overall quality of fertilizers, it is imperative to broaden the scope of critical quality attributes, while simultaneously strengthening the monitoring of the fertilizer production process. (2) The utilization of spectral imaging technology enables the acquisition of both spatial and spectral insights into the ingredients of a fertilizer, providing a comprehensive understanding of its composition. (3) The employment of multi-source spectral data fusion methods has the potential to effectively surmount the inherent constraints of individual spectroscopic techniques, offering a more comprehensive and accurate analysis. (4) The establishment of an open-source spectral database for fertilizers would significantly contribute to the further expansion and advancement of this field. It is anticipated that the integration of chemometrics with analytical spectroscopy will enhance fertilizer production, ultimately fostering a shift towards a more sustainable development path.

The application of mobile intelligent terminal in the environment is very complex, and its own computing capacity is also very limited, so it is vulnerable to malicious attacks. The security classification of mobile intelligent terminals can effectively ensure the security of their use. Therefore, a security classification method for mobile intelligent terminals based on multi-source data fusion is proposed. The Boolean value is used to count the multi-source data of the mobile intelligent terminal, and the word frequency method is used to calculate the weight of the multi-source data of the mobile intelligent terminal. The D-S evidence theory is used to complete the multi-source data fusion of the mobile intelligent terminal and implement the multi-source data fusion processing of the mobile intelligent terminal. On this basis, the security level permission value of mobile intelligent terminal is calculated to achieve the security level division of mobile intelligent terminal based on multi-source data fusion. The experimental results show that the accuracy of mobile intelligent terminal security classification is higher than 96% and the classification time is less than 3.8 ms after the application of the proposed method. Therefore, the security level of mobile intelligent terminals after the application of this method is high, and the security performance of mobile intelligent terminals is strong, which can effectively improve the accuracy of security classification and shorten the time of security classification.

In order to solve the problem that the target is easily lost in the process of multisource target data fusion tracking, a multisource target data fusion tracking method based on data mining is proposed. Multisource target data fusion tracking belongs to location level fusion. Firstly, a hybrid heterogeneous network fusion model is established, and then, data features are extracted, and a fusion source big data acquisition algorithm is designed based on compressed sensing to complete data preprocessing to reduce the amount of data acquisition. Based on data mining association multisource fusion target, get the relationship between each measurement and target, and build multisource target data fusion tracking model to ensure the stable state of fusion results. It shows that the proposed method can save the tracking time and improve the tracking accuracy compared with the methods based on NNDA and PDA, which is more conducive to the real-time tracking of multisource targets.

Artificial intelligence has been applied in wildfire science and management since the 1990s, with early applications including neural networks and expert systems. Since then, the field has rapidly progressed congruently with the wide adoption of machine learning (ML) methods in the environmental sciences. Here, we present a scoping review of ML applications in wildfire science and management. Our overall objective is to improve awareness of ML methods among wildfire researchers and managers, as well as illustrate the diverse and challenging range of problems in wildfire science available to ML data scientists. To that end, we first present an overview of popular ML approaches used in wildfire science to date and then review the use of ML in wildfire science as broadly categorized into six problem domains, including (i) fuels characterization, fire detection, and mapping; (ii) fire weather and climate change; (iii) fire occurrence, susceptibility, and risk; (iv) fire behavior prediction; (v) fire effects; and (vi) fire management. Furthermore, we discuss the advantages and limitations of various ML approaches relating to data size, computational requirements, generalizability, and interpretability, as well as identify opportunities for future advances in the science and management of wildfires within a data science context. In total, to the end of 2019, we identified 300 relevant publications in which the most frequently used ML methods across problem domains included random forests, MaxEnt, artificial neural networks, decision trees, support vector machines, and genetic algorithms. As such, there exists opportunities to apply more current ML methods — including deep learning and agent-based learning — in the wildfire sciences, especially in instances involving very large multivariate datasets. We must recognize, however, that despite the ability of ML models to learn on their own, expertise in wildfire science is necessary to ensure realistic modelling of fire processes across multiple scales, while the complexity of some ML methods such as deep learning requires a dedicated and sophisticated knowledge of their application. Finally, we stress that the wildfire research and management communities play an active role in providing relevant, high-quality, and freely available wildfire data for use by practitioners of ML methods.

A dose deposition matrix (DDM) prediction method using several voxel features and a machine learning (ML) approach is proposed for plan optimization in radiation therapy. Head and lung cases with the inhomogeneous medium are used as training and testing data. The prediction model is a cascade forward backprop neural network where the input is the features of the voxel, including 1) voxel to body surface distance along the beamlet axis, 2) voxel to beamlet axis distance, 3) voxel density, 4) heterogeneity corrected voxel to body surface distance, 5) heterogeneity corrected voxel to beamlet axis, and (6) the dose of voxel obtained from the pencil beam (PB) algorithm. The output is the predicted voxel dose corresponding to a beamlet. The predicted DDM was used for plan optimization (ML method) and compared with the dose of MC-based plan optimization (MC method) and the dose of pencil beam-based plan optimization (PB method). The mean absolute error (MAE) value was calculated for full volume relative to the dose of the MC method to evaluate the overall dose performance of the final plan. For patient with head tumor, the ML method achieves MAE value 0.49 × 10-4 and PB has MAE 1.86 × 10-4. For patient with lung tumor, the ML method has MAE 1.42 × 10-4 and PB has MAE 3.72 × 10-4. The maximum percentage difference in PTV dose coverage (D98) between ML and MC methods is no more than 1.2% for patient with head tumor, while the difference is larger than 10% using the PB method. For patient with lung tumor, the maximum percentage difference in PTV dose coverage (D98) between ML and MC methods is no more than 2.1%, while the difference is larger than 16% using the PB method. In this work, a reliable DDM prediction method is established for plan optimization by applying several voxel features and the ML approach. The results show that the ML method based on voxel features can obtain plans comparable to the MC method and is better than the PB method in achieving accurate dose to the patient, which is helpful for rapid plan optimization and accurate dose calculation. Establishment of a new machine learning method based on the relationship between the voxel and beamlet features for dose deposition matrix prediction in radiation therapy.