Proposed Hybrid Method for Wavelet Shrinkage with Robust Multiple Linear Regression Model

Full text Figures and data Side by side Abstract Editor's evaluation Introduction Materials and methods Results Discussion Data availability References Decision letter Author response Article and author information Metrics Abstract Background: Oxygen uptake (VO2) is one of the most important measures of fitness and critical vital sign. Cardiopulmonary exercise testing (CPET) is a valuable method of assessing fitness in sport and clinical settings. There is a lack of large studies on athletic populations to predict VO2max using somatic or submaximal CPET variables. Thus, this study aimed to: (1) derive prediction models for maximal VO2 (VO2max) based on submaximal exercise variables at anaerobic threshold (AT) or respiratory compensation point (RCP) or only somatic and (2) internally validate provided equations. Methods: Four thousand four hundred twenty-four male endurance athletes (EA) underwent maximal symptom-limited CPET on a treadmill (n=3330) or cycle ergometer (n=1094). The cohort was randomly divided between: variables selection (nrunners = 1998; ncyclist = 656), model building (nrunners = 666; ncyclist = 219), and validation (nrunners = 666; ncyclist = 219). Random forest was used to select the most significant variables. Models were derived and internally validated with multiple linear regression. Results: Runners were 36.24±8.45 years; BMI = 23.94 ± 2.43 kg·m−2; VO2max=53.81±6.67 mL·min−1·kg−1. Cyclists were 37.33±9.13 years; BMI = 24.34 ± 2.63 kg·m−2; VO2max=51.74±7.99 mL·min−1·kg−1. VO2 at AT and RCP were the most contributing variables to exercise equations. Body mass and body fat had the highest impact on the somatic equation. Model performance for VO2max based on variables at AT was R2=0.81, at RCP was R2=0.91, at AT and RCP was R2=0.91 and for somatic-only was R2=0.43. Conclusions: Derived prediction models were highly accurate and fairly replicable. Formulae allow for precise estimation of VO2max based on submaximal exercise performance or somatic variables. Presented models are applicable for sport and clinical settling. They are a valuable supplementary method for fitness practitioners to adjust individualised training recommendations. Funding: No external funding was received for this work. Editor's evaluation The authors have established new formulas to predict maximum oxygen uptake for cyclists and runners based on submaximal exercise testing and anthropometric characteristics. This is an important study with a large and comprehensive dataset, which may be helpful for many exercise labs. The work is convincing, using appropriate and validated methodology in line with the current state-of-the-art, as shown by references to common exercise books. https://doi.org/10.7554/eLife.86291.sa0 Decision letter Reviews on Sciety eLife's review process Introduction The oxygen uptake (VO2) is considered an important metric in assessing cardiorespiratory fitness, health status, or endurance performance potential (Guazzi et al., 2012). With the application of standardised procedures and interpretation protocols, during graded exercise tests (GXT), the (maximal oxygen uptake) VO2max can be established (Bentley et al., 2007). GXT is the most widely used assessment to examine the dynamic relationship between exercise and integrated physiological systems (Albouaini et al., 2007; Bentley et al., 2007). The information from GXT during cardiopulmonary exercise testing (CPET) can be applied across the spectrum of sport performance, occupational safety screening, research, and clinical diagnostics (Guazzi et al., 2017). VO2 max is often used as a boundary between severe and extreme intensity domains and by definition requires maximal effort from the tested subject (Gaesser and Poole, 1996). However, it is not always recommended or possible to undertake a test to exhaustion (Guazzi et al., 2012). For the athletes, the proximity of competition or injury history can allow submaximal testing, but not testing to exhaustion (Sassi et al., 2006). Testing that requires maximal effort may be disruptive to the training process or interfere with race performance (Coutts et al., 2007; Lamberts et al., 2011). Due to practical constraints, tests to exhaustion or peak-power-output tests are often performed only two or three times a year (Coutts et al., 2007). However, VO2 values are widely used in sport science and the decision-making process (Mann et al., 2013). VO2 is widely considered one of the major endurance performance determinants (Joyner and Coyle, 2008). Using VO2max to guide the selection process, prescribing training intensity, assessing training adaptations, or predicting race times is a common practice in high-performance sports (Bassett and Howley, 2000; Bentley et al., 2007; Hawley and Noakes, 1992; Noakes et al., 1990). VO2max is also one of the critical vital signs coordinating the function of the cardiovascular, respiratory, and muscular systems, it is an indicator of overall body health status (Kaminsky et al., 2017). Quantifying VO2max provides additional input regarding clinical decision-making, risk stratification, evaluation of therapy, and physical activity guidelines (Guazzi et al., 2012). For patients undertaking a test to exhaustion is rarely needed or possible due to health restraints or cardiac risk (Guazzi et al., 2016). For many years researchers have studied indirect methods of estimating VO2max(Sartor et al., 2013). Protocols such as the Astrand-Ryhming Test, Six-Minute Walk Test, or YMCA Step Test have been established and validated (Astrand and Ryhming, 1954; Beutner et al., 2015; Carey, 2022; Jalili et al., 2018). Moreover, estimation of the VO2 and heart rate (HR) values below the ventilatory threshold can be based on cardiorespiratory kinetics assessment using randomised changes in the work rate known as a pseudo-random binary sequences testing (Hoffmann et al., 2022). However, with the development of technology, the accessibility of laboratory testing and mobile testing improved (Montoye et al., 2020; Pritchard et al., 2021). Therefore, new opportunities to develop more precise yet simple and accessible methods and models to assess VO2max occur (Jurov et al., 2023). This appears to be especially important considering the low prediction accuracy of most of the VO2max formulae that were validated in our previous study (Wiecha et al., 2023). Recently, we have been observing the development of prediction methods with the usage of machine learning (ML) and artificial intelligence (AI) (Ashfaq et al., 2022). Both ML and AI are used in sport science as forecasting and decision-making support tools (Abut and Akay, 2015; Bobowik and Wiszomirska, 2022; Chmait and Westerbeek, 2021; Hammes et al., 2022; Rossi et al., 2021). There is growing evidence that VO2max prediction based on ML models, especially support vector ML and artificial neural network models, exhibits more robust and accurate results compared to MLR only (Abut and Akay, 2015; Ashfaq et al., 2022). Therefore, in this research, with the support of ML, we look for algorithms and prediction patterns that allow us to use values obtained during submaximal CPET and somatic measurements to estimate maximal VO2max values in male runners and cyclists. We stipulate that prediction models allow for accurate calculation of VO2max based on somatic or submaximal CPET variables. Materials and methods We have applied the development and validation of the prediction TRIPOD guidelines to conduct the study (see Supplementary Material 1TRIPOD Checklist for Prediction Model Development and Validation) (Collins et al., 2015). The study is based on retrospective data analysis from the CPET registry collected from 2013 to 2021 at the medical clinic (Sportslab, Warsaw, Poland). All CPET have been performed at the individual request of participants, as a part of regular training monitoring or performance assessment. Ethical approval Request a detailed protocol The Institutional Review Board of the Bioethical Committee at the Medical University of Warsaw (AKBE/32/2021) has approved the study protocol. The regulations of the Declaration of Helsinki were met during all parts of the study. Each study participant delivered written consent to undergo CPET and participate in the study. Derivation cohort Request a detailed protocol We selected the cohort with the use of rigorous exclusion/inclusion criteria. Due to the insufficient number of women in our database and the number of potential variables in the regression models for adequate power, we had to limit ourselves to conduct analysis in the male population only (Martens and Logan, 2021). Out of 6439 healthy, adult male cyclists and long-distance runners that undergone CPET, 4423 met the criteria as further: (1) age ≥18 years, (2) declared regular cycling or running training for ≥3 months, (3) had no extreme outliers ≤ or ≥±3 standard deviations (SD) from mean for all of the testing variables (beyond ≥±3 SD in VO2max), (4) lack of any injury, medical condition, or addiction in medical history that may affect exercise capacity, (5) not taking any medications with a modifying effect on exercise capacity, (6) maximum exertion achieved during CPET. We defined the maximum exertion in CPET as the fulfilment of the minimum six of the following criteria: (1) respiratory exchange ratio (RER) ≥1.10, (2) present VO2 plateau (growth <100 mL·min–1 in VO2 despite increased running speed or cycling power), (3) respiratory frequency (fR) ≥45 breaths·min–1, (4) declared subjective exertion intensity during CPET ≥18 in the Borg scale (Borg, 1970), (5) blood lactate concentration [La-]b ≥8 mmol·L–1, (6) growth in speed/power ≥10% of respiratory compensation point (RCP) values after exceeding the RCP, (7) peak heart rate (HRpeak) ≥15 beats·min–1 below predicted maximal heart rate (HRmax) (Lach et al., 2021). Participants’ selection procedure has been shown in Figure 1. Figure 1 Download asset Open asset Flowchart of the preliminary inclusion and exclusion process. Abbreviations: EA, endurance athlete; CPET, cardiopulmonary exercise testing; SD, standard deviation; TE, treadmill; RER, respiratory exchange ratio; VO2, oxygen uptake (mL·min−1·kg−1); [La−]b, lactate concentration (mmol·L−1); fR, breathing frequency (breaths·min−1); RCP, respiratory compensation point; HRpeak, peak heart rate (beats·min−1); HRmax, maximal heart rate (bpm). At both stages of the selection, some participants met several (>1) exclusion criteria. Somatic measurements and CPET protocols Request a detailed protocol Body mass was measured with a body composition (BC) analyser (Tanita, MC 718, Japan) with the multifrequency of 5 kHz/50 kHz/250 kHz via the bioimpedance analysis and normal testing mode. The participants’ skin was cleaned with alcohol before placing the electrodes on the skin. Prior to the test, the participants received instructions to refrain from exercising for 2 hr, consume a light meal rich in carbohydrates 2–3 hr beforehand, and maintain hydration by drinking isotonic beverages. Additionally, they were advised to abstain from medications, caffeine, and cigarettes on the day of the test. Running CPET (TE) was performed on a mechanical treadmill (h/p/Cosmos Quasar, Germany). Cycling CPET (CE) was performed on Cyclus-2 (RBM elektronik-automation GmbH, Leipzig, Germany). Hans Rudolph V2 mask (Hans Rudolph, Inc, Shawnee, KS, USA), breath-by-breath method with Cosmed Quark CPET gas exchange analysing device (Cosmed Srl, Rome, Italy), and Quark PFT Suite to Omnia 1.6 software were utilised. The gas analyser device was regularly calibrated with the reference gas (16% O2; 5% CO2) in accordance with the manufacturer’s instructions (Airgas USA, LLC, Plumsteadville, PA, USA). From 2013 to 2021, three Cosmed Quark CPET units were used. HR was measured with the Cosmed torso belt (Cosmed srl, Rome, Italy). [La-]b was measured via enzymatic-amperometric electrochemical technique with Super GL2 analyser (Müller Gerätebau GmbH, Freital, Germany). The [La-]b analyser was regularly calibrated before each measurement series. The 40 m2 indoor, air-conditioned laboratory with 20–22°C temperature and 40–60% humidity, and 100 m ASL provided the same conditions for all BC and CPET. Each CPET began with a 5 min personalised warm-up (walk or easy jog with ‘conversational’ intensity for running, easy pedalling with ‘conversational’ intensity for cycling). Then after the preparation (about 5 min), the continuous progressive step test was conducted. Due to the population diversity (training status), the running test speed started from 7 to 12 km·hr–1 with a 1% treadmill incline. The choice of initial starting speed was determined by the interview and sports results achieved. For example, those running less than 60 min at a distance of 10 km started the test at 7 km/hr, while those running 10 km for less than 35 min started the test at an initial speed of 12 km/hr. The pace increased by 1 km·hr–1 every 2 min with no change in incline. The cycling test began at 60–150 W, depending on the athletes training status. The power increased by 20–30 W every 2 min. It was recommended to maintain a constant cadence of 80–90 (repetition·min–1) during the test. The tests were terminated due to exhaustion: volitional inability to continue the activity or/and VO2 and HR plateau with increasing load or/and observed disturbance of coordination in running or/and inability to maintain the set cadence. Due to the graded protocol used, the cycling power and running speed values have been calculated as a function of time to better reflect the actual level for the test moment being determined (Kuipers et al., 1985). Before the test, after every step, and 3 min after the termination of the effort technician took a 20 µL blood sample from a fingertip. Samples were collected during the test without interrupting the effort. The samples were taken from the initial puncture. The first blood drop was collected into the swab and the second blood drop was drawn for further analysis into the capillary. VO2max was recorded as the highest value (15 s intervals) before the termination of the test. HRmax was recorded as the highest value obtained at the end of the test, without averaging. The anaerobic threshold (AT) was established with the following criteria: (1) common start of VE/VO2 and VE/VCO2 curves, (2) end-tidal partial pressure of oxygen raised constantly with the end-tidal partial pressure of carbon dioxide (Beaver et al., 1986). The was established with the following criteria: (1) PetCO2 must decrease after reaching maximal amount, (2) the presence of fast nonlinear growth in VE (second deflection), (3) the VE/VCO2 ratio achieved minimum and started to rise, and (4) a nonlinear increase in VCO2 versus VO2 (lack of linearity) (Beaver et al., 1986). The [La-]b was estimated for AT and RCP in relation to power or speed (Wiecha et al., 2022). Data analysis Request a detailed protocol Our comprehensive ML approach enables the evaluation of each formula by preliminary variables precision (at the stage of selection), then accuracy (during the model’s building) and recall (in internal validation). Individual CPET results were saved into the Excel file (Microsoft Corporation, Redmond, WA, USA) and a custom-made script was used to generate the database in Excel (Python programming). Further, mean, SD, and 95% confidence intervals (CI) were calculated. The normality of the distribution of the data was examined using the Shapiro-Wilk test and intergroup differences were calculated using the Student’s t-test for independent variables. Three-step variable selection procedures based on random forests were applied using the R package VSURF in RStudio software (R Core Team, Vienna, Austria; version 3.6.4) (Genuer et al., 2016). For each level of measurement (AT, RCP) and their combination (AT+RCP), significant variables were identified separately. The first step was dedicated to eliminate irrelevant variables from the dataset. Second step aimed to select all variables related to the response for interpretation purposes. The third step refined the selection by eliminating redundancy in the set of variables selected by the second step, for prediction purposes (Genuer et al., 2017). Each time for variables selection, the anthropometric variables as in Tables 1–2 and the CPET parameters given in Tables 3–4 from a specific level of measurement (AT; RCP) and their combinations were visible. Table 1 Basic anthropometric characteristics for runners. Variable (unit)Derivation group n=1998Testing group n=666Validation group n=666MeanCISDMeanCISDMeanCISDAge (years)36.235.6–36.98.4535.935.5–36.38.0535.534.9–36.28.14Height (cm)180.0179.6–180.56.04179.4179.1–179.76.13179.7179.2–180.26.61BM (kg)77.777.0–78.49.3577.777.3–78.19.2977.977.1–78.610.1BMI (kg·m–2)23.923.8–24.12.4324.124.0–24.22.4124.123.9–24.32.56BF (%)15.415.1–15.74.5515.515.3–15.74.5215.415.1–15.84.55FM (kg)12.211.9–12.64.6812.312.1–12.54.6512.311.9–12.74.92FFM (kg)65.565.0–66.06.4365.465.1–65.76.3165.665.1–66.16.86 BM, body mass; BMI, body mass index; BF, body fat; FM, fat mass; FFM, fat-free mass; CI, 95% confidence interval; SD, standard deviation. Table 2 Basic anthropometric characteristics for cyclists. Variable (unit)Derivation group n=656Testing group n=219Validation group n=219MeanCISDMeanCISDMeanCISDAge (years)37.336.6–38.09.1337.135.9–38.49.5037.636.5–38.88.46Height (cm)179.9179.4–180.46.27180.1179.2–181.06.96180.2179.4–181.06.13BM (kg)78.878.1–79.69.8079.177.7–80.510.479.878.4–81.310.9BMI (kg·m–2)24.324.1–24.62.6324.424.0–24.72.8024.624.2–25.02.96BF (%)16.415.7–17.14.9916.115.7–16.54.8116.215.5–16.84.87FM (kg)13.312.6–14.15.6613.012.6–13.45.2713.312.5–14.05.85FFM (kg)65.864.9–66.66.2565.865.4–66.36.0666.665.7–67.46.58 BM, body mass; BMI, body mass index; BF, body fat; FM, fat mass; FFM, fat-free mass; CI, 95% confidence interval; SD, standard deviation. Table 3 Cardiopulmonary exercise testing (CPET) characteristics for runners. Variable (unit)Derivation group n=1998Testing group n=666Validation group n=666MeanCISDMeanCISDMeanCISDrVO2AT (mL·min–1·kg–1)38.438.1–38.85.0138.538.3–38.74.8838.137.7–38.55.16RERAT0.870.86–0.870.040.870.86–0.870.040.870.86–0.870.04HRAT (beats·min–1)151.5150.8–152.310.3151.0150.6–151.510.8152.0151.2–152.810.8VEAT (L·min–1)79.178.1–80.012.278.377.8–78.912.077.276.3–78.212.0SPEEDAT (km·h–1)11.010.9–11.11.4511.011.0–11.11.3610.910.8–11.01.42LAAT (mmol·L–1)2.082.02–2.140.631.801.76–1.830.622.352.27–2.420.72rVO2RCP (mL·min–1·kg–1)47.547.0–48.05.8847.747.4–48.06.1547.346.8–47.86.16RERRCP1.001.00–1.000.041.001.00–1.000.041.001.00–1.000.03HRRCP (beats·min–1)173.4172.7–174.19.21173.2172.8–173.69.30174.3173.5–175.09.50VERCP (L·min–1)114.7113.5–116.015.9113.9113.1–114.616.7112.7111.4–114.016.2SPEEDRCP (km·h–1)14.013.9–14.11.7714.114.0–14.11.7013.913.8–14.11.75LARCP (mmol·L–1)4.724.63–4.821.044.404.34–4.451.044.814.69–4.931.14rVO2max (mL·min–1·kg–1)53.853.3–54.36.6754.354.0–54.66.9553.853.3–54.37.09 CI, 95% confidence interval; SD, standard deviation; rVO2AT, oxygen uptake at anaerobic threshold relative to body mass; RERAT, respiratory exchange ratio at anaerobic threshold; HRAT, heart rate at anaerobic threshold; VEAT, pulmonary ventilation at anaerobic threshold; SPEEDAT, velocity at anaerobic threshold; LAAT, blood lactate concentration at anaerobic threshold; rVO2RCP, oxygen uptake at respiratory compensation point relative to body mass; RERRCP, respiratory exchange ratio at respiratory compensation point; HRRCP, heart rate at respiratory compensation point; VERCP, pulmonary ventilation at respiratory compensation point; SPEEDRCP, velocity at respiratory compensation point; LARCP, blood lactate concentration at respiratory compensation point; rVO2max, maximal oxygen uptake relative to body mass. Table 4 Cardiopulmonary exercise testing (CPET) characteristics for cyclists. Variable (unit)Derivation group n=656Testing group n=219Validation group n=219MeanCISDMeanCISDMeanCISDrVO2AT (mL·min–1·kg–1)33.032.5–33.45.8433.232.4–33.95.6833.732.9–34.55.89RERAT0.870.87–0.870.040.870.87–0.880.040.870.87–0.880.04HRAT CI, 95% confidence interval; SD, standard deviation; rVO2AT, oxygen uptake at anaerobic threshold relative to body mass; RERAT, respiratory exchange ratio at anaerobic threshold; HRAT, heart rate at anaerobic threshold; VEAT, pulmonary ventilation at anaerobic threshold; power at anaerobic threshold relative to body mass; LAAT, blood lactate concentration at anaerobic threshold; rVO2RCP, oxygen uptake at respiratory compensation point relative to body mass; RERRCP, respiratory exchange ratio at respiratory compensation point; HRRCP, heart rate at respiratory compensation point; VERCP, pulmonary ventilation at respiratory compensation point; LARCP, blood lactate concentration at respiratory compensation point; power at respiratory compensation point relative to body mass; rVO2max, maximal oxygen uptake relative to body mass. selection variables were in the further only selected parameters were into multiple linear regression The data for MLR model building were randomly into that is testing, validation and of the a only significant were in the Derived are by the of mean and mean analysis was used to the model’s precision and accuracy during validation and tests to the fulfilment of MLR test the of in MLR test assessment between and test of Each model was examined the and any have not been 2 package in RStudio (R Core Team, Vienna, Austria; version version for and software version were used in was considered as the Results Somatic measurements and CPET results data of the runners models for testing, and validation are in Table while cyclists are in Table The runners of and for testing, and validation the cyclists and differences between of runners and cyclists were in BMI and between testing in all between validation only in CPET results for runners models are in Table 3 and for cyclists in Table Runners in the cohort achieved relative to body mass VO2max of in testing group and in validation group cyclists mean was and for testing, and validation to body mass oxygen uptake at anaerobic threshold in runners for ± ± and ± of in testing, and validation it was ± ± and ± of rVO2max, relative to body mass oxygen uptake at respiratory compensation point in runners for ± ± and ± of for testing, and validation while in cyclists for ± ± and ± of rVO2max, There were no significant differences in values between testing, and validation the runners and cyclists between runners and cyclists results were all significant Prediction models based on AT and RCP Full of MLR prediction models for cyclists are in Table for runners in Table The models prediction performance is as with and for cyclists from for somatic parameters to for RCP equations. For runners from for to for AT and equations. for cyclists models was the for RCP and the highest for For from for AT and to for equation. observed for cyclists was the for RCP in the validation group and the highest for while in runners the for AT and and the highest for The performance of prediction is in Figure Figure 2 Download asset Open asset of prediction for Abbreviations: maximal oxygen anaerobic threshold; RCP, respiratory compensation point; All values are in performance for running while the performance for cycling equations. performance of the prediction model for for for AT and for somatic-only equation. Table 5 VO2max prediction for cyclists. linear regression group group = = = = based on anaerobic threshold; RCP, based on respiratory compensation point; based on somatic variables mean mean maximal oxygen uptake relative to body mass rVO2AT, oxygen uptake at anaerobic threshold relative to body mass power at anaerobic threshold relative to body mass rVO2RCP, oxygen uptake at respiratory compensation point relative to body mass VERCP, pulmonary ventilation at respiratory compensation point BF, body fat BM, body mass Table VO2max prediction for runners. linear regression group group = = = = based on anaerobic threshold; RCP, based on respiratory compensation point; based on somatic variables mean mean maximal oxygen uptake relative to body mass rVO2AT, oxygen uptake at anaerobic threshold relative to body mass SPEEDAT, velocity at anaerobic threshold FFM, fat mass VEAT, pulmonary ventilation at anaerobic threshold HRAT, heart rate at anaerobic threshold BF, body fat rVO2RCP, oxygen uptake at respiratory compensation point relative to body mass SPEEDRCP, velocity at respiratory compensation point Models validation of each model for cyclists is in Table while for runners in Table the performance of our prediction was to that observed in the

Crop yield forecasting has been well studied in recent decades and is significant in protecting food security. Crop growth is a complex phenomenon that depends on various factors. Machine learning and deep learning trends have emerged as important innovations in this field. We propose to utilize crop, weather, and soil data from agricultural datasets to evaluate yield prediction behavior. Paddy being a staple food crop in India is chosen for this research. In this paper, we propose hybrid architecture for paddy yield prediction, namely, MLR-LSTM, which combines Multiple Linear Regression and Long Short-Term Memory to utilize their complementary nature. The results are compared with traditional machine learning methods such as Support vector machine, Long short-term memory and Random forest method. Evaluation metrics such as Coefficient of Determination (R2), Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Square Error (MSE), F1 score, Recall, and Precision are used to evaluate the hybrid method and traditional models. The results obtained from the proposed hybrid method indicates that the hybrid model delivers better R2, RMSE, MAE, MSE values of 0.93, 0.1549, 0.199, and 0.024 respectively.

The applicability of artificial neural networks (ANNs) and the adaptive neuro-fuzzy inference system (ANFIS) for determination of mean velocity and discharge of natural streams is investigated. The 2,184 field data obtained from four different sites on the Sarimsakli and Sosun streams in central Turkey were used in the study. ANNs and ANFIS models use the inputs, water surface velocity and water surface slope, to estimate the mean velocity and discharges of natural streams. The accuracies of both models were compared with the multiple-linear regression (MLR) model. The comparison results showed that the ANFIS model performed better than the ANNs and regression models for estimating mean velocity and discharge. The ANN model also showed better accuracy than the MLR model. The root mean square errors (RMSE) and mean absolute relative errors (MARE) of the MLR model were reduced by 88 and 91 % using the ANFIS model in estimating discharges, respectively. It is found that the optimal ANFIS model with RMSE of 0,063, MARE of 3,47 and determination coefficient (R2) of 0,996 in the test period is superior in estimation of discharge than the MLR model with RMSE of 0,532, MARE of 38,9 and R2 of 0,776, respectively. The study reveals that the ANFIS technique can be successfully used for estimating the mean velocity and discharge of natural streams by using only the inputs of water surface velocity and water surface slope.

The aim of the present research is to calculate the Relative Accuracy (R.A) and Root Mean Square Error (RMSE) for the location of Technical Institute, Mosul in Nineveh Governorate, Iraq. at the northern part of Mosul city by using surveying Instruments (GPS 1230 , Total Station 06 & Level NAK2), to calculate the coordinates and elevations of (16) Ground Control Points which covered the study area. The field data, remote sensing techniques and GIS software (Arc Map GIS10.3) are used to check the digital map of study area that helped the administrator to take the correct decision, determining positions of the future expansionist for buildings, roads, measuring lengths, areas and there coordinates, directions as well as the total costs estimation needed for any development from the final map. The gradient percentage between the highest and lowest points is calculated to be (9.954%). Relative accuracy for the based measured points (R.A) = 1:60000), and Root Mean Square error in Easting coordinates (RMSE) = ± 0.102m, in Northing coordinates (RMSN) = ± 0.096m, the Root Mean Square for the resultant (RMSR) = ± 0.099m, and Root Mean Square for Elevations ( RMSRL)= ± 0.005m. We Matched and correlated (10) measured points from study area with their graphic data positions on the aerial photo, determining the offsets for position and elevations as follows: (RMSE = ± 0.076m), (RMSN = ± 0.125m), (RMSR = ± 0.088m), and (Root Mean Square for Elevations = RMSRL= ± 0.045m). This research enable us after checking the results to produce new maps from Aerial photograph or Digital Image to use it for land uses and future extensions in whole study area.

Spatial prediction of soil organic carbon is a crucial proxy to manage and conserve natural resources, monitoring CO2 and preventing soil erosion strategies within the landscape, regional, and global scale. The objectives of this study was to evaluate capability of artificial neural network and multivariate linear regression models in order to predict soil organic carbon using terrain attributes. A study area of 24 km2 in hilly regions of Zargham Ababd in south of Semirom under natural rangeland uses, was selected and then 125 soil samples (0-10 cm depth) were collected. Soil organic carbon was measured for the collected soil samples. Topographic attributes were calculated by a digital elevation model with 10 m spacing. Finally, multiple linear regression (MLR) analysis and ANN models were developed for soil organic carbon estimation in the study area and then the developed modeless were validated by additional samples (25 points). The results showed that the MLR and ANN models explained 60 and 89 % of the total variability of SOC, respectively, in the study area using terrain attributes. Sensitivity analysis based upon the ANN models, revealed that the profile curvature, stream power index, slope, sediment transport index, wetness index, plan curvature and aspect were identified as the important topographic attributes influencing the SOC distribution within the selected hillslope. The overall results indicated that topographic attributes and hydrological process control a significant variability of SOC. Prediction of the statistical studied models in the study area resulted in mean error and root mean square error values of 0.25, 0.3 in MLR equation and 0.006, 0.027 in ANN, respectively. Therefore, the ANN model could provide superior predictive performance when compared with developed MLR model. Keywords: Soil organic carbon, Terrain attributes, Linear regression, Artificial neural network

A modified simple-to-use interactive self-modeling mixture analysis (SIMPLISMA) combined with successive projections algorithm (SPA) is proposed for robust optimization of calibration model. It is not as SIMPLISMA do originally for pure variables selection, the modified SIMPLISMA is for feature samples selection, and getting the calibration sample set with minimum colinear. At meanwhile, SPA is introduced for informative wavelength variables selection. Under the determination algorithm of SIMPLISMA-SPA, the calibration model is optimized with selected samples and variables simultaneously. Two visible near infrared (VIS-NIR) spectra analysis experiments (distilled water pH detection experiment by spectrophotometer and distilled water pH detection experiment by grating spectrograph) are employed to evaluate the performance of SIMPLISMA-SPA. The results indicate that, for the experiment with spectrophotometer, under the SIMPLISMA-SPA, 21 samples and 18 variables are selected from the original 34 samples and 351 variables for constructing multiple linear regression (MLR) model, the root mean square errors (RMSE) of cross validation is 0.047, it is higher than the model of sample set partitioning based on joint x-y distance combined with successive projections algorithm (SPXY-SPA); for the experiment with grating spectrograph, under the SIMPLISMA-SPA, 34 samples and 33 variables are selected from the original 60 samples and 2860 variables for constructing MLR model, the RMSE of cross validation is 0.008, the performance is similar to the MLR model with SPXY-SPA. The conclusions show that, SIMPLISMA-SPA can be as an alternative multivariate calibration model optimization method for VIS-NIR spectral analysis.

Development of enhanced emission factor equations for paved and unpaved roads using artificial neural network

Bioelectrical signals such as electrocardiogram (ECG) and flow cytometry signals are often affected by both low-frequency and high frequency perturbations during data acquisition. It is necessary to remove these interferences from the acquired data so that the pertinent information needed from these signals can be obtained. Methods for detrending and denoising in ECG are well established, but in the context of impedance cytometry data, there lacks a body of literature available that provides guidance as to a robust methodology for processing the data. For the first time in the context of impedance cytometry, to the best of our knowledge, in this work we systematically studied and compared the performance of different algorithms for detrending and denoising, and developed a procedure to analyze impedance cytometry data with minimal error. This work can serve as guidance to select the optimal algorithm based on the following parameters: Standard Deviation, Correlation Coefficient, Power Spectral Density (PSD), Root Mean Square Error (RMSE) and Root Mean Square Difference (RMSD). The approaches discussed conventional filtering techniques such as: Butterworth Filtering, Chebyshev Filtering, as well as the thresholding techniques in the Discrete Wavelet Transform (DWT). The procedure of selecting the mother wavelet basis functions and the four different thresholding methods are discussed and compared. The performance of the optimized algorithm is compared with the pClamp10 commercially available cytometry analysis software resulting in 19.2% improvement in amplitude preservation, 18.4% improvement in area preservation and more than 50% improvement in the peak-search error rate.

The concept of orthometric heights system determination plays a major key role in geodesy, and it has broad applications in various fields and activities. In geodesy, one significant quantity is the orthometric height, the height above or below the geoid along the gravity plumbline. Conventionally, the orthometric height is determined by gravimetry and levelling techniques. However, the aforementioned techniques has its own demerits. Thus, the error is accumulated with the increase of the propagation measurement line, it is difficult to convert two separated points which is located in two continents or islands separated by sea. These techniques are tedious, time consuming and expensive. In order to resolve this challenge, many researchers resort to various techniques and approaches of obtaining orthometric heights for an area using various mathematical models. It is in this quest that, this study seek to estimate orthometric heights of a mine by utilizing plausible alternative techniques based on artificial neural networks (ANN), multivariate adaptive regression splines (MARS), polynomial regression models and multiple linear regression (MLR). The working efficiency and performance of each model has been assessed based on statistical indicators of Mean (M), Mean Square Error (MSE), Root Mean Square Error (RMSE), Mean Bias Error (MBE), Mean Absolute Error (MAE), Standard Deviation (SD), Correlation coefficient (R), Correction of determination (R2), and Signal to Noise Ratio (SNR). The statistical findings reveal that all the models produce satisfactory results in estimating the orthometric heights in the mine. MARS and ANN models compare to the MLR and polynomial models achieved higher results in terms of accuracy with mean and standard deviation of -0.000001888 m, +2.24736 m, and +0.005835 m and 0.095063 m respectively. This study will create the opportunity for geospatial practitioners to recognize the significant of ANN, MARS, MLR, and Polynomial model in solving some of the problems in geoscientific community.

Prediction of suspended sediment discharge in a catchments area is very important because it can be used to evaluation the erosion hazard, management of its water resources, water quality, hydrology project management (dams, reservoirs, and irrigation) and to determine the extent of the damage that occurred in the catchments. Multiple Linear Regression analysis and artificial neural network can be used to predict the amount of daily suspended sediment discharge. Regression analysis using the least square method, whereas artificial neural networks using Radial Basis Function (RBF) and feedforward multilayer perceptron with three learning algorithms namely Levenberg-Marquardt (LM), Scaled Conjugate Descent (SCD) and Broyden-Fletcher-Goldfarb-Shanno Quasi-Newton (BFGS). The number neuron of hidden layer is three to sixteen, while in output layer only one neuron because only one output target. The mean absolute error (MAE), root mean square error (RMSE), coefficient of determination (R2 ) and coefficient of efficiency (CE) of the multiple linear regression (MLRg) value Model 2 (6 input variable independent) has the lowest the value of MAE and RMSE (0.0000002 and 13.6039) and highest R2 and CE (0.9971 and 0.9971). When compared between LM, SCG and RBF, the BFGS model structure 3-7-1 is the better and more accurate to prediction suspended sediment discharge in Jenderam catchment. The performance value in testing process, MAE and RMSE (13.5769 and 17.9011) is smallest, meanwhile R2 and CE (0.9999 and 0.9998) is the highest if it compared with the another BFGS Quasi-Newton model (6-3-1, 9-10-1 and 12-12-1). Based on the performance statistics value, MLRg, LM, SCG, BFGS and RBF suitable and accurately for prediction by modeling the non-linear complex behavior of suspended sediment responses to rainfall, water depth and discharge. The comparison between artificial neural network (ANN) and MLRg, the MLRg Model 2 accurately for to prediction suspended sediment discharge (kg/day) in Jenderan catchment area.

OPINION article Front. Physiol., 22 January 2014Sec. Integrative Physiology Volume 4 - 2013 | https://doi.org/10.3389/fphys.2013.00403

본 연구는 Deep Neural Network(DNN)을 이용하여 광주-기아 챔피언스 필드의 일일 관중 수를 예측함으로써 이를 통해 구단과 관련기업의 마케팅 자료제공 및 구장 내 부대시설의 재고관리에 자료로 쓰임을 목적으로 수행 되었다. 본 연구 에서는 Artificial Neural Network(ANN)의 종류인 DNN 모델을 이용하였으며 DNN 모델의 과적합을 막기 위해 Dropout 과 Batch normalization 적용한 모델을 바탕으로 총 4종류를 설계하였다. 각각 10개의 DNN을 만들어 예측값의 Root Mean Square Error(RMSE)와 Mean Absolute Percentage Error(MAPE)의 평균값을 낸 모델과 예측값의 평균으로 RMSE와 MAPE를 평가한 Ensemble 모델을 만들었다. 모델의 학습 데이터는 2008년부터 2017년까지의 관중 수 데이터를 수집하여 수집된 데이터의 80%를 무작위로 선정하였으며, 나머지 20%는 테스트 데이터로 사용하였다. 총 100회의 데이터 선정, 모델구성 그리고 학습 및 예측을 한 결과 Ensemble 모델은 DNN 모델의 예측력이 가장 우수하게 나왔으며, 다중선 형회귀 모델 대비 RMSE는 15.17%, MAPE는 14.34% 높은 예측력을 보이고 있다.In this paper, we used the Deep Neural Network (DNN) to predict the number of daily spectators of Gwangju -KIA Champions Field in order to provide marketing data for the team and related businesses and for managing the inventories of the facilities in the stadium. In this study, the DNN model, which is based on an artificial neural network (ANN), was used, and four kinds of DNN model were designed along with dropout and batch normalization model to prevent overfitting. Each of four models consists of 10 DNNs, and we added extra models with ensemble model. Each model was evaluated by Root Mean Square Error (RMSE) and Mean Absolute Percentage Error (MAPE). The learning data from the model randomly selected 80% of the collected data from 2008 to 2017, and the other 20% were used as test data. With the result of 100 data selection, model configuration, and learning and prediction, we concluded that the predictive power of the DNN model with ensemble model is the best, and RMSE and MAPE are 15.17% and 14.34% higher, correspondingly, than the prediction value of the multiple linear regression model.

This study predicts the strength of rotary brace damper by analyzing a new set of probabilistic models using the usual method of multiple linear regressions (MLR) and advanced machine-learning methods of multivariate adaptive regression splines (MARS), Rotary brace damper can be easily assembled with high energy-dissipation capability. To investigate the behavior of this damper in structures, a steel frame is modeled with this device subjected to monotonic and cyclic loading. Several response parameters are considered, and the performance of damper in reducing each response is evaluated. MLR and MARS methods were used to predict the strength of this damper. Displacement was determined to be the most effective parameter of damper strength, whereas the thickness did not exhibit any effect. Adding thickness parameter as inputs to MARS and MLR models did not increase the accuracies of the models in predicting the strength of this damper. The MARS model with a root mean square error (RMSE) of 0.127 and mean absolute error (MAE) of 0.090 performed better than the MLR model with an RMSE of 0.221 and MAE of 0.181.

Accurate estimation of municipal solid waste (MSW) generation has become a crucial task in decision-making processes for the MSW planning and management systems. In this study, the Gaussian process regression (GPR) model tuned by Bayesian optimization was used to forecast the MSW generation of Turkey. The Bayesian optimization method, which can efficiently optimize the hyperparameters of kernel functions in the machine learning algorithms, was applied to reduce the computation redundancy and enhance the estimation performance of the models. Four socio-economic indicators such as population, gross domestic product per capita, inflation rate, and the unemployment rate were used as input variables. The performance of the Bayesian GPR (BGPR) model was compared with the multiple linear regression (MLR) and Bayesian support vector regression (BSVR) models. Different performance measures such as mean absolute deviation (MAD), root mean square error (RMSE), and coefficient of determination (R2) values were used to evaluate the performance of the models. The exponential-GPR model tuned by Bayesian optimization showed superior performance with minimum MAD (0.0182), RMSE (0.0203), and high R2 (0.9914) values in the training phase and minimum MAD (0.0342), RMSE (0.0463), and high R2 (0.9841) values in the testing phase. The results of this study can help decision-makers to be aware of social-economic factors associated with waste management and ensure optimal usage of their resources in future planning.

ABSTRACTIn the context of widespread saline and sodic soil, mapping and monitoring spatial distribution of soil salinity and sodicity are important for utilization and management in agriculture lands. In this study, two-stage assessment was proposed to predict spatial distribution of saline and sodic soils. First, artificial neural network (ANN) and multiple linear regressions (MLR) model were used to predict sodium adsorption ratio (SAR) and exchangeable sodium percentage (ESP) based on soil electrical conductivity (EC) and pH. Then, the Kriging interpolation method combined with overlay mapping technique was used to perform saline spatial predictions in the study area. The model accuracy level is evaluated based on coefficient of determination (R2) and root mean square error (RMSE). In the first stage, the values of R2 and RMSE of SAR and ESP were 0.94, 0.17 and 0.94, 0.24 for ANN, and 0.35, 0.52 and 0.34, 0.76 for MLR, respectively. Similarly, in the second stage, the RMSE of ANN-Kriging were much closer to 0 and relatively lower than MLR-Kriging and Kriging. The results show that ANN-Kriging can be used to improve the accuracy of mapping and monitoring spatial distribution of saline and sodic soil in areas that develop the rice-shrimp cultivation model.