Automatic nonlinear predictive model-construction algorithm using forward regression and the PRESS statistic

Rapid prediction of cellulose, hemicellulose, and lignin content in biomass using FTIR based on transfer learning

This paper introduces a new robust nonlinear identification algorithm using the predicted residual sums of squares (PRESS) statistic and forward regression. The major contribution is to compute the PRESS statistic within a framework of a forward orthogonalization process and hence construct a model with a good generalization property. Based on the properties of the PRESS statistic the proposed algorithm can achieve a fully automated procedure without resort to any other validation data set for iterative model evaluation.

Livestock management faces a significant challenge in ensuring effective traceability and monitoring of food-producing animals. Advances in human biometric technologies have prompted the use of face recognition technology for goat identification and verification. This research project aims to enhance goat face recognition accuracy through the utilization of two versions of labelled images and video frame images. The primary challenge lies in determining the optimal type of training data to use. Regular validation on diverse datasets encompassing various goat face recognition scenarios is crucial to ensure the model's generalization capabilities. Furthermore, the dataset utilized reflects the complexities associated with livestock surveillance, including diverse settings and lighting conditions, posing significant challenges to accurate goat detection and recognition. The objectives of this study are to develop a robust system capable of effectively addressing these challenges and to strike a balance between training data inclusion and model generalization. The methodology employed involves leveraging Roboflow to extract frames from video data, label the images, preprocess them, and apply augmentation techniques to enhance dataset diversity. Frames from test videos, initially treated as "unseen" data, have been pivotal in improving the model's recognition capabilities by exposing it to realistic conditions. The project's methodology highlights the dynamic nature of model development and refinement in addressing real-world challenges in livestock management. Overall, the project aims to contribute to the advancement of goat detection and recognition systems, with promising results expected in improving livestock management practices. Ongoing experimentation and adaptation of techniques, such as adjustments to model architecture and hyperparameters, are conducted to achieve this.

This study introduces significant improvements in the construction of deep convolutional neural network models for classifying agricultural products, specifically oranges, based on their shape, size, and color. Utilizing the MobileNetV2 architecture, this research leverages its efficiency and lightweight nature, making it suitable for mobile and embedded applications. Key techniques such as depthwise separable convolutions, linear bottlenecks, and inverted residuals help reduce the number of parameters and computational load while maintaining high performance in feature extraction. Additionally, the study employs comprehensive data augmentation methods, including horizontal and vertical flips, grayscale transformations, hue adjustments, brightness adjustments, and noise addition to enhance the model's robustness and generalization capabilities. The proposed model demonstrates superior performance, achieving an overall accuracy of 99.53%∼100% with nearly perfect precision, recall of 95.7%, and F1-score of 94.6% for both “orange_good” and “orange_bad” classes, significantly outperforming previous models which typically achieved accuracies between 70% and 90%. While the classification performance was near-perfect in some aspects, there were minor errors in specific detection tasks. The confusion matrix shows that the model has high sensitivity and specificity, with very few misclassifications. Finally, this study highlights the practical applicability of the proposed model, particularly its easy deployment on resource-constrained devices and its effectiveness in agricultural product quality control processes. These findings affirm the model in this research as a reliable and highly efficient tool for agricultural product classification, surpassing the capabilities of traditional models in this field.

Reconstructing as‐built building information modeling from point clouds in underground garages holds great potential for enhancing facility management. However, this task is particularly challenging due to the complex and diverse architectural and mechanical, electrical, and plumbing (MEP) components present in such environments. Moreover, there is no publicly available dataset and no dedicated semantic segmentation algorithm for underground garages environments. To address this gap, this paper first builds an expert‐labeled underground garage dataset, which includes 10 categories of components. Subsequently, this paper introduces GarageNet, a deep learning (DL) network designed for semantic segmentation of point clouds for scenes including both building and MEP components. GarageNet integrates a residual squeeze‐and‐excitation module to enhance layer and channel connection and a multi‐head attention feature aggregation module to capture local geometric structures. The results indicate that the GarageNet achieved a high overall accuracy of 95.09% and a mean intersection over union of 87.15%, surpassing other DL algorithms such as PointNext. Ablation studies and cross‐validation further demonstrate the model's reliability and generalization capability.

This paper pioneers a novel approach in electromagnetic (EM) system analysis by synergistically combining Bayesian Neural Networks (BNNs) informed by Latin Hypercube Sampling (LHS) with advanced thermal-mechanical surrogate modeling within COMSOL simulations for high-frequency low-pass filter modeling. Our methodology transcends traditional EM characterization by integrating physical dimension variability, thermal effects, mechanical deformation, and real-world operational conditions, thereby achieving a significant leap in predictive modeling fidelity. Through rigorous evaluation using Mean Squared Error (MSE), Maximum Learning Error (MLE), and Maximum Test Error (MTE) metrics, as well as comprehensive validation on unseen data, the model's robustness and generalization capability is demonstrated. This research challenges conventional methods, offering a nuanced understanding of multiphysical phenomena to enhance reliability and resilience in electronic component design and optimization. The integration of thermal variables alongside dimensional parameters marks a novel paradigm in filter performance analysis, significantly improving simulation accuracy. Our findings not only contribute to the body of knowledge in EM diagnostics and complex-environment analysis but also pave the way for future investigations into the fusion of machine learning with computational physics, promising transformative impacts across various applications, from telecommunications to medical devices.

Aiming at the problem that the boiler thermal efficiency can't be on-line calculated in the field, data collected are divided into training data and testing data by researching on the 1000MW unit of Sanbaimen Power Plant in Datang Chaozhou, and then prediction model for boiler thermal efficiency is established by applying support vector regression and particle swarm optimization. This method uses optimization function of particle swarm algorithm to optimize the parameters C and g of the prediction model, and applys test data and the randon data to test the model's accuracy and generalization capability. The simulation results show that prediction model for boiler thermal efficiency has higher pre- diction accuracy that relative error is controlled within 1% and has better generalization ability, which provides feasible scheme for online measurement of boiler thermal efficiency.

Optimizing Time-Series forecasting using stacked deep learning framework with enhanced adaptive moment estimation and error correction

This study investigates the effectiveness of an Artificial Neural Network (ANN) model in enhancing the classification of dry beans varieties. The dry beans dataset, comprising 13,611 samples and 16 numerical features, was preprocessed using Z-score normalization for outlier removal and Principal Component Analysis (PCA) to remove 702 outliers and reduce dimensionality to 10 components while preserving 99.99% of the original variance. A feedforward ANN architecture was designed, constructed as a feedforward neural network with three fully connected layers namely, an input layer that receives 10 features (as reduced by PCA), a first hidden layer with 16 neurons and ReLU activation, a second hidden layer with 32 neurons and ReLU activation, and an output layer with neurons equal to the number of classes, using softmax activation for multi-class probability prediction. The model was trained over 60 epochs using TensorFlow/Keras. Evaluation on a held-out test set demonstrated that the ANN model achieved a classification accuracy of 94.50%. Performance metrics, including accuracy, precision, recall, F1-score, and confusion matrix analysis, confirmed the model's robustness and generalization capability across all dry beans’ classes. The findings affirm that ANN models, when supported by appropriate preprocessing, can serve as scalable and accurate alternatives to conventional machine learning approaches in agricultural classification tasks.

Pepper is a high-economic-value agricultural crop that faces diverse disease challenges such as blight and anthracnose. These diseases not only reduce the yield of pepper but, in severe cases, can also cause significant economic losses and threaten food security. The timely and accurate identification of pepper diseases is crucial. Image recognition technology plays a key role in this aspect by automating and efficiently identifying pepper diseases, helping agricultural workers to adopt and implement effective control strategies, alleviating the impact of diseases, and being of great importance for improving agricultural production efficiency and promoting sustainable agricultural development. In response to issues such as edge-blurring and the extraction of minute features in pepper disease image recognition, as well as the difficulty in determining the optimal learning rate during the training process of traditional pepper disease identification networks, a new pepper disease recognition model based on the TPSAO-AMWNet is proposed. First, an Adaptive Residual Pyramid Convolution (ARPC) structure combined with a Squeeze-and-Excitation (SE) module is proposed to solve the problem of edge-blurring by utilizing adaptivity and channel attention; secondly, to address the issue of micro-feature extraction, Minor Triplet Disease Focus Attention (MTDFA) is proposed to enhance the capture of local details of pepper leaf disease features while maintaining attention to global features, reducing interference from irrelevant regions; then, a mixed loss function combining Weighted Focal Loss and L2 regularization (WfrLoss) is introduced to refine the learning strategy during dataset processing, enhancing the model's performance and generalization capabilities while preventing overfitting. Subsequently, to tackle the challenge of determining the optimal learning rate, the tent particle snow ablation optimizer (TPSAO) is developed to accurately identify the most effective learning rate. The TPSAO-AMWNet model, trained on our custom datasets, is evaluated against other existing methods. The model attains an average accuracy of 93.52% and an F1 score of 93.15%, demonstrating robust effectiveness and practicality in classifying pepper diseases. These results also offer valuable insights for disease detection in various other crops.

In multimode fiber (MMF) imaging, neural networks typically require large datasets and extensive training times, which present substantial challenges for both data acquisition and practical deployment. To address this limitation, we propose a pre-training approach that utilizes data generated from a physical model. By incorporating physically based training data, the required training time for actual fiber data is reduced to approximately one-third. Additionally, this method demonstrates superior performance on the test set, with a 0.04 increase in the average structural similarity index measure (SSIM) and a 31.25% reduction in the average mean squared error (MSE) compared to the baseline model. This approach not only accelerates the training process but also improves the model's accuracy and generalization capabilities, offering a more efficient and effective solution for MMF imaging.

Change detection (CD) in remote sensing imagery is crucial for monitoring environmental variations over time. Recent advancements have introduced numerous effective algorithms, significantly enhancing the performance of CD tasks. However, various challenges still persist, such as complex backgrounds, small targets, and diverse change types. To address these challenges, we propose a novel Mamba-based multi-scale feature enhancement method. Our method leverages the strengths of state space models in handling long sequences by reformulating the pyramid (multi-scale) feature fusion as a sequence processing task. This approach enables our model to efficiently capture both long-range context and fine-grained local details, which are critical for effective feature learning and mitigating the aforementioned challenges. Moreover, we introduce scale-level embedding and auxiliary loss to optimize and regulate the model's training process. These enhancements not only accelerate training but also improve the model's generalization capability. Extensive experiments are conducted on four leading benchmarks: WHUCD, SYSU-CD, LEVIR-CD, and DSIFN-CD datasets. The results demonstrate that our approach consistently delivers state-of-theart performance, surpassing other cutting-edge methods by a significant margin. The source code will be made available at https://github.com/Band-127/Pyramid-Mamba-CD upon formal acceptance of the paper.

As a pivotal area of research in the field of computer vision, the technology for food identification has become indispensable across diverse domains including dietary nutrition monitoring, intelligent service provision in restaurants, and ensuring quality control within the food industry. However, recognizing food images falls within the domain of Fine-Grained Visual Classification (FGVC), which presents challenges such as inter-class similarity, intra-class variability, and the complexity of capturing intricate local features. Researchers have primarily focused on deep information in deep convolutional neural networks for fine-grained visual classification, often neglecting shallow and detailed information. Taking these factors into account, we propose a Multi-level Attention Feature Fusion Network (MAF-Net). Specifically, we use feature maps generated by the Convolutional Neural Networks (CNNs) backbone network at different stages as inputs. We apply a self-attention mechanism to identify local features on these feature maps and then stack them together. The feature vectors obtained through the attention mechanism are then integrated with the original input to enhance data augmentation. Simultaneously, to capture as many local features as possible, we encourage multi-scale features to concentrate on distinct local regions at each stage by maximizing the Kullback-Leibler Divergence (KL-divergence) between the different stages. Additionally, we present a novel approach called subclass center loss (SCloss) to implement label smoothing, minimize intra-class feature distribution differences, and enhance the model's generalization capability. Experiments conducted on three food image datasets-CETH Food-101, Vireo Food-172, and UEC Food-100-demonstrated the superiority of the proposed model. The model achieved Top-1 accuracies of 90.22%, 89.86%, and 90.61% on CETH Food-101, Vireo Food-172, and UEC Food-100, respectively. Notably, our method not only outperformed other methods in terms of the Top-5 accuracy of Vireo Food-172 but also achieved the highest performance in the Top-1 accuracies of UEC Food-100.

With the growth of multisource sensor technology, multimodal learning has become pivotal in remote sensing (RS) image segmentation. Despite its potential, current methods face challenges in acquiring large-scale paired samples. When annotated optical images are available, but synthetic aperture radar (SAR) images lack annotations, learning discriminative features for SAR images from optical images becomes difficult. Unsupervised domain adaptation (UDA) offers a potential solution to this challenge, which we refer to as unpaired cross-modality UDA. In this article, we propose unlocking pseudolabel potential and alignment (ULPA) for unpaired cross-modality adaptation in RS image segmentation, a novel one-stage adaptation framework designed to enhance cross-modality knowledge transfer. Our approach employs a prototypical multidomain alignment (PMDA) strategy, which reduces the modality gap through contrastive learning between features and prototypes of identical classes across different modalities. In addition, we introduce the unreliable-sample-guided feature contrast (UFC) loss to address the underutilization of unreliable pixels during training. This strategy separates reliable and unreliable pixels based on prediction confidence, assigning unreliable pixels to a category-wise queue of negative samples, thus ensuring all candidate pixels contribute to the training process. Extensive experiments show that the integration of PMDA and UFC loss can lead to more effective cross-modality domain alignment and substantially boost the model's generalization capability.

Physics-informed machine learning has emerged as a promising approach for modeling physical systems. However, real-world applications often face significant challenges due to the limitations of partial observations and inaccuracies in governing partial differential equations (PDEs). In this work, we propose a novel physics-informed machine learning method named Physics-Informed method based on Inaccurate PDEs and Partial Observation (PIPO), to overcome the above two challenges under the real-world scenario, which aims to address the problems of super-resolution and forecasting simultaneously in physical systems characterized by partial observations and inaccurate PDEs. The proposed method is motivated by two key considerations. First, despite the inherent inaccuracy of PDEs, the differential terms (such as diffusion and advection terms) contain valuable information that can effectively reduce the hypothesis space, thereby enhancing the model's generalization capability. Second, while the data only provides partial observations, it offers crucial supervised constraints at the observed points. These constraints not only facilitate model optimization but also help prevent the degeneracy of PDE loss, where the PDE loss could yield multiple solutions. PIPO integrates an interpolator, encoder, forecaster, decoder, and parameters learner, which are jointly optimized using data loss and PDE losses to reconstruct high-resolution states and forecast future states using only partial observation data and inaccurate PDEs. We leverage the proposed PIPO method to address a real-world problem in air pollutant concentration fields and wind fields, specifically PM2.5 transport dynamics, which are governed by the advection-diffusion equation with unknown diffusion coefficients and the source term. The results in super-resolution reconstruction, forecasting, and multi-hour forecasting highlight the effectiveness of PIPO in capturing complex spatial and temporal dynamics despite the limitations of partial observations and inaccurate PDEs.