An Image Classification Method Using Hashing Preprocessing

Deep learning (DL) has shown explosive growth in its application to bioinformatics and has demonstrated thrillingly promising power to mine the complex relationship hidden in large-scale biological and biomedical data. A number of comprehensive reviews have been published on such applications, ranging from high-level reviews with future perspectives to those mainly serving as tutorials. These reviews have provided an excellent introduction to and guideline for applications of DL in bioinformatics, covering multiple types of machine learning (ML) problems, different DL architectures, and ranges of biological/biomedical problems. However, most of these reviews have focused on previous research, whereas current trends in the principled DL field and perspectives on their future developments and potential new applications to biology and biomedicine are still scarce. We will focus on modern DL, the ongoing trends and future directions of the principled DL field, and postulate new and major applications in bioinformatics.

The study presents the results of the development and testing of deep learning neural network architectures, which demonstrate high accuracy rates in classifying neurophysiological data, in particular hemodynamic brain activation patterns obtained by functional near-infrared spectroscopy, during solving mathematical problems on spatial-numerical associations. The analyzed signal represents a multidimensional time series of oxyhemoglobin and deoxyhemoglobin dynamics. Taking the specificity of the fNIRS signal into account, a comparative analysis of 2 types of neural network architectures was carried out: (1) architectures based on recurrent neural networks: recurrent neural network with long short-term memory, recurrent neural network with long short-term memory with fully connected layers, bidirectional recurrent neural network with long short-term memory, convolutional recurrent neural network with long short-term memory; (2) architectures based on convolutional neural networks with 1D convolutions: convolutional neural network, fully convolutional neural network, residual neural network. Trained long short-term memory recurrent neural network architectures showed worse results in accuracy in comparison with 1D convolutional neural network architectures. Residual neural network (model_Resnet) demonstrated the highest accuracy rates in three experimental conditions more than 88% in detecting age-related differences in brain activation during spatial-numerical association tasks considering the individual characteristics of the respondents’ signal.

Recently, there has been a remarkable growth in Artificial Intelligence (AI) with the development of efficient AI models and high-power computational resources for processing complex datasets. There has been a growing number of applications of machine learning in satellite remote sensing image data processing. In this work, machine learning methods were applied for crop classification of temporal multi- spectral satellite image to achieve better prediction of crop-wise area statistics. In India, agriculture has a huge impact on the national economy and most of the critical decisions are dependent on agricultural statistics. Sentinel-2 satellite image data for the Guntur district region of Andhra Pradesh, India has been used as the study area. The main reason for selecting this region is the diversity of agricultural crops and the availability of ground truth. As a baseline, the performance of machine learning models like Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT), and K-Nearest Neighbor (KNN) on crop classification was evaluated on 2016 single time multi-spectral satellite image. SVM performed well with an F1 score of 0.94. Further, the performance of SVM, RF, 1D and 2D Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) and RNN with Gated Recurrent Unit (GRU) on 2018 Kharif season temporal multi-spectral satellite image has been evaluated for estimation of crop areas. The results show that SVM has the best F1 score of 0.99 and achieved a 95.9% agreement with the ground surveyed crop areas.

Accurate prediction of agricultural yield is extremely important to ensure food security and cope with the challenges created by climate change and natural disasters. Forecasting agricultural yield is a challenging task due to the complex nature of variables (fertiliser, rainfall, temperature and others) that affect agricultural production. This study employs six supervised machine learning algorithms: Support Vector Machine (SVM), Decision Tree (DT), Random Forest (RF), Multi-Layer Perceptron (MLP), Recurrent Neural Network (RNN), and Convolutional Neural Network (CNN) to build a predictive model using 49 years of historical data (1973-2021) on paddy, wheat, and maize. Model performance was evaluated using Mean Squared Error (MSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and Root Mean Squared Error (rMSE). Results show that DT and RF models are the most precise with MSE 1% to 5%, MAE 8% to 21%, followed by SVM and CNN. Key predictors of crop yield include area cultivated, capital expenditure, banking expansion, rainfall, temperature, and fertilizers, while irrigation and road network were less significant. The study recommends that farmers prioritize commercial farming, agricultural equipment, and timely availability of fertilizer for application. The Government of Nepal (GoN) should redirect subsidies towards agricultural mechanization, ensure timely supply of fertilizer, and expand banking services in agricultural areas.

The Sixth International Symposium on Neural Networks (ISNN 2009)

Emotion recognition plays a pivotal role in advancing Human-Computer Interaction (HCI) by enabling systems to understand and respond to human emotional states. Among various modalities, Speech Emotion Recognition (SER) stands out as a non-invasive, cost-effective, and temporally efficient approach for detecting emotions. This study leverages the RAVDESS dataset, which provides high-quality audio recordings for emotion classification. The proposed methodology involves preprocessing audio signals to remove noise, extracting temporal and spectral features in both time and frequency domains, and implementing machine learning models for multi-class emotion classification. The study evaluates and compares the performance of several classification models, including Random Forest (RF), Multilayer Perceptron (MLP), Support Vector Machine (SVM), Convolutional Neural Networks (CNN), and Decision Trees (DT). Experimental results demonstrate promising accuracy levels, highlighting the potential of these machine learning techniques in SER. This research contributes to the integration of SER within Brain-Computer Interfaces (BCI) and other emotion-aware applications, paving the way for enhanced interactive systems. Keywords – Speech Emotion Recognition -Machine Learning - Random Forest -Multilayer Perceptron - Support Vector Machine - Convolutional Neural Networks - Decision Tree - RAVDESS Dataset

The study intended to explore the effect of different neural network algorithms in the electrocardiogram (ECG) classification of patients with congenital heart disease (CHD). Based on the single convolutional neural network (CNN) ECG algorithm and the recurrent neural network (RNN) ECG algorithm, a multimodal neural network (MNN) ECG algorithm was constructed utilizing the MIT-BIH database as training set and test set. Furthermore, the MNN ECG algorithm was optimized to establish an improved MNN (IMNN) algorithm, which was applied to the diagnosis of CHD patients. The CHD patients admitted between August 2016 and August 2019 were selected for analysis to compare the classification effect and accuracy rate of IMNN, MNN, CNN ECG, and RNN ECG algorithms. It was found that the RNN ECG algorithm had higher classification sensitivity and true positive rate in terms of normal or bundle (NB) branch block beat, supraventricular abnormal (SA) rhythm, abnormal ventricular (AV) beat, and fusion beat (FB) than the CNN ECG algorithm ( P < 0.05 ), and the classification sensitivity and true positive rate of IMNN algorithm in the four aspects were significantly higher than those of MNN algorithm ( P < 0.05 ). The classification accuracy of CNN ECG algorithm and RNN ECG algorithm was above 98%, while that of MNN algorithm and IMNN algorithm was better than that of CNN ECG algorithm and RNN ECG algorithm, and the accuracy rate can reach 98.5% or more. Moreover, the accuracy rate of the IMNN algorithm can reach more than 98%. In conclusion, IMNN not only has a good classification ability in the simulated environment but also performs well in the actual environment, which is worthy of clinical promotion.

Introduction: This paper presents a novel approach for classifying different types of steel rods using a combination of pre-trained convolutional neural networks (CNNs) and fuzzy logic systems. We utilize VGG16, ResNet50, and InceptionV3 models to extract features from grayscale images of steel rods, which are then classified using Support Vector Machines (SVM). Furthermore, we incorporate a fuzzy logic system to improve the final classification accuracy by combining the individual accuracies of each CNN model. Experimental results demonstrate the effectiveness of our approach in achieving high classification accuracy compared to traditional methods. Objectives: This research presents a novel multi-model approach for steel rod classification utilizing three distinct fuzzy logic systems: Fuzzy Recurrent Neural Network (RNN), Fuzzy Convolutional Neural Network (CNN), and Fuzzy Neural Network. The proposed system addresses the critical challenge of accurate defect detection and classification in steel manufacturing processes. By combining these complementary approaches, we achieve enhanced feature extraction capabilities and improved classification accuracy. Experimental results demonstrate that our multi-model system achieves a classification accuracy of 97.8%, surpassing single-model approaches by an average of 8.2%. The system successfully identifies surface defects, structural anomalies, and dimensional variations with high precision, making it suitable for real-time industrial applications. Methods: This paper introduces a novel approach for the feature extraction and classification of steel rods by integrating multiple models and utilizing fuzzy logic systems. The methodology leverages pre-trained convolutional neural networks (CNNs) for extracting comprehensive feature representations from steel rod images. These extracted features are then combined and integrated using fuzzy logic to enhance classification accuracy and reliability. By addressing the limitations of traditional manual inspection methods and single-model approaches, this integrated multi-model system offers a robust solution for real-time industrial implementation. The proposed system aims to improve the efficiency and effectiveness of quality control processes in steel rod manufacturing, ensuring consistent and accurate classification even under varying conditions and complexities. This innovative approach paves the way for more advanced and adaptable automated inspection systems in the industry. Results: The paper aims to develop an integrated multi-model system that combines three distinct fuzzy logic approaches to enhance feature extraction capabilities through complementary methodologies. By improving the classification accuracy and reliability, the system addresses the limitations of existing methods. The goal is to create a robust and adaptable system that is suitable for real-time industrial implementation for steel rod analysis and classification. This comprehensive approach leverages the strengths of multiple models and fuzzy logic techniques, ensuring accurate and efficient classification processes, even under complex and varying conditions. The proposed multi model system is designed to meet the stringent quality control requirements of industrial applications, ultimately improving productivity and product quality through reliable automated inspection and classification for steel rod with accuracy of 97.80%, precision of 97.30% and recall 97.50%. Conclusions: This paper presents a novel approach for the classification of steel rods using a combination of pre-trained CNN models and fuzzy logic systems. The experimental results demonstrate the effectiveness of our method in achieving high classification accuracy. This research demonstrates the effectiveness of a multi-model fuzzy logic approach for steel rod classification. The system achieves significant improvements over single-model approaches while maintaining real-time processing capabilities. Our approach provides a foundation for further research and development in automated industrial image classification.

For environmental protection, urban planning, monitoring, and management of the urban ecosystem, mapping urban green spaces is a crucial undertaking. A vital source of information for United Nations Sustainable Development Goal 11.7 could come from urban green space mapping. The standard method of mapping urban green spaces requires field measurements and takes a lot of time. It is also important to update urban green space maps periodically because urban green spaces can change quickly over time due to development. With the advent of high-resolution satellite sensors like Sentinel-1 and Sentinel-2, a large number of remote sensing images may be gathered, providing quick and precise information over urban areas. This work intends to offer a new perspective on how crowd sourced geospatial big data and remote sensing may be combined to enhance the mapping of urban green spaces, including time optimization and accurate information through machine learning and deep learning. For the revitalization of cities, this data will be valuable. Remote sensing imagery data can be classified using machine learning techniques like Support vector machines (SVM), Random forests (RF), and Naive Bayes (NB). In deep learning techniques such as Long Short-Term Memory (LSTM), Convolutional Neural Network (CNN), K Nearest Neighbor (KNN), Generative Adversarial Networks (GAN), and Recurrent Neural Networks (RNN) can be used to classify remote sensing images.

Recent experience in applying recurrent neural networks (RNNs) to interpreting Permannt Downhole Gauge (PDG) records has highlighted the potential utility of machine learning algorithms to learn reservoir behavior from data. The power of the RNN resides in its ability to retain information in a form of memory of previous patterns and information contained in the previous behavior of phenomena being modeled. This memory plays a role of informing the decision at the present time by using what happened in the past. This property suggests RNNs as a suitable choice to model sequences of reservoir information, even when the reservoir modeler is faced with incomplete knowledge of the underlying physical system. Convolutional Neural Networks (CNNs) are another variant of machine learning algorithms that have shown promise in sequence modeling domains, such as audio synthesis and machine translation. In this study, RNN and CNN were applied to tasks that traditionally would be modeled by a reservoir simulator. This was achieved by formulating the relationship between physical quantities of interest from subsurface reservoirs as a sequence mapping problem. In addition, the performance of a CNN layer as compared to RNN was evaluated systematically to investigate their capabilities in a variety of tasks of interest to the reservoir engineer. Preliminary results suggest that CNNs, with specific design modifications, are as capable as RNNs in modeling sequences of information and as reliable when making inferences to cases that has not been seen by the algorithm during training. Design details and reasons pertaining to the way these two seemingly different architectures process information, and handle memory are also discussed.

In this modern world, we are accustomed to a constant stream of data. Major social media sites like Twitter, Facebook, or Quora face a huge dilemma as a lot of these sites fall victim to spam accounts. These accounts are made to trap unsuspecting genuine users by making them click on malicious links or keep posting redundant posts by using bots. This can greatly impact the experiences that users have on these sites. A lot of time and research has gone into effective ways to detect these forms of spam. Performing sentiment analysis on these posts can help us in solving this problem effectively. The main purpose of this proposed work is to develop a system that can determine whether a tweet is “spam” or “ham” and evaluate the emotion of the tweet. The extracted features after preprocessing the tweets are classified using various classifiers, namely, decision tree, logistic regression, multinomial naïve Bayes, support vector machine, random forest, and Bernoulli naïve Bayes for spam detection. The stochastic gradient descent, support vector machine, logistic regression, random forest, naïve Bayes, and deep learning methods, namely, simple recurrent neural network (RNN) model, long short-term memory (LSTM) model, bidirectional long short-term memory (BiLSTM) model, and 1D convolutional neural network (CNN) model are used for sentiment analysis. The performance of each classifier is analyzed. The classification results showed that the features extracted from the tweets can be satisfactorily used to identify if a certain tweet is spam or not and create a learning model that will associate tweets with a particular sentiment.

The increasing complexity of urban transportation systems and the growing volume of vehicles have made traffic congestion a persistent challenge in modern cities. Efficient traffic flow prediction is essential for mitigating congestion, improving road safety, optimizing traffic signal control, and enhancing overall transportation efficiency. In recent years, artificial intelligence (AI) has emerged as a transformative tool in the field of traffic management, offering sophisticated algorithms capable of modeling, analyzing, and predicting complex traffic patterns with high accuracy. The application of AI in traffic flow prediction leverages vast amounts of real-time and historical data to generate precise forecasts, supporting data-driven decision-making by urban planners and traffic control authorities. The prediction of traffic flow involves analyzing time-series data that exhibit nonlinear, dynamic, and often stochastic behavior. Traditional statistical models, such as autoregressive integrated moving average (ARIMA), have proven to be limited in handling the high dimensionality and variability inherent in traffic systems. In contrast, AI algorithms possess the capacity to learn and adapt from complex data inputs without the need for explicit programming, making them particularly suitable for traffic-related applications. AI algorithms used in traffic flow prediction can be broadly categorized into machine learning (ML) and deep learning (DL) approaches. Machine learning algorithms such as k-nearest neighbors (KNN), support vector machines (SVM), decision trees, and random forests have demonstrated effectiveness in short-term traffic prediction tasks. These algorithms are capable of identifying hidden patterns in traffic data and adjusting to changes in traffic behavior over time. Ensemble methods, which combine the strengths of multiple learning models, further enhance prediction accuracy and robustness. Deep learning algorithms, a subfield of AI inspired by the human brain’s neural architecture, have shown exceptional performance in capturing spatial-temporal dependencies in traffic data. Recurrent neural networks (RNNs), particularly long short-term memory (LSTM) networks and gated recurrent units (GRUs), are widely used for their ability to process sequential data and retain information over extended time intervals. Convolutional neural networks (CNNs) are employed to extract spatial features from traffic sensor data or road network imagery. Hybrid models that integrate CNNs with RNNs have achieved high levels of predictive precision by simultaneously learning spatial and temporal correlations. In addition to supervised learning methods, unsupervised and reinforcement learning techniques are also applied in traffic flow prediction. Clustering algorithms, such as k-means and DBSCAN, assist in identifying traffic patterns, while reinforcement learning models optimize adaptive traffic signal control systems by learning optimal actions through environmental interaction. This study explores the different types of AI algorithms used in traffic flow prediction, examining their theoretical foundations, structural differences, and practical applications. It aims to evaluate the comparative advantages of various algorithms in addressing the challenges of real-time traffic prediction in increasingly complex transportation networks.

A hybrid model based on neural networks for biomedical relation extraction

The increasing demands for the reliability of modern industrial equipment and structures necessitate advanced techniques for design, monitoring, and analysis. This review article presents the latest research advancements in the application of machine learning techniques to vibration and acoustic signal analysis from 2015 to 2024. A total of 96 peer-reviewed scientific publications were examined, selected using a systematic Scopus-based search. The main research areas include processes such as modeling and design, health management, condition monitoring, non-destructive testing, damage detection, and diagnostics. In the context of these processes, a review of machine learning techniques was conducted, including convolutional neural networks (CNNs), recurrent neural networks (RNNs), long short-term memory (LSTM), autoencoders, support vector machines (SVMs), decision trees (DTs), nearest neighbor search (NNS), K-means clustering, and random forests. These techniques were applied across a wide range of engineering domains, including civil infrastructure, transportation systems, energy installations, and rotating machinery. Additionally, this article analyzes contributions from different countries, highlighting temporal and methodological trends in this field. The findings indicate a clear shift towards deep learning-based methods and multisensor data fusion, accompanied by increasing use of automatic feature extraction and interest in transfer learning, few-shot learning, and unsupervised approaches. This review aims to provide a comprehensive understanding of the current state and future directions of machine learning applications in vibration and acoustics, outlining the field’s evolution and identifying its key research challenges and innovation trajectories.

The prediction of student performance is a critical area in educational data mining, providing invaluable insights for early interventions and personalized learning strategies. This chapter explores the application of machine learning and deep learning algorithms in predicting academic success, focusing on the enhancement of traditional predictive models through advanced computational techniques. A comprehensive review of widely-used models such as decision trees, support vector machines, k-nearest neighbors, and random forests is presented, highlighting their strengths and limitations in handling educational data. In addition, the chapter delves into deep learning approaches, such as artificial neural networks, convolutional neural networks, recurrent neural networks, and long short-term memory networks, which have shown promising results in capturing complex patterns and temporal dependencies in student performance data. The chapter emphasizes the importance of high-quality data preprocessing, including data cleaning, feature selection, and imputation, as essential steps for enhancing model accuracy. Evaluation metrics such as accuracy, precision, recall, F1-score, and ROC-AUC curve analysis are discussed to ensure robust model validation, especially in the presence of class imbalance. Further, challenges like model overfitting and strategies to prevent it, including regularization, cross-validation, and early stopping, are explored. The integration of machine learning and deep learning in education holds transformative potential for improving academic outcomes, providing a framework for data-driven decisions and timely interventions. This chapter serves as a critical resource for researchers and practitioners aiming to leverage AI for enhanced student performance prediction.