Multi-Model Loan Approval Prediction Using Machine Learning and Deep Learning with Tkinter GUI

Intrusion detection plays a critical role in safeguarding computer networks from malicious activities and unauthorized access. Traditional machine learning (ML) models have been widely employed for intrusion detection, but their effectiveness can be limited due to the complex and evolving nature of network attacks. An efficient Convolutional Neural Network (CNN) that utilizes one-dimensional convolutions, batch normalization, and max pooling layers is designed to capture the attack patterns in network traffic data. By leveraging the inherent feature extraction capabilities of CNNs, the proposed architecture demonstrates improved performance in identifying network intrusions compared to traditional ML models. The effectiveness of the novel CNN architecture is evaluated by conducted comprehensive experiments on two benchmark intrusion detection datasets. The designed CNN performance was compared with four other ML models such as logistic regression, k-nearest neighbors, decision trees, and random forest. The experimental results revealed that the proposed CNN architecture outperformed the traditional ML models with highest accuracy of 97.68% and 97.39% and highest F1-score of 97.68% and 97.40% for. UNSW-NB15 and CICIDS2017 datasets, respectively. The proposed CNN architecture serves as a promising alternative to traditional ML models, offering improved performance in identifying and mitigating network attacks.

Urban traffic congestion is a rapidly rising challenge in today’s cities, which result in longer travel times, increased pollution levels, and economic drawbacks. Traditional traffic control methods, which often rely on fixed rules, struggle to handle the dynamic and complex nature of modern traffic. In this study, we explore how machine learning can be used to classify traffic congestion levels more effectively using real-time data. We experimented with several models—like Support Vector Machines (SVM), Random Forests, Gradient Boosting, Deep Neural Networks, and various ensemble techniques. Our findings show that ensemble models, which combine the strengths of multiple classifiers, perform better in terms of accuracy and reliability compared to individual models. We also look at recent advancements in deep learning, including artificial neural networks (ANNs), gated recurrent units (GRUs), and hybrid models, to see how they enhance congestion prediction. We also evaluate how well these deep learning solutions perform in scenarios set in real world by looking at key factors like computational efficiency, feasibility for real-time use, and how well they scale. This provides a more complete picture of their potential in smart traffic management. Putting aside academic interest, applying machine learning to real time traffic classification has significant real world value, offering practical solutions to everyday urban mobility challenges.. With cities slowly becoming complex systems, traffic management needs to be better,more agile, responsive, and data-driven. This paper bridges that gap by combining the usual machine learning methods with deep learning and ensemble approaches. Besides classification, these models open up the path towards smarter decision-making in urban planning. It also addresses how developments in sensor technologies, IoT, and federated learning paradigms are reshaping the future of traffic analytics, while preserving data privacy without sacrificing real-time model flexibility. By identifying gridlocks, predicting congestion trends, and optimizing route management, these models can actively reduce emissions and travel delays, contributing to a more sustainable urban future. The experimental evaluation revealed that among all tested algorithms, the Artificial Neural Network (ANN) with the Swush activation function achieved the highest classification accuracy of 99.79% outperforming ensemble and traditional machine learning models. The findings highlight the feasibility of deploying such models in real-time traffic management systems to optimize routing and minimize congestion-related emissions.

We study the eigenvalue distribution of random matrices pertinent to the analysis of deep neural networks. The matrices resemble the product of the sample covariance matrices, however, an important difference is that the analog of the population covariance matrix is now a function of random data matrices (synaptic weight matrices in the deep neural network terminology). The problem has been treated in recent work [J. Pennington, S. Schoenholz and S. Ganguli, The emergence of spectral universality in deep networks, Proc. Mach. Learn. Res. 84 (2018) 1924–1932, arXiv:1802.09979] by using the techniques of free probability theory. Since, however, free probability theory deals with population covariance matrices which are independent of the data matrices, its applicability in this case has to be justified. The justification has been given in [L. Pastur, On random matrices arising in deep neural networks: Gaussian case, Pure Appl. Funct. Anal. (2020), in press, arXiv:2001.06188] for Gaussian data matrices with independent entries, a standard analytical model of free probability, by using a version of the techniques of random matrix theory. In this paper, we use another version of the techniques to extend the results of [L. Pastur, On random matrices arising in deep neural networks: Gaussian case, Pure Appl. Funct. Anal. (2020), in press, arXiv:2001.06188] to the case where the entries of the data matrices are just independent identically distributed random variables with zero mean and finite fourth moment. This, in particular, justifies the mean field approximation in the infinite width limit for the deep untrained neural networks and the property of the macroscopic universality of random matrix theory in this case.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

Summary A meticulous interpretation of steady-state or unsteady-state relative permeability (Kr) experimental data is required to determine a complete set of Kr curves. In this work, different machine learning (ML) models were developed to assist in a faster estimation of these curves from steady-state drainage coreflooding experimental runs. These ML algorithms include gradient boosting (GB), random forest (RF), extreme gradient boosting (XGB), and deep neural network (DNN) with a main focus on and comparison of the two latter algorithms (XGB and DNN). Based on existing mathematical models, a leading-edge framework was developed where a large database of Kr and capillary pressure (Pc) curves were generated. This database was used to perform thousands of coreflood simulation runs representing oil-water drainage steady-state experiments. The results obtained from these simulation runs, mainly pressure drop along with other conventional core analysis data, were used to estimate analytical Kr curves based on Darcy’s law. These analytically estimated Kr curves along with the previously generated Pc curves were fed as features into the ML model. The entire data set was split into 80% for training and 20% for testing. The k-fold cross-validation technique was applied to increase the model’s accuracy by splitting 80% of the training data into 10 folds. In this manner, for each of the 10 experiments, nine folds were used for training and the remaining fold was used for model validation. Once the model was trained and validated, it was subjected to blind testing on the remaining 20% of the data set. The ML model learns to capture fluid flow behavior inside the core from the training data set. In terms of applicability of these ML models, two sets of experimental data were needed as input; the first was the analytically estimated Kr curves from the steady-state drainage coreflooding experiments, while the other was the Pc curves estimated from centrifuge or mercury injection capillary pressure (MICP) measurements. The trained/tested model was then able to estimate Kr curves based on the experimental results fed as input. Furthermore, to test the performance of the ML model when only one set of experimental data is available to an end user, a recurrent neural network (RNN) algorithm was trained/tested to predict Kr curves in the absence of Pc curves as an input. The performance of the three developed models (XGB, DNN, and RNN) was assessed using the values of the coefficient of determination (R2) along with the loss calculated during training/validation of the model. The respective crossplots along with comparisons of ground truth vs. artificial intelligence (AI)-predicted curves indicated that the model is capable of making accurate predictions with an error percentage between 0.2% and 0.6% on history-matching experimental data for all three tested ML techniques. This implies that the AI-based model exhibits better efficiency and reliability in determining Kr curves when compared to conventional methods. The developed ML models by no means replace the need to conduct drainage coreflooding or centrifuge experiments but act as an alternative to existing commercial platforms that are used to interpret experimental data to predict Kr curves. The two main advantages of the developed ML models are their capability of predicting Kr curves within a matter of a few minutes as well as with limited intervention from the end user. The results also include a comparison between classical ML approaches, shallow neural networks, and DNNs in terms of accuracy in predicting the final Kr curves. The research presented here is an extension of the state-of-the-art framework proposed by Mathew et al. (2021). However, the two main aspects of the current study are the application of deep learning for the prediction of Kr curves and the application of feature engineering. The latter not only reduces the training/testing time for the ML models but also enables the end user to obtain the final predictions with the least set of experimental data. The various models discussed in this research work currently focus on the prediction of Kr curves for drainage steady-state experiments; however, the work can be extended to capture the imbibition cycle as well.

Optimisation and interpretation of machine and deep learning models for improved water quality management in Lake Loktak

Mild cognitive impairment (MCI) is a clinical condition characterized by a decline in cognitive ability and progression of cognitive impairment. It is often considered a transitional stage between normal aging and Alzheimer's disease (AD). This study aimed to compare deep learning (DL) and traditional machine learning (ML) methods in predicting MCI using plasma proteomic biomarkers. A total of 239 adults were selected from the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort along with a pool of 146 plasma proteomic biomarkers. We evaluated seven traditional ML models (support vector machines (SVMs), logistic regression (LR), naïve Bayes (NB), random forest (RF), k-nearest neighbor (KNN), gradient boosting machine (GBM), and extreme gradient boosting (XGBoost)) and six variations of a deep neural network (DNN) model-the DL model in the H2O package. Least Absolute Shrinkage and Selection Operator (LASSO) selected 35 proteomic biomarkers from the pool. Based on grid search, the DNN model with an activation function of "Rectifier With Dropout" with 2 layers and 32 of 35 selected proteomic biomarkers revealed the best model with the highest accuracy of 0.995 and an F1 Score of 0.996, while among seven traditional ML methods, XGBoost was the best with an accuracy of 0.986 and an F1 Score of 0.985. Several biomarkers were correlated with the APOE-ε4 genotype, polygenic hazard score (PHS), and three clinical cerebrospinal fluid biomarkers (Aβ42, tTau, and pTau). Bioinformatics analysis using Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) revealed several molecular functions and pathways associated with the selected biomarkers, including cytokine-cytokine receptor interaction, cholesterol metabolism, and regulation of lipid localization. The results showed that the DL model may represent a promising tool in the prediction of MCI. These plasma proteomic biomarkers may help with early diagnosis, prognostic risk stratification, and early treatment interventions for individuals at risk for MCI.

The last decade has seen an important rise of data gathering, especially in the financial sectors. Banks are indeed one of the biggest producers of big data, as a matter of fact no other company than the bank has so much data gathered on its customers. Gathering and analyzing this data is a key feature for decision making, particularly in banking sector. One of the most important and frequent decision banks has to make, is loan approval. The challenge is to know how to build a proactive, powerful, responsible and ethical exploitation of personal data, to make loan applicant proposals more relevant and personalized. Machine learning is a promising solution to deal with this problem. Therefor, in the last years, many algorithms based on machine learning have been proposed to solve loan approval issue. However, these algorithms have not taken into consideration Real-time paradigm during processing. In this paper, we propose a Real-Time Binary classification model to deal with loan approval. Our proposed model is based on a deep neural network, and it permits to classify loan applicant as good or bad risk. Experimental results prove that our proposed Real-Time model, based on deep neural network, outperforms typical binary classifiers, in terms of precision recall and accuracy.

This study presents a comprehensive framework for credit scoring in loan application processes. The research presents a framework that uses data analysis and machine learning techniques to evaluate creditworthiness, in loan applications. By incorporating cutting-edge algorithms like Naive Bayes, SVM, Decision Tree, Multi Layer Perceptron (MLP), and Gradient Booster (GB) the goal is to revolutionize the decision-making process for loan approvals by using analytics. The model utilizes a dataset that includes payment statements enabling a thorough and randomized credit scoring system for each individual applying for a loan. By leveraging machine learning algorithms, the system examines past payment behaviors to extract patterns and information. These findings are then used to generate a credit score that is further classified as good, bad, or moderate. This approach provides an assessment of an applicant’s reliability. To improve the model’s accuracy, feature selection techniques and Synthetic Minority Oversampling Techniques (SMOTE) are utilized to compare models’ effectiveness, in predicting creditworthiness. The integration of data and machine learning not only enhances the efficiency of loan approval processes but also facilitates more informed financial decisions based on data analysis. On all the machine learning models which were performed, SVM performed best among the five models with an F-measure value of 0.86 incorporating feature selection and SMOTE.

Deep neural network is an important and effective approach to discover patterns inside data. Most existing neural networks, like deep neural network and convolutional neural network, have a fixed network connection among neurons. This will cause overfitting problems and long training time. This article discusses an algorithm to combat these problems, through creating and removing connections during training, leading to faster training and fewer symmetric problems. This enables the network to adapt itself to the proper number of neurons according to the dataset. It greatly speeds up training process, so it is useful for large datasets and deep networks. This method is simple to implement and requires less memory and computing power than existing machine learning algorithm. It also has good results in machine learning problems.

In the present study, the amount of fragments generated and their travel distances due to vehicle collision with concrete median barrier (CMB) was analyzed and predicted. In this regard, machine learning was applied to the results of numerical analysis, which were developed by comparing with field test. The numerical model was developed using smoothed particle hydrodynamics (SPH). SPH is a mesh-free method that can be used to predict the amount of fragments and their travel distances from concrete structures under impact loading. In addition, deep neural network (DNN) and gradient boosting machine (GBM) were also employed as machine learning methods. In this study, the results of DNN, GBM, and numerical analysis were then compared with the conducted field test. Such comparisons revealed that numerical analysis generated lower error than both DNN and GBM. When prediction results of both the amount of fragments and their travel distances were considered, the result of DNN showed smaller errors than that of GBM. Therefore, in studies where machine learning is used to predict the amount of fragments and their travel distances, careful selection of an appropriate method from the various available machine learning methods such as DNN, GBM, and random forest is absolutely important.

Purpose: The aim of the article is to develop an algorithm for classifying cracks in the analyzed images using modern methods of deep machine learning and transfer learning based on pretrained convolutional neural network - Inception-ResNet-v2. Design/Methodology/Approach: Transfer learning based on the pretrained convolutional neural network was used to categorize the images. The fully conected layer of the Inception-ResNet-v2 network has been modified. The last layer was trained using a two-class (binary) linear SVM (Support Vector Machine). In total, 20,000 training cases (images) were used to train the fully connected layer within transfer learning process. The research analyzed the possibility of using the deep neural networks for quick and fully automatic identification of cracks / defects on the surface of analyzed parts. Findings: The results indicate that pretrained convolutional neural network using SVM to train a fully connected layer is a very effective solution for visual crack / fault detection. In the analyzed model, a positive classification was obtained at the level of 99.89%. Practical Implications: The model presented in the article can be used in quality control carried out by process monitoring. An effective model for identifying defective parts can be used in both logistics and production processes. Originality/Value: A novelty is the use of a freely available, deep neural network trained to classify 1000 categories of various images for binary categorization of faults (cracks). The algorithm was adjusted by replacing the primary, 1000-output fully connected layer in the Inception-ResNet-v2 network with a binary layer (2 categories). The fully connected layer has been trained using the classification version of the popular SVM learner, but thanks to the combination of this layer with the sophisticated fearure extraction ability of the pre-trained Inception-ResNet-v2 deep network, the resulting predictive model enables the classification of defects with a very high level of accuracy.

Automated image classification is an essential task of the computer vision field. The tagging of images into a set of predefined groups is referred to as image classification. The implementation of computer vision to automate image classification would be beneficial because manual image evaluation and identification can be time-consuming, particularly when there are many images of different classes. Deep learning approaches are proven to overperform existing machine learning techniques in many fields in recent years, and computer vision is one of the most notable examples. The very deep neural network (VDCNN) is a powerful deep learning model for image classification, and this paper examines it briefly using MNIST handwritten digit dataset. This dataset is used to prove the efficacy of very deep neural networks over other deep learning models. The proposed study aims to comprehend the very deep neural network architecture used to accomplish a handwritten digit recognition task. The feasibility of the proposed model is evaluated using mean accuracy, validation accuracy, and standard deviation. The study results of the very deep neural network model are compared to a convolutional neural network and convolutional neural network with batch normalization. According to the results of the comparison study, very deep neural networks achieve high accuracy of 99.1% for a handwritten dataset. The outcome of the proposed work is used to interpret how well a very deep neural network performs when compared to the other two models of deep neural networks. This proposed architecture may be used to automate the classification of handwritten digits dataset.

The concept of Human Activity Recognition (HAR) is integral to applications based on Internet of Things (IoT)-enabled devices, particularly in healthcare, fitness tracking, and smart environments. The streams of data from wearable sensors are rich in information, yet their high dimensionality and variability pose a significant challenge to proper classification. To address this problem, this paper proposes hybrid architectures that integrate traditional machine learning models with a deep neural network (DNN) to deliver improved performance and enhanced capabilities for HAR tasks. Multi-sensor HAR data were used to systematically test several hybrid models, including: RF + DNN (Random Forest + Deep Neural Network), XGB + DNN (XGBoost + DNN), GB + DNN (Gradient Boosting + DNN), KNN + DNN (K-Nearest Neighbors + DNN), and DT + DNN (Decision Tree + DNN). The RF + DNN model was the most accurate, achieving a 97.03% score with excellent precision, recall, and F1-score. These findings demonstrate that hybrid machine learning and deep learning systems have a promising future in IoT-based HAR applications. The model provides a novel solution for developing smart and trustworthy monitoring systems that support real-time analytics, patient surveillance, and other IoT applications.

Optimized ensemble learning with multi-feature fusion for enhanced anti-inflammatory peptide prediction.