Creativity in Nature

Manifold learning algorithms have been demonstrated to be effective for hyperspectral data dimension reduction (DR). However, the low dimensional feature representation resulted by traditional manifold learning algorithms could not preserve the nonnegative property of the hyperspectral data, which leads inconsistency with the psychological intuition of “combining parts to form a whole”. In this paper, we introduce a nonnegative discriminative manifold learning (NDML) algorithm for hyperspectral data DR, which yields a discriminative and low dimensional feature representation, with psychological and physical evidence in the human brain. Our method benefits from both the nonnegative matrix factorization (NMF) algorithm and the discriminative manifold learning (DML) algorithm. We apply the NDML algorithm to hyperspectral remote sensing image classification on HYDICE dataset. Experimental results confirm the efficiency of the proposed NDML algorithm, compared with some existing manifold learning based DR methods.Keywordsmanifold learningnonnegative matrix factorizationdimension reductionhypsrspectral data

The human brain processes enormous volumes of high-dimensional data for everyday perception. To humans, a picture is worth a thousand words, but to a machine, it is just a seemingly random array of numbers. Although machines are very fast and efficient, they are vastly inferior to humans for everyday information processing. Algorithms that mimic the way the human brain computes and learns may be the solution. We present a theoretical model based on the observation that images of similar visual perceptions reside in a complex manifold in a low-dimensional image space. The perceived features are often highly structured and hidden in a complex set of relationships or high-dimensional abstractions. To model the pattern manifold, we present a novel learning algorithm using a recurrent neural architecture. The brain memorizes information using a dynamical system made of interconnected neurons. Retrieval of information is accomplished in an associative sense. It starts from an arbitrary state that might be an encoded representation of a visual image and converges to another state that is stable. The stable state is what the brain remembers. In designing a recurrent neural architecture, it is usually of prime importance to guarantee the convergence in the dynamics of the network. We propose to modify this picture: if the brain remembers by converging to the state representing familiar patterns, it should also diverge from such states when presented with an unknown encoded representation of a visual image belonging to a different category. That is, the identification of an instability mode is an indication that a presented pattern is far away from any stored pattern and therefore cannot be associated with current memories. These properties can be used to circumvent the plasticity-stability dilemma by using the fluctuating mode as an indicator to create new states. We capture this behavior using a novel neural architecture and learning algorithm, in which the system performs self-organization utilizing a stability mode and an instability mode for the dynamical system. Based on this observation we developed a self-organizing line attractor, which is capable of generating new lines in the feature space to learn unrecognized patterns. Experiments performed on various databases show that the proposed nonlinear line attractor is able to successfully associate patterns and it provides better association when compared to other state of the art techniques. It shows that the proposed model is able to create nonlinear manifolds in a multidimensional feature space to distinguish complex patterns.

The human brain is one of the body's most major organs. If there are problems within the human brain, they may cause serious consequences, and even endangers the human life. One of the most fatal diseases for humans is a brain tumor. In the old days, tumor detection was done manually by doctors through reading magnetic resonance images, which might not be time efficient, and sometimes may even produce inaccurate results. Nowadays, with the development of science and technology, Artificial Intelligence (AI) is present in many fields in human life, including medical field. Tumor detection with AI is one of the applications that technology changes human life. The Convolution Neural Network (CNN), a prominent algorithm in deep learning, is widely employed in tumor identification. In this study, a CNN model is proposed. Over 7000 brain tumor magnetic resonance images, including glioma, meningioma, no tumor and pituitary are used in this study. The images are also preprocessed to improve the accuracy of the proposed models. In this study, the well-known VGG16 model, which is a pretrained deep learning model, is utilized to compare with the proposed model. The proposed model and the VGG16 model are trained and evaluated using both the original (uncropped) images and preprocessed (cropped) images. The results of the experiment indicate that the suggested model exceeds the VGG16 model in the light of loss and accuracy.

“The analysis of cryptic text is hard problem”, and there is no fixed algorithm for generating plain-text from cipher text. Human brains do this intelligently. The intelligent cryptic analysis process needs learning algorithms, co-operative effort of cryptanalyst and mechanism of knowledge based inference engine. This information of knowledge base will be useful for mining data(plain-text, key or cipher text plain-text relationships), classification of cipher text based on enciphering algorithms, key length or any other desirable parameters, clustering of cipher text based on similarity and extracting association rules for identifying weaknesses of cryptic algorithms. This categorization will be useful for placing given cipher text into a specific category or solving difficult level of cipher text-plain text conversion process. This paper elucidates cipher text-plain text process first than utilizes it to create a framework for AI-enabled-Cryptanalysis system. The process demonstrated in this paper attempts to analyze captured cipher from scratch. The system design elements presented in the paper gives all hints and guidelines for development of AI enabled Cryptic analysis tool.

The increasing complexity of urban transportation systems and the growing volume of vehicles have made traffic congestion a persistent challenge in modern cities. Efficient traffic flow prediction is essential for mitigating congestion, improving road safety, optimizing traffic signal control, and enhancing overall transportation efficiency. In recent years, artificial intelligence (AI) has emerged as a transformative tool in the field of traffic management, offering sophisticated algorithms capable of modeling, analyzing, and predicting complex traffic patterns with high accuracy. The application of AI in traffic flow prediction leverages vast amounts of real-time and historical data to generate precise forecasts, supporting data-driven decision-making by urban planners and traffic control authorities. The prediction of traffic flow involves analyzing time-series data that exhibit nonlinear, dynamic, and often stochastic behavior. Traditional statistical models, such as autoregressive integrated moving average (ARIMA), have proven to be limited in handling the high dimensionality and variability inherent in traffic systems. In contrast, AI algorithms possess the capacity to learn and adapt from complex data inputs without the need for explicit programming, making them particularly suitable for traffic-related applications. AI algorithms used in traffic flow prediction can be broadly categorized into machine learning (ML) and deep learning (DL) approaches. Machine learning algorithms such as k-nearest neighbors (KNN), support vector machines (SVM), decision trees, and random forests have demonstrated effectiveness in short-term traffic prediction tasks. These algorithms are capable of identifying hidden patterns in traffic data and adjusting to changes in traffic behavior over time. Ensemble methods, which combine the strengths of multiple learning models, further enhance prediction accuracy and robustness. Deep learning algorithms, a subfield of AI inspired by the human brain’s neural architecture, have shown exceptional performance in capturing spatial-temporal dependencies in traffic data. Recurrent neural networks (RNNs), particularly long short-term memory (LSTM) networks and gated recurrent units (GRUs), are widely used for their ability to process sequential data and retain information over extended time intervals. Convolutional neural networks (CNNs) are employed to extract spatial features from traffic sensor data or road network imagery. Hybrid models that integrate CNNs with RNNs have achieved high levels of predictive precision by simultaneously learning spatial and temporal correlations. In addition to supervised learning methods, unsupervised and reinforcement learning techniques are also applied in traffic flow prediction. Clustering algorithms, such as k-means and DBSCAN, assist in identifying traffic patterns, while reinforcement learning models optimize adaptive traffic signal control systems by learning optimal actions through environmental interaction. This study explores the different types of AI algorithms used in traffic flow prediction, examining their theoretical foundations, structural differences, and practical applications. It aims to evaluate the comparative advantages of various algorithms in addressing the challenges of real-time traffic prediction in increasingly complex transportation networks.

In this study, we propose a novel visual object recognizer inspired by the human brain’s emotional learning. In the proposed computational model, the visual information is transferred through the ventral visual pathway to the amygdala, which is responsible for emotional visual stimuli. In the model, the orbitofrontal cortex (OFC) evaluates the amygdala response and tries to prevent inappropriate answers. The proposed visual recognizer is based on threshold logic units defined on the neural models of the amygdala and the OFC. According to the experimental results, the presented model learns the visual patterns quickly and shows higher performance than the brain emotional learning-based pattern recognizer (BRLPR) and multilayer perceptron (MLP) with Levenberg–Marquardt backpropagation (BPG) learning algorithm, in which the adaptive neurofuzzy inference system (ANFIS) cannot be trained because of the curse of dimensionality. The main features of the proposed model are the lower time and spatial complexity. Hence, it can be utilized in real-time visual object recognition.

Machine learning (ML) algorithms seek to extract the most beneficial information out of the raw data. As mentioned in previous chapters, preprocess data preparation actions might be needed in order to make the data set ready to be fed into the ML algorithms. ML algorithms have gotten the attention of researchers all over the world during the last few decades. In traditional algorithms, the analyst had to define the rules, which was not always accessible or easily possible, in order to obtain the output. ML algorithms develop the models or rules based on the training data set which include input and output data points. ML algorithms try to understand more beneficial information regarding the system based on the training data set. The built model can be tested using the verification data set which does not have any overlap with the training sets. If the model acquires the acceptable performance measures, it can be applied for other cases to perform the prediction process. It should be considered that ML algorithms are not supposed to do the magic. Indeed, they are supposed to explore and analyze the training data, which the human brain is not able to handle that, to develop a predictive model in which its performance is acceptable for the verification data set. Predictive models should be generalized which means performing satisfactorily for both training and verifying data sets.

The purpose of this study is to familiarise the reader with the foundations of neural networks. Artificial Neural Networks (ANNs) are algorithm-based systems that are modelled after Biological Neural Networks (BNNs). Neural networks are an effort to use the human brain's information processing skills to address challenging real-world AI issues. The evolution of neural networks and their significance are briefly explored. ANNs and BNNs are contrasted, and their qualities, benefits, and disadvantages are discussed. The drawbacks of the perceptron model and their improvement by the sigmoid neuron and ReLU neuron are briefly discussed. In addition, we give a bird's-eye view of the different Neural Network models. We study neural networks (NNs) and highlight the different learning approaches and algorithms used in Machine Learning and Deep Learning. We also discuss different types of NNs and their applications. A brief introduction to Neuro-Fuzzy and its applications with a comprehensive review of NN technological advances is provided.

Today's systems, especially in the age of federated learning, rely on sending all the data to the cloud, and then use complex algorithms, such as Deep Neural Networks, which require billions of parameters and many hours to train a model. In contrast, the human brain can do much of this learning effortlessly. Hyperdimensional (HD) Computing aims to mimic the behavior of the human brain by utilizing high dimensional representations. This leads to various desirable properties that other Machine Learning (ML) algorithms lack such as: robustness to noise in the system and simple, highly parallel operations. In this paper, we propose HyDREA, a HD computing system that is Robust, Efficient, and Accurate. To evaluate the feasibility of HyDREA in a federated learning environment with wireless communication noise, we utilize NS-3, a popular network simulator that models a real world environment with wireless communication noise. We found that HyDREA is 48× more robust to noise than other comparable ML algorithms. We additionally propose a Processing-in-Memory (PIM) architecture that adaptively changes the bitwidth of the model based on the signal to noise ratio (SNR) of the incoming sample to maintain the robustness of the HD model while achieving high accuracy and energy efficiency. Our results indicate that our proposed system loses less than 1% classification accuracy, even in scenarios with an SNR of 6.64. Our PIM architecture is also able to achieve 255× better energy efficiency and speed up execution time by 28× compared to the baseline PIM architecture.

Many colleges in China have adopted the policy of recruiting students by academic subject categories in order to optimize the talent training mode. To solve the problems in major selection after enrollment, this paper has designed an intelligent algorithm model for recommending college majors. Compared with existing methods for assigning college majors, the model uses deep neural networks and clustering algorithms to simulate complex calculations in the human brain. It uses historical learning data from senior students or graduates to predict the future grades of freshmen, judge their adaptability to various college majors, reduce human interference in the college major selection process, recommend the most suitable college major to students.

In February 2011, Watson (IBM super computer) managed to beat two past grand champions on the TV quiz show Jeopardy!. Watson was able to answer questions that require intelligence when done by humans. This marked the first machine to pass the Turing test and started a new era of computing called cognitive computing where computers (modeled after the human brain) learn and interact naturally with people to extend what either humans or machine could do on their own. Google, Amazon, Facebook, etc., using big data technologies, smart Machine Learning and AI algorithms were able to tap into our intensions by predicting what we click, buy, like, dislike, shop, surf, etc.,. This marked the era of smart Web or predictive intelligence where Turing test is reversed and machines now try to figure out who we are, our information needs, our behavioral patterns, the activities we are engaged in and our goals. Together with the torrents of data we leave behind us every time we communicate with the digital eco-system, a new era of human-machine cooperation is starting that gives us millions of potential insights into user experience, marketing, personal tastes, and human behavior. In this talk, we are going to illustrate through motivating cases and research directions the main characteristics of this era and how it can transform the way we interact with the Web to ultimately improve the quality of our lives and gain valuable insights into our affective, mental and physical states.

Internet of Things is an intelligence devices that can connect to any other devices. Based on that ability to connect and its intelligence, it makes people to create an intelligence device and capable to learn like human brain. To accomplish that goal, machine learning is the solution. Combination between machine learning and IoT generate a revolution in human life and application industry. The combination also generate new trend in market. Therefore, in this paper will be discuss about machine learning including machine learning technique and algorithm and also discuss about IoT including architecture and elements. Then in this paper will discuss about some researches that have already done that combine IoT with machine learning approach, including issue and challenge in those researches.

Deep learning has gained immense popularity in scientific computing, and its algorithms are widely used in complex problem-solving industries. Every deep learning algorithm use different types of neural networks to perform indented tasks. Deep learning (DL) algorithms have emerged from different machine learning and soft computing methodologies. Since then, a number of deep learning (DL) algorithms have been recently introduced in the scientific community and applied in various application fields. Today, the use of DLs has become indispensable due to their intelligence, effective learning, accuracy and reliability in model creation. However, a comprehensive list of DL algorithms has not yet been presented in the scientific literature. This article lists the most popular DL algorithms and their application areas. Deep learning uses ANN artificial neural networks to perform convoluted calculations on huge amounts of data. It is a type of machine learning based on the structure and function of the human brain. Deep learning algorithms train machines by learning from examples. Industries such as healthcare, e-commerce, entertainment and advertising often use deep learning.

Neuro-fuzzy systems are learning machines that employ algorithms derived from articial neural networks to nd the parameters of a fuzzy inference system. These hybridintelligent systems can learn fuzzy rules from the data, while preserving their semantic properties. The learning algorithms employed in these systems are inspired from the physiology and functioning of human brain. As the study on neuroscience and cognitive psychology is an ongoing process, it is essential that these machine learning algorithms be extended with developments from the ndings in human learning psychology. Studies in human learning psychology have shown that self-regulated learning in a meta-cognitive framework is the best learning strategy. Meta-cognition also provides a learner with self-monitoring, which is a step-by-step process of evaluation during the learning process. In this thesis, we develop a Meta-Cognitive sequential learning algorithm for Neuro-Fuzzy Inference System called McFIS which is based on a well-known model of meta-cognition proposed by Nelson and Narens. Similar to Nelson and Narens model of meta-cognition, McFIS consists of a cognitive and a meta-cognitive component. A Takagi-Sugeno-Kang type neuro-fuzzy inference system forms the cognitive component and a self-regulatory learning mechanism is its meta-cognitive component. The metacognitive component monitors the knowledge in the cognitive component and controls the learning by eciently deciding on which sample to learn, when to learn it and how to learn it, eciently. Such a learning strategy helps the network generalize the functional relationship between input and output. The performance evaluation of McFIS on a set of benchmark function approximation and time-series prediction problems indicate signicant improvement over other state-of-the-art techniques. In addition, quantitative study on a set classication problems indicate motivating results. ix

Inspired by the human brain's structure and function, Artificial Neural Networks (ANN) were developed for data classification. However, existing Neural Networks, including Deep Neural Networks, do not mimic the brain's rich structure. They lack key features such as randomness and neuron heterogeneity, which are inherently chaotic in their firing behavior. Neurochaos Learning (NL), a chaos-based neural network, recently employed one-dimensional chaotic maps like Generalized Lüroth Series (GLS) and Logistic map as neurons. For the first time, we propose a random heterogeneous extension of NL, where various chaotic neurons are randomly placed in the input layer, mimicking the randomness and heterogeneous nature of human brain networks. We evaluated the performance of the newly proposed Random Heterogeneous Neurochaos Learning (RHNL) architectures combined with traditional Machine Learning (ML) methods. On public datasets, RHNL outperformed both homogeneous NL and fixed heterogeneous NL architectures in nearly all classification tasks. RHNL achieved high F1 scores on the Wine dataset (1.0), Bank Note Authentication dataset (0.99), Breast Cancer Wisconsin dataset (0.99), and Free Spoken Digit Dataset (FSDD) (0.98). These RHNL results are among the best in the literature for these datasets. We investigated RHNL performance on image datasets, where it outperformed stand-alone ML classifiers. In low training sample regimes, RHNL was the best among stand-alone ML. Our architecture bridges the gap between existing ANN architectures and the human brain's chaotic, random, and heterogeneous properties. We foresee the development of several novel learning algorithms centered around Random Heterogeneous Neurochaos Learning in the coming days.