Program Equivalence Using Neural Networks

Traceability of codes refers to the mapping between equivalent codes written in different languages - including high-level and low-level programming languages. In the field of Legal Metrology, it is critical to guarantee that the software embedded in a meter corresponds to a version that was previously approved by the Legal Metrology Authority. In this paper, we propose a novel approach for correlating source and object codes using artificial neural networks. Our approach correlates the source code with the object code by feeding the neural network with logical flow characteristics of such codes. Any incidence of false positives is obviously a critical issue for software evaluation purposes. Our evaluation using real code examples shows a correspondence around 90% for the traceability of the executable codes with very low rate of false positives.

Low-level languages like C/C++ are widely used in various applications for their performance and flexibility. Unfortunately, these languages are prone to memory corruption vulnerabilities, leading to control-flow hijacking attacks. Control flow integrity (CFI) is a general principle to enforce run-time control flow of a program to a pre-computed control-flow graph (CFG). While the traditional context-insensitive CFI falls short in protecting critical control transfers, recent context-sensitive CFI research shows promising improvements but has various limitations. We present Control Flow Integrity with Look Back (CFI-LB), a call-site sensitive CFI in which a conventional source-target control transfer is strengthened by a look back into its call-sites (return addresses). CFI-LB features the adaptive call-site sensitivity in which each indirect call has its own level of sensitivity and the multi-scope CFG to improve the security even if a precise context-sensitive static CFG is not available, especially for large programs such as GCC and NGINX. One of the CFGs is constructed by our localized concolic execution, which significantly extends the dynamic CFG with very low false positives. In addition, CFI-LB is the first CFI system explicitly designed to protect its reference monitors from race conditions. We have built a prototype of CFI-LB. The evaluation with SPEC CPU2006 benchmarks and NGINX indicates that CFI-LB has a low-performance overhead (less than 5% on average for the full protection) while increasing the security.

This paper presents an investigation of an artificial neural network (ANN) to predict the flutter characteristics of a simple wing that under went multiple weight variation changes. The weight variations were used to simulate the addition of non-structural weight or structural repair weight. The test case wing had 24 designated repair areas where repair weights were added as lumped masses. Weight and location of the repairs were randomly generated to increase the sample size and help the generalization of the ANN. The ANN was evaluated for both the flutter speed and flutter frequency for multiple levels of structural damping. The number of test cases required to train the neural network was also evaluated for both the error between the input and output results as well as the generalization of the neural networks.

Artificial neural networks have been applied to the differentiation of masses from false- positive detections in digital mammograms. A database of 110 pairs of digital mammograms containing a total of 102 masses (54 malignant, 48 benign) was utilized in this study. Three- hundred-two false positive regions were selected from these images to be used in the training of the artificial neural network. Over 90 features were calculated for both the true masses and the false positives. Features that showed the most separation, in a one-dimensional analysis, between true positives and false positives were selected for artificial neural network input. A three level feed-forward neural network was used with one input layer, one hidden layer and an output layer. By varying the structure and learning rate of the neural network an optimal structure was found. The performance of the ANN was evaluated by means of receiver operating characteristic (ROC) analysis and free-response receiver operating characteristic (FROC) analysis. Results from a round robin evaluation yielded an Az of 0.97 in the task of differentiating between masses and false-positive detections. In the future, multi-dimensional feature analysis will be performed to obtain the optimal performance using a combination of rule-based decision making along with artificial neural networks.

این مطالعه به منظور بررسی پیش بینی شاخص های عملکرد تولیدی در مرغان تخم گذار با استفاده از شبکه های عصبی مصنوعی و رگرسیون غیرخطی چندگانه انجام شد. بررسی بر روی اطلاعات چهار دوره متوالی پرورش در یک واحد پرورش مرغ تخم گذار صورت گرفت. روش های داده-کاوی شامل رگرسیون خطی و غیر خطی، شبکه عصبی پرسپترون سه لایه، شبکه عصبی پرسپترون چهار لایه و شبکه عصبی با تابع پایه ای شعاعی بود. در این مدل ها از متغیرهای سن گله، میزان خوراک مصرفی و فصل تولید به عنوان متغیر پیشگو و شاخص های عملکرد تولیدی شامل درصد تخم-گذاری، وزن توده ای تخم مرغ تولیدی و ضریب تبدیل غذایی به عنوان متغیر پاسخ استفاده شد. نتایج نهایی رگرسیون های خطی نشان داد که برای تمامی متغیرهای وابسته مورد مطالعه متغیر مستقل سن گله معنی دار می باشد. بنابراین رگرسیون غیر خطی شاخص های عملکرد تولیدی در مقابل سن برای مقایسه با شبکه های عصبی مختلف مورد بررسی قرار گرفت و برای مقایسه کلیه مدل ها از ضریب تعیین (R2) و میانگین قدر مطلق خطا (MAE) استفاده شد. نتایج نشان داد بین شبکه های عصبی مصنوعی مختلف مورد مطالعه، شبکه با تابع پایه ای شعاعی بهتر از سایر مدل های در پیش‌بینی شاخص های عملکرد تولیدی مرغان تخم گذار عمل می کند.

BGNN4VD: Constructing Bidirectional Graph Neural-Network for Vulnerability Detection

Nowadays, Photovoltaic (PV) energy sources are responsible for more than 720TWh of the global energy consumed. Therefore, among all the arising research topics regarding PV sources, Maximum Power Point tracking (MPPT) algorithms are widely studied, since they have critical importance in order to properly track and acquire the Maximum Power Point (MPP) of energy that can be harvested from the PV source; where, metaheuristic optimization algorithms have been adapted as MPPT solutions, showing an improved settling time with steady-state oscillations reduction. Yet, many of the Metaheuristic-based MPPTs have issues against dynamically variable MPP through time, since they cannot work properly without a reset signal upon temperature and irradiance parametric changes, due the fact that those algorithms converge on a global solution after some iterations and need to know when to start looking for the MPP again in order to avoid getting stuck in old MPP points. Hence, this work shows the implementation of Artificial Neural Networks (ANN) for pattern recognition through the power data acquisition, which enables an efficient solution that allows detecting changes in solar irradiation, which leads to a reliable reinitialization signal through the detection of solar irradiation through the ANN; where, results show over 99% of accuracy from the change in solar irradiation detection. Moreover, the ANN was trained using the metaheuristic Earthquake Algorithm (EA), which was again validated as a training method for ANN. In addition, this work enables other users to suite the EA algorithm to other applications and the implementation of ANN into the Simulink environments; both achievements, through the presentation and exploration of a complete MATLAB code example for the implementation of the EA as ANN training method, and the complete Simulink testbed design with a full description of the ANN implementation for the Simulink environment.KeywordsArtificial neural networksMetaheuristicsPhotovoltaic systems

Objective: The main objective of this paper is to improve the intrusion detection accuracy of neural networks by hybridized with Jordan network, applying novel Lyapunov function and changing input values as fuzzy values using fuzzy logic. Methods: In this research, the intrusion detection of NSL KDD dataset is carry out by neural network first . The performance of neural networks mainly depends on the parameters like number of hidden layer, no of node in the hidden layer and the no of epoch. Selecting the proper parameters values and weight initialization are the main difficulty in neural network. To overcome this issue a hybrid network by combining neural network with Jordan network is proposed which is highly sensitive to weight convergence. In hybrid network Lyapunov function is used to achieve the stability of equilibrium between two networks. But in this work a novel Lyapunov function is proposed to achieve global robust stability in hybrid network. A novel Lyapunov function uses a class of general activation functions which are not to be differentiable, bounded or monotonically nondecreasing. A set of criteria are derived to guarantee the existence, uniqueness and global robust stability of the equilibrium of hybrid networks with time delays. Then the learning ability of hybrid network is improved by using fuzzy logic. The hybrid network improved by a novel Lyapunov and fuzzy logic is called as Improved Fuzzy Hybrid Jordan network and Artificial Neural Network (IHFJANN). Findings: Artificial Neural Network (ANN), Hybrid Jordan network and Artificial Neural Network (HJANN) and Improved Hybrid Fuzzy Jordan network and Artificial Neural Network (IHFJ ANN) are applied on NSL KDD training dataset to lean the type of available attacks. NSL training dataset contains 2500 instances and 38 attributes where as testing dataset contains 995 instances and 38 attributes. The learned model of three classifiers is used to predict the classes in test dataset. The performance measures are evaluated in terms of accuracy, precision, recall and f-measure values. Improvement: The classification accuracy of Artificial Neural Network (ANN), Hybrid Jordan network and Artificial Neural Network (HJANN) and Improved Hybrid Fuzzy Jordan network and Artificial Neural Network (IHFJANN) are 72%, 80% and 84% respectively. Accuracy is increased by 12% in IHFJANN than the ANN and 4% than the HJANN. The precision value of ANN, HJANN and IHFJANN are 0.46, 0.54 and 0.57 respectively. Precision value is increased by 0.9 in IHFJANN than the ANN and 0.3 than the HJANN. The recall value of ANN, HJANN and IHFJANN are 0.73, 0.81 and 0.84 respectively. Recall value is increased by 0.9 in IHFJANN than the ANN and 0.3 than the HJANN. The F-measure value of ANN, HJANN and IHFJANN are 0.58, 0.65 and 0.68 respectively. F-measure value is increased by 0.10 in IHFJANN than the ANN and 0.3 than the HJANN. The results proved that the proposed IHFJANN provides better performance than ANN and HJANN.

The Sixth International Symposium on Neural Networks (ISNN 2009)

The article explores modern neural network architectures for the automatic detection and recognition of marine surface objects and obstacles of given classes throughout the full image area, applicable for execution in real or near real time on an optoelectronic vision system to au-tomate and improve the safety of civil marine navigation. A formal statement of the problem of automatic detection of objects on images is given. The state-of-the-art algorithms for detecting objects in images based on use of artificial convolutional neural networks were reviewed, their comparison was made and a reasonable choice was made in favor of the most efficient neuralnetwork architecture in terms of computational complexity to recognition accuracy. The subject area is studied, as well as publicly available databases of surface objects suitable for use in the training of algorithms using artificial neural networks. The article concluded that there is insuffi-cient labeled data for training neural network algorithms, as a result of which the authors inde-pendently collected research images and video sequences, prepared and labeled the collected data containing surface marine objects and other obstacles that represent a navigation hazard for ships. Based on the selected neural network architecture, a new neural network algorithm for automatic full-frame detection and recognition of surface objects was developed, and an artificial neural network was trained using the prepared database of images of typical objects. The resulting algorithm was tested by the authors on a validation data set, the quality of its work was estimated using various metrics, and the algorithm’s performance was measured. Conclusions are made about the necessity to expand the collected database of images of typical marine objects, further steps are proposed to improve the accuracy of the developed software and algorithmic complex and its implementation to be used in a marine optoelectronic machine vision system for automa-tion and improving the safety of civil navigation.

Some features of cognitive modeling are presented, including the prerequisites for a cognitive approach to solving complex problems. Cognitive modeling involves the use of various artificial neural networks, including convolutional neural networks. The classification of artificial neural networks according to various characteristics is given. The features of self-organizing neural networks and networks using deep learning methods are considered. The artificial neural network, which is a three-layer unidirectional direct propagation network, the interface of a computer program used to approximate functions using the specified neural network, as well as the solution of the image recognition problem using an artificial convolutional neural network, in which the neural network parameters are adjusted for each recognizable image fragment in order to adaptively filter the image, are considered in detail. The analysis of images in video surveillance systems in order to detect fires allows them to be detected at an early stage and, thus, prevent the fire propogation.

One of the limitations of the current computer-aided detection (CAD) of polyps in CT colonography (CTC) is a relatively large number of false-positive (FP) detections. Rectal tubes (RTs) are one of the typical sources of FPs because a portion of a RT, especially a portion of a bulbous tip, often exhibits a cap-like shape that closely mimics the appearance of a small polyp. Radiologists can easily recognize and dismiss RT-induced FPs; thus, they may lose their confidence in CAD as an effective tool if the CAD scheme generates such "obvious" FPs due to RTs consistently. In addition, RT-induced FPs may distract radiologists from less common true positives in the rectum. Therefore, removal RT-induced FPs as well as other types of FPs is desirable while maintaining a high sensitivity in the detection of polyps. We developed a three-dimensional (3D) massive-training artificial neural network (MTANN) for distinction between polyps and RTs in 3D CTC volumetric data. The 3D MTANN is a supervised volume-processing technique which is trained with input CTC volumes and the corresponding "teaching" volumes. The teaching volume for a polyp contains a 3D Gaussian distribution, and that for a RT contains zeros for enhancement of polyps and suppression of RTs, respectively. For distinction between polyps and nonpolyps including RTs, a 3D scoring method based on a 3D Gaussian weighting function is applied to the output of the trained 3D MTANN. Our database consisted of CTC examinations of 73 patients, scanned in both supine and prone positions (146 CTC data sets in total), with optical colonoscopy as a reference standard for the presence of polyps. Fifteen patients had 28 polyps, 15 of which were 5-9 mm and 13 were 10-25 mm in size. These CTC cases were subjected to our previously reported CAD scheme that included centerline-based segmentation of the colon, shape-based detection of polyps, and reduction of FPs by use of a Bayesian neural network based on geometric and texture features. Application of this CAD scheme yielded 96.4% (27/28) by-polyp sensitivity with 3.1 (224/73) FPs per patient, among which 20 FPs were caused by RTs. To eliminate the FPs due to RTs and possibly other normal structures, we trained a 3D MTANN with ten representative polyps and ten RTs, and applied the trained 3D MTANN to the above CAD true- and false-positive detections. In the output volumes of the 3D MTANN, polyps were represented by distributions of bright voxels, whereas RTs and other normal structures partly similar to RTs appeared as darker voxels, indicating the ability of the 3D MTANN to suppress RTs as well as other normal structures effectively. Application of the 3D MTANN to the CAD detections showed that the 3D MTANN eliminated all RT-induced 20 FPs, as well as 53 FPs due to other causes, without removal of any true positives. Overall, the 3D MTANN was able to reduce the FP rate of the CAD scheme from 3.1 to 2.1 FPs per patient (33% reduction), while the original by-polyp sensitivity of 96.4% was maintained.

Traditional malware detection methods cannot keep up with the massive amount of newly created malware quickly and effectively. Machine learning is a promising method for the detection and classification of large-scale newly created malware according to the features of samples. The current research trend is to use machine learning technology, such as the Gradient Boosting Decision Tree (GBDT) and deep neural network technology, to learn newly created malware rapidly and accurately. We propose Control-Flow Graph (CFG)- and Graph Isomorphism Network (GIN)-based malware classification, where we first extract the CFG from portable executable (PE) files and use the large-scale pre-training language model MiniLM to generate the node features of CFG. The extracted CFG is compressed to a feature vector with GIN and classified with Multi-Layer Perceptron. To evaluate our approach, we made a CFG-based malware detection dataset from PE files of the Dike Dataset, which we call the Malware Geometric Dataset (MGD), and collected the results. The evaluation results show that our proposal demonstrated 0.9977 in the Area Under Curve metric and achieved a 97.44 % detection rate when the False Positive Rate was 0.1 %.

Purpose In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Design/methodology/approach In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Findings In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Originality/value In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing.

This paper aims at developing a CAD system used for the detection of Ground Glass Opacity (GGO) nodules in chest CT images. In our scheme, we apply Gabor filter on the CT image in order to enhance the detection process. After this we perform some morphological operations including threshold process and labeling to extract the objects having high intensity values. Then, some feature analysis is used to examine these objects to decide which of them are likely to be cancer candidates. Following the feature analysis, a template matching between the potential cancer candidates and some Gaussian reference models is performed to determine the similarity between them. The algorithm was applied on 715 slices containing 25 GGO nodules and achieved detection sensitivity of 92% with False Positive (FP) rate of 0.76 FP/slice. Finally, we used an Artificial Neural Network (ANN) to reduce the number of FP findings. After using ANN, we were able to reduce the FP rate to 0.25 FP/slice but at the expense of decreasing the detection sensitivity to 84%