MR brain image classification by multimodal perceptron tree neural network

The brain is considered a main important part of human body as it participate to control all the activities of human. Under some unhealthy conditions the abnormal and uncontrolled growth of tissue may take place which is unnatural process. This kind of process taking place in human brain is referred as “brain tumor”. The brain tumor may be of cancerous (malignant) or may be of non-cancerous (Benign) and its detection is a very much important to reduced the death rate of humans suffering from tumor. The detection of brain tumor can be performed by using various image processing techniques like brain magnetic resonance imaging (MRI), Computed Tomography (CT), Electroencephalography (EEG), Positron Emission Tomography (PET), Magneto Encephalography (MEG) etc. Among these techniques the brain MRI is widely adopted in the world due to its significant features. But to detect tumor in the brain MRI, the processes like preprocessing, segmentation and classification are must. This paper deals with the various aspects of the brain tumor detection. The paper discusses the significant researches which are meant for brain tumor detection through MRI quality enhancement, MRI segmentation and MRI classification (as cancerous or not). The outcome of the paper discussed that there were no proper researches are performed to detect the brain tumor, focused on good quality of image, less researches on segmentation and classification of brain tumor. Finally the paper gives the future research scope to overcome the addressed research gap.

BackgroundSegmenting the hippocampal subfields accurately from brain magnetic resonance (MR) images is a challenging task in medical image analysis. Due to the small structural size and the morphological complexity of the hippocampal subfields, the traditional segmentation methods are hard to obtain the ideal segmentation result.MethodsIn this paper, we proposed a hippocampal subfields segmentation method using generative adversarial networks. The proposed method can achieve the pixel-level classification of brain MR images by building an UG-net model and an adversarial model and training the two models against each other alternately. UG-net extracts local information and retains the interrelationship features between pixels. Moreover, the adversarial training implements spatial consistency among the generated class labels and smoothens the edges of class labels on segmented region.ResultsThe evaluation has performed on the dataset obtained from center for imaging of neurodegenerative diseases (CIND) for CA1, CA2, DG, CA3, Head, Tail, SUB, ERC and PHG in hippocampal subfields, resulting in the dice similarity coefficient (DSC) of 0.919, 0.648, 0.903, 0.673, 0.929, 0.913, 0.906, 0.884 and 0.889 respectively. For the large subfields, such as Head and CA1 of hippocampus, the DSC was increased by 3.9% and 9.03% than state-of-the-art approaches, while for the smaller subfields, such as ERC and PHG, the segmentation accuracy was significantly increased 20.93% and 16.30% respectively.ConclusionThe results show the improvement in performance of the proposed method, compared with other methods, which include approaches based on multi-atlas, hierarchical multi-atlas, dictionary learning and sparse representation and CNN. In implementation, the proposed method provides better results in hippocampal subfields segmentation.

Surgical robots are gaining increasing popularity because of their capability to improve the precision of pedicle screw placement. However, current surgical robots rely on unimodal computed tomography (CT) images as baseline images, limiting their visualization to vertebral bone structures and excluding soft tissue structures such as intervertebral discs and nerves. This inherent limitation significantly restricts the applicability of surgical robots. To address this issue and further enhance the safety and accuracy of robot-assisted pedicle screw placement, this study will develop a software system for surgical robots based on multimodal image fusion. Such a system can extend the application range of surgical robots, such as surgical channel establishment, nerve decompression, and other related operations. Initially, imaging data of the patients included in the study are collected. Professional workstations are employed to establish, train, validate, and optimize algorithms for vertebral bone segmentation in CT and magnetic resonance (MR) images, intervertebral disc segmentation in MR images, nerve segmentation in MR images, and registration fusion of CT and MR images. Subsequently, a spine application model containing independent modules for vertebrae, intervertebral discs, and nerves is constructed, and a software system for surgical robots based on multimodal image fusion is designed. Finally, the software system is clinically validated. We will develop a software system based on multimodal image fusion for surgical robots, which can be applied to surgical access establishment, nerve decompression, and other operations not only for robot-assisted nail placement. The development of this software system is important. First, it can improve the accuracy of pedicle screw placement, percutaneous vertebroplasty, percutaneous kyphoplasty, and other surgeries. Second, it can reduce the number of fluoroscopies, shorten the operation time, and reduce surgical complications. In addition, it would be helpful to expand the application range of surgical robots by providing key imaging data for surgical robots to realize surgical channel establishment, nerve decompression, and other operations.

This paper develops a volume-based technique, called Volume Sphering Analysis (VSA) which can process all acquired Magnetic Resonance (MR) image slices formed image cube using only one set of training samples obtained from an image slice. So, several significant advantages and benefits can be gained from our proposed VSA. In the past, when MR image classification is performed, each image slice requires its own specific training samples and training samples obtained from one slice are not applied to another slice. The VSA allows users to reduce computational time. In addition, it saves significant effort in selecting training samples for each of image slices. Thirdly, it is robust to all image slices compared to the traditional one-slice MR image classification which is sensitive to each image slice. Experimental results demonstrate that the VSA performs as well as does that using specifically selected training samples for individual image slices.

Accurate classification and quantification of brain tissues is important for monitoring disease progression, measurement of atrophy, and correlating magnetic resonance (MR) measures with clinical disability. Classification of MR brain images in the presence of lesions, such as multiple sclerosis (MS), is particularly challenging. Images obtained with lower resolution often suffer from partial volume averaging leading to false classifications. While partial volume averaging can be reduced by acquiring volumetric images at high resolution, image segmentation and quantification can be technically challenging. In this study, we integrated the brain anatomical knowledge with non-parametric and parametric statistical classifiers for automatically classifying tissues and lesions on high resolution multichannel three-dimensional images acquired on 60 MS brains. The results of automatic lesion segmentation were reviewed by the expert. The agreement between results obtained by the automated analysis and the expert was excellent as assessed by the quantitative metrics, low absolute volume difference percent (36.18 ± 34.90), low average symmetric surface distance (1.64 mm ± 1.30 mm), high true positive rate (84.75 ± 12.69), and low false positive rate (34.10 ± 16.00). The segmented results were also in close agreement with the corrected results as assessed by Bland–Altman and regression analyses. Finally, our lesion segmentation was validated using the MS lesion segmentation grand challenge dataset (MICCAI 2008).

In the last few years there has been rapid progress in the application of nuclear magnetic resonance clinical imaging as a diagnostic aid (Partain et al, 1983; Steiner, 1983; Worthington, 1983). Records kept by the operators of NMR imaging equipment indicate that about 1800 individuals have now been examined without incident within the United Kingdom. In view of this progress, an advisory group (Appendix) appointed by the National Radiological Protection Board recommends some modifications to the original advice given in 1981 (NRPB, 1981). The principal modifications are that: (1) It is no longer considered necessary to exclude volunteers with a history of epilepsy or cardiac disease. (2) It is not obligatory that a registered medical practitioner trained in resuscitation techniques be present during an exposure. (3) Higher limits are recommended for rates of change of magnetic flux density when the period of change is less than 10 ms. (4) The radiofrequency limit of 15 MHz has been removed. Theoretical considerations indicate that the interaction of an applied magnetic field with the intrinsic magnetic moments of protons and electrons within a molecule could alter its rate of chemical reaction (McLauchlan, 1981). Chemical reactions involving radical pair intermediates are expected to be sensitive to magnetic fields for this reason and a number of enzyme reactions that might be expected to be affected have been identified (A. Cass, personal communication). However, there is no experimental confirmation of these theoretical possibilities at present.

In this paper, various medical software tools, which have been developed for the manual, semi-automatic or fully-automatic segmentation of magnetic resonance (MR) images, and some features of these software tools are presented and discussed. MR imaging is one of the medical imaging modalities which are frequently preferred by the clinicians and surgeons. Segmentation of the MR images in clinical researches and in clinical engineering-based studies is emerging as a considerable requirement for the analysis of the disease images and the diseases. Medical software tools have been developed to meet this need and to provide facilities for the clinicians, surgeons and researchers in computer-aided research projects they conduct. Currently available MR image segmentation tools have many differences when considering criteria such as design, graphical-user interface and functions they provide. In this short review study, we briefly summarized 10 different MR image segmentation software tools highlighted in clinical researches and engineering studies and these software tools have been introduced.

The study intended to explore the effect of different neural network algorithms in the electrocardiogram (ECG) classification of patients with congenital heart disease (CHD). Based on the single convolutional neural network (CNN) ECG algorithm and the recurrent neural network (RNN) ECG algorithm, a multimodal neural network (MNN) ECG algorithm was constructed utilizing the MIT-BIH database as training set and test set. Furthermore, the MNN ECG algorithm was optimized to establish an improved MNN (IMNN) algorithm, which was applied to the diagnosis of CHD patients. The CHD patients admitted between August 2016 and August 2019 were selected for analysis to compare the classification effect and accuracy rate of IMNN, MNN, CNN ECG, and RNN ECG algorithms. It was found that the RNN ECG algorithm had higher classification sensitivity and true positive rate in terms of normal or bundle (NB) branch block beat, supraventricular abnormal (SA) rhythm, abnormal ventricular (AV) beat, and fusion beat (FB) than the CNN ECG algorithm ( P < 0.05 ), and the classification sensitivity and true positive rate of IMNN algorithm in the four aspects were significantly higher than those of MNN algorithm ( P < 0.05 ). The classification accuracy of CNN ECG algorithm and RNN ECG algorithm was above 98%, while that of MNN algorithm and IMNN algorithm was better than that of CNN ECG algorithm and RNN ECG algorithm, and the accuracy rate can reach 98.5% or more. Moreover, the accuracy rate of the IMNN algorithm can reach more than 98%. In conclusion, IMNN not only has a good classification ability in the simulated environment but also performs well in the actual environment, which is worthy of clinical promotion.

An efficient statistical model tissue classification algorithm is proposed for the segmentation of brain magnetic resonance images. Due to the partial volume effects, many voxels may be composed of a multiple tissue types. To solve this problem, we present an efficient method for brain magnetic resonance images classification. The method uses the Bayesian contextual classifier based on Markov random field models. In the algorithm, each mixture voxels in the MR image is labeled using the maximum a posteriori classifier. A spatial prior is defined based on homogeneous regions while taking into different tissue mixtures. The efficacy of the proposed algorithm is demonstrated by extensive experiments using phantom data.

Accurate and fast segmentation of magnetic resonance (MR) images with volumetric brain formations, such as glioblastomas and meningiomas, helps plan surgical and radiation treatment, increase the safety and radicality of surgical intervention, which in turn allows to increase the overall life expectancy of patients and the disease-free period. It is required for the development and evaluation of the effectiveness of a deep convolutional neural network with transmission connections for automatic segmentation of volumetric brain formations (meningiomas and glioblastomas) on postoperative MR images, as well as analysis of its accuracy in comparison with manual expert segmentation and existing methods. Material and methods . The paper considers the creation of an architecture inspired by the SegResNet model, training on BraTS2024-GLI and BraTS2024-MEN-RT, describes a method for compiling a training sample that reduces class imbalance, and analyzes the results in comparison with participants in the BraTS 2024 competition. Results and discussion . The developed model was trained and tested on two datasets of postoperative images of glioblastoma and meningioma. Several metrics are analyzed to compare the model with the methods described in the literature, as well as to evaluate it in the context of the variability of manual segmentation by different experts. The model achieves a Sorensen coefficient 0.8299 for meningioma segmentation and 0.7028 for glioblastoma contrast-accumulating region segmentation. In addition, the segmentation of the model provides an accurate estimate of the volume of the tumor area, as evidenced by the high values of the coefficient of intra-class correlation – 0.9661 for meningioma and 0.8339 for glioblastoma. Overall, the developed model requires fewer resources for learning and getting results. Conclusions. Model performs segmentation at least at the expert level, but with significantly less variability, especially when assessing the volume of the tumor after surgical treatment.

We introduce a new neural network architecture, Multimodal Neural Graph Memory Networks (MN-GMN), for visual question answering. Our novel approach uses graph structure with different region features as node attributes and applies a recently proposed powerful graph neural network model, Graph Network (GN), to reason about objects and their interactions in the scene context. The input module of the MN-GMN generates a set of visual features plus a set of region-grounded captions (RGCs) for the image. The RGCs capture object attributes and their relationships. Two GNs are constructed from the input module using visual features and RGCs. Each node of the GNs iteratively computes a question-guided contextualized representation of the visual/textual information assigned to it. To combine the information from both GNs, each node writes the updated representations to an external spatial memory. The final states of the memory cells are fed into an answer module to predict an answer. Experiments show that MN-GMN rivals the state-of-the-art models on the Visual7W, VQA-v2.0, and CLEVR datasets.

In this paper, a new method is proposed to decrease sensitiveness to motion noise and uncertainty in magnetic resonance imaging (MRI) segmentation especially when only one brain image is available. The method is approached with considering spatial neighborhood information by fusing the information of pixels with their neighbors with Dempster–Shafer (DS) theory. The basic probability assignment (BPA) of each single hypothesis is obtained from the membership function of applying fuzzy c-means (FCM) clustering to the gray levels of the MRI. Then multiple hypotheses are generated according to the single hypothesis. Then we update the objective pixel’s BPA by fusing the BPA of the objective pixel and those of its neighbors to get the final result. Some examples in MRI segmentation are demonstrated at the end of the paper, in which our method is compared with some previous methods. The results show that the proposed method is more effective than other methods in motion-blurred MRI segmentation.

Accurate and efficient diagnosis in a short time period is an important part of brain magnetic resonance imaging (MRI) classification. In this paper, we use multi-cluster feature selection (MCFS) method to select efficient features from the primary features for brain MRI classification. The primary features are obtained from a three-level two-dimensional discrete wavelet transform (2D DWT). The selected features are then applied to the K-nearest neighbor (KNN) classifier. We classify the MRI as normal or one of the seven different diseases. The results demonstrate that the proposed method achieves higher accuracy than the other methods in distinguishing different types of disease.

A Centroid Neural Network with spatial constraints (CNN-S) is proposed in this paper. The spatial constraints are applied to the Centroid Neural Network(CNN) algorithm to reduce noise in Magnetic Resonance(MR) images. MR image segmentation is performed to illustrate the application of the proposed algorithm. The proposed algorithm incorporates a novel approach of using the weights of attributes to evaluate the roles of the latter. Experiments and results on MR images from Internet Brain Segmentation Repository(IBSR) show that the proposed algorithm provides a superior performance over other algorithms such as Fuzzy C-Means(FCM)and Fuzzy C-Means with spatial constraints(FCM-S).

Since the phenomena of intensity inhomogeneity in MR images are prominent and adversely affect quantitative image analysis .In this paper ,we propose a novel magnetic resonance (MR) image segmentation approach based on the kernel graph cuts technique .Because of automatic multiregion segmentation and global energy minimization ,the kernel graph cuts method can be applied to many kinds of images segmentation ,such as MR images and so on . To reduce or eliminate intensity inhomogeneity in MR images ,we add the intensity inhomogeneity correction step which is based on fuzzy c-means (FCM) algorithm before the segment procedure .Firstly , the real MR image data obtained after bias corrected by FCM algorithm .Secondly ,we segment the real MR image data by kernel graph cuts method .Experiments show that the kernel graph cuts method with intensity inhomogeneity correction have a better segment result in accuracy and over-segmentation .