Rapid femur modeling method based on statistical shape model

Clinical relevance of augmented statistical shape model of the scapula in the glenoid region

Facial disfigurement may affect the quality of life of many patients. Facial prostheses are often used as an adjuvant to surgical intervention and may sometimes be the only viable treatment option. Traditional methods for designing soft-tissue facial prostheses are time-consuming and subjective, while existing digital techniques are based on mirroring of contralateral features of the patient, or the use of existing feature templates/models that may not be readily available. We aim to support the objective and semi-automated design of facial prostheses with primary application to midline or bilateral defect restoration where no contralateral features are present. Specifically, we developed and validated a statistical shape model (SSM) for estimating the shape of missing facial soft tissue segments, from any intact parts of the face. An SSM of 3D facial variations was built from meshes extracted from computed tomography and cone beam computed tomography images of a black South African sample (n = 235) without facial disfigurement. Various types of facial defects were simulated, and the missing parts were estimated automatically by a weighted fit of each mesh to the SSM. The estimated regions were compared to the original regions using color maps and root-mean-square (RMS) distances. Root mean square errors (RMSE) for defect estimations of one orbit, partial nose, cheek, and lip were all below 1.71mm. Errors for the full nose, bi-orbital defects, as well as small and large composite defects were between 2.10 and 2.58mm. Statistically significant associations of age and type of defect with RMSE were observed, but not with sex or imaging modality. This method can support the objective and semi-automated design of facial prostheses, specifically for defects in the midline, crossing the midline or bilateral defects, by facilitating time-consuming and skill-dependent aspects of prosthesis design.

Background:The accuracy of three-dimensional (3D) reconstructions from cone-beam computed tomography (CBCT) has been particularly important in dentistry, which will affect the effectiveness of diagnosis, treatment plan, and outcome in clinical practice. The aims of this study were to assess the linear, volumetric, and geometric accuracy of 3D reconstructions from CBCT and to investigate the influence of voxel size and CBCT system on the reconstructions results.Methods:Fifty teeth from 18 orthodontic patients were assigned to three groups as NewTom VG 0.15 mm group (NewTom VG; voxel size: 0.15 mm; n = 17), NewTom VG 0.30 mm group (NewTom VG; voxel size: 0.30 mm; n = 16), and VATECH DCTPRO 0.30 mm group (VATECH DCTPRO; voxel size: 0.30 mm; n = 17). The 3D reconstruction models of the teeth were segmented from CBCT data manually using Mimics 18.0 (Materialise Dental, Leuven, Belgium), and the extracted teeth were scanned by 3Shape optical scanner (3Shape A/S, Denmark). Linear and volumetric deviations were separately assessed by comparing the length and volume of the 3D reconstruction model with physical measurement by paired t-test. Geometric deviations were assessed by the root mean square value of the imposed 3D reconstruction and optical models by one-sample t-test. To assess the influence of voxel size and CBCT system on 3D reconstruction, analysis of variance (ANOVA) was used (α = 0.05).Results:The linear, volumetric, and geometric deviations were −0.03 ± 0.48 mm, −5.4 ± 2.8%, and 0.117 ± 0.018 mm for NewTom VG 0.15 mm group; −0.45 ± 0.42 mm, −4.5 ± 3.4%, and 0.116 ± 0.014 mm for NewTom VG 0.30 mm group; and −0.93 ± 0.40 mm, −4.8 ± 5.1%, and 0.194 ± 0.117 mm for VATECH DCTPRO 0.30 mm group, respectively. There were statistically significant differences between groups in terms of linear measurement (P < 0.001), but no significant difference in terms of volumetric measurement (P = 0.774). No statistically significant difference were found on geometric measurement between NewTom VG 0.15 mm and NewTom VG 0.30 mm groups (P = 0.999) while a significant difference was found between VATECH DCTPRO 0.30 mm and NewTom VG 0.30 mm groups (P = 0.006).Conclusions:The 3D reconstruction from CBCT data can achieve a high linear, volumetric, and geometric accuracy. Increasing voxel resolution from 0.30 to 0.15 mm does not result in increased accuracy of 3D tooth reconstruction while different systems can affect the accuracy.

Poster 139: Utilization of 3D Statistical Shape Modeling of Anatomic Variation Across a Cohort of Patella Instability Patients

Patient-specific biomechanical simulations of joints require accurate reconstruction of bony anatomy from medical image data. The articular geometries of the joints may influence their biomechanics. Statistical shape models (SSMs) have become ubiquitous in the literature and aim to capture the natural variation of biological objects. They work by learning the variation from training examples to define the space of valid biological shapes. However, the kinematic information descriptive of the anato-physiological relationship of two interacting objects is not generally encoded in the SSM. Here, we propose a framework for developing combined statistical shape and kinematics models (SSKMs) as Gaussian process morphable models to analyse the shape and kinematics relationship. We demonstrate the framework on a three-dimensional (3D) image data set consisting of ten right-handed cadaveric shoulder joints acquired using computed tomography. Additionally, we simulate specific bone motions to encode kinematics in the combined model. Our SSKM built from shoulder data (matching scapulae and humeri) correctly depicts a correlation between the shape and kinematics as hypothesized. We furthermore demonstrate the ability to marginalize from the SSKM to obtain shape-only variation and kinematics-only variation. Future work aims to use the SSKM framework to understand the relationships between kinematics and shape for various joints as well as to develop patient-specific computational models to evaluate joint biomechanics.

ObjectivesThe primary objective was to determine which of the following angular insertion depth (AID) estimation methods showed the strongest correlation with the postoperative AID (AIDpostop) of a lateral wall (LW) electrode: the Escudé formula, based on the largest distance from the round window (RW) to the LW (distance A); the elliptic-circular approximation (ECA) method, based on both distance A and the perpendicular distance (distance B); and a three-dimensional (3D) reconstruction method. The secondary objective was to assess the impact of using the actual electrode insertion length on the evaluation of AID estimation methods.MethodsThis study included 45 cochleae implanted with the Advanced Bionics SlimJ electrode, with all 16 active electrode contacts positioned intracochlear. Distance A, distance B, and a 3D reconstruction along the LW were evaluated on preoperative magnetic resonance imaging using 3D Slicer. The AIDpostop and insertion length were assessed using cone-beam computed tomography. Two sets of estimated AID values were obtained: assuming a perfect 23-mm insertion length with the reference electrode at the RW (AID23mm); and using the actual insertion length (AIDinsertionlength). Spearman’s rank correlation coefficient was used to assess the association between the estimated AID values and AIDpostop.ResultsA moderately positive correlation was observed between AID23mm and AIDpostop for all three approaches, with no statistically significant differences among them (rs=0.410–0.579). When the analysis was repeated using AIDinsertionlength, the strength of the correlation with AIDpostop increased significantly for all three methods, with the 3D reconstruction method showing a stronger correlation (rs=0.952) than the Escudé formula (rs=0.734) or the ECA method (rs=0.787) (P<0.001).ConclusionThe 3D reconstruction approach has the potential to improve prediction of the AID for LW electrode arrays compared to spiral formulae based on 2D cochlear dimensions. Accurate assessment of the actual insertion length is important for the proper evaluation of AID estimation methods.

Three-dimensional (3D) reconstruction technology has found widespread applications across various domains, including intelligent driving and underwater exploration. But the existing imaging systems and methods still have deficiencies in terms of reconstruction accuracy, detection distance and system volume. Herein, this paper presents a three-dimensional detection and reconstruction method based on a compact Risley-prism 3D imaging system that achieves multi-viewpoint imaging by rotating the Risley prism to adjust the camera's optical axis. A refractive camera model that integrates the pinhole camera model with the vector form of Snell's law is established to precisely describe beam trajectory. A forward projection method suitable for refractive interfaces is developed based on Fermat's principle, and the influence of systematic errors on the reconstruction is analyzed in detail through simulation. Furthermore, a new 3D reconstruction method combining error calibration based on the optimization iteration is introduced to avoid the influence of error and improve reconstruction quality. Experimental results demonstrate that the proposed approach markedly enhances 3D reconstruction accuracy, reducing the Normalized Root Mean Square Error (NRMSE) from 0.9076 to 0.0207.

IntroductionVideo urodynamic studies (VUDS) use fluoroscopic imaging to visualize the bladder and multichannel urodynamics to assess its function. Qualitative assessment of bladder shape is used to identify abnormal features (e.g., diverticula) that correspond with pathophysiology; however, this assessment is limited in its ability to predict bladder function. Therefore, we developed a novel quantitative approach to assess bladder shape obtained from fluoroscopic VUDS images utilizing statistical shape modeling. This method was compared to existing binary and continuous shape quantification methods and used to identify relationships between bladder shape and measures of bladder physiology categorized as related to sensation, incontinence, or emptying.MethodsThis was a retrospective, cross-sectional study of 49 participants. Bladder walls were segmented from fluoroscopic images at rest with the bladder filled to approximately 300 mL. Bladder shape was evaluated in three ways: 1) binary categorization as typical or atypical based on clinical assessment, 2) quantification of height-to-width ratios, and 3) quantification by statistical shape modeling. Independent t-tests and correlations were used to assess associations between the three shape evaluation methods and to define relationships between shape and physiologic measures: 3 volumetric measures describing sensation, 2 dichotomous variables addressing incontinence, and 1 volumetric measure representing emptying.ResultsThe statistical shape model generated 5 modes of variation. Mode 1 corresponded with height-to-width ratio (r=0.920, p&amp;lt;0.001), modes 2 and 3 with diagonal height-to-width ratio (r=0.66 and -0.585, p&amp;lt;0.001 and &amp;lt;0.001), and mode 3 with binary shape categorization (p&amp;lt;0.001). In terms of function, those with atypical bladder shape had impaired emptying (p=0.010), modes 4 and 5 were significantly associated with measures of bladder sensation, mode 3 with urodynamic stress urinary incontinence, and mode 3 with emptying in those able to void (r=0.368, p=0.021). The relationship between mode 3 and emptying across all patients is best fitted by a quadratic function (p&amp;lt;0.001).DiscussionOur results demonstrate that binary shape categorization and bladder shape quantified by statistical shape modeling correspond with measures of bladder physiology. This foundational study establishes statistical shape modeling as a robust bladder shape quantification method that can be used to relate bladder shape with physiology.

Unmanned aerial vehicle remote sensing images are easy to acquire and cost-effective. Their application provides a new approach for the maintenance of offshore wind farms. To obtain an accurate model of wind turbines, thereby improving detection efficiency and mitigating the risks associated with high-altitude workings, a low-cost method for wind turbine three-dimensional (3D) reconstruction is proposed. The main advantages of deep learning-based Multi-View Stereo Network (MVSNet) include high accuracy, fast processing speed, and ease of extension to multiple viewpoints. Most networks utilize multi-scale 3D Convolutional Neural Network (CNN) for regularization. However, when dealing with images that have high depth and resolution, CNN regularization strategy leads to a significant increase in memory usage. In this paper, the two-dimensional cost maps are regularized along the depth dimension sequentially using Stacked Convolutional Gated Recurrent Unit (Stacked Conv-GRU), instead of reducing the 3D cost volume all at once. Localized convolution operations replace undifferentiated fully connected operations, substantially reducing memory consumption and enabling high-resolution reconstruction. We conduct comparisons and model evaluations on the ”Nordtank” wind turbine remote sensing image dataset. Experimental results demonstrate that, compared to other 3D reconstruction methods, Stacked Conv-GRU regularized MVSNet reduces run time and hardware requirements while maintaining similar accuracy.

This paper describes a new method of non-rigid registration using the combined power of elastic and statistical shape models. The transformations are constrained to be consistent with a physical model of elasticity to maintain smoothness and continuity. A Bayesian formulation, based on this model, on an intensity similarity measure, and on statistical shape information embedded in corresponding boundary points, is employed to find a more accurate and robust non-rigid registration. A dense set of forces arises from the intensity similarity measure to accommodate complex anatomical details. A sparse set of forces constrains consistency with statistical shape models derived from a training set. A number of experiments were performed on both synthetic and real medical images of the brain and heart to evaluate the approach. It is shown that statistical boundary shape information significantly augments and improves elastic model based non-rigid registration.KeywordsControl PointBoundary PointElastic ModelSynthetic ImageShape InformationThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Prostate gland segmentation is a critical step in prostate radiotherapy planning, where dose plans are typically formulated on CT. Pretreatment MRI is now beginning to be acquired at several medical centers. Delineation of the prostate on MRI is acknowledged as being significantly simpler to perform, compared to delineation on CT. In this work, the authors present a novel framework for building a linked statistical shape model (LSSM), a statistical shape model (SSM) that links the shape variation of a structure of interest (SOI) across multiple imaging modalities. This framework is particularly relevant in scenarios where accurate boundary delineations of the SOI on one of the modalities may not be readily available, or difficult to obtain, for training a SSM. In this work the authors apply the LSSM in the context of multimodal prostate segmentation for radiotherapy planning, where the prostate is concurrently segmented on MRI and CT. The framework comprises a number of logically connected steps. The first step utilizes multimodal registration of MRI and CT to map 2D boundary delineations of the prostate from MRI onto corresponding CT images, for a set of training studies. Hence, the scheme obviates the need for expert delineations of the gland on CT for explicitly constructing a SSM for prostate segmentation on CT. The delineations of the prostate gland on MRI and CT allows for 3D reconstruction of the prostate shape which facilitates the building of the LSSM. In order to perform concurrent prostate MRI and CT segmentation using the LSSM, the authors employ a region-based level set approach where the authors deform the evolving prostate boundary to simultaneously fit to MRI and CT images in which voxels are classified to be either part of the prostate or outside the prostate. The classification is facilitated by using a combination of MRI-CT probabilistic spatial atlases and a random forest classifier, driven by gradient and Haar features. The authors acquire a total of 20 MRI-CT patient studies and use the leave-one-out strategy to train and evaluate four different LSSMs. First, a fusion-based LSSM (fLSSM) is built using expert ground truth delineations of the prostate on MRI alone, where the ground truth for the gland on CT is obtained via coregistration of the corresponding MRI and CT slices. The authors compare the fLSSM against another LSSM (xLSSM), where expert delineations of the gland on both MRI and CT are employed in the model building; xLSSM representing the idealized LSSM. The authors also compare the fLSSM against an exclusive CT-based SSM (ctSSM), built from expert delineations of the gland on CT alone. In addition, two LSSMs trained using trainee delineations (tLSSM) on CT are compared with the fLSSM. The results indicate that the xLSSM, tLSSMs, and the fLSSM perform equivalently, all of them out-performing the ctSSM. The fLSSM provides an accurate alternative to SSMs that require careful expert delineations of the SOI that may be difficult or laborious to obtain. Additionally, the fLSSM has the added benefit of providing concurrent segmentations of the SOI on multiple imaging modalities.

To develop a patient-specific 3 D reconstruction of a femur modeled using the statistical shape model (SSM) and X-ray images, it is assumed that the target shape is not outside the range of variations allowed by the SSM built from a training dataset. We propose the shape-partitioned statistical shape model (SPSSM) to cover significant variations in the target shape. This model can divide a shape into several segments of anatomical interest. We break up the eigenvector matrix into the corresponding representative matrices for the SPSSM by preserving the relevant rows of the original matrix without segmenting the shape and building an independent SSM for each segment. To quantify the reconstruction error of the proposed method, we generated two groups of deformation models of the femur which cannot be easily represented by the conventional SSM. One group of femurs had an anteversion angle deformation, and the other group of femurs had two different scales of the femoral head. Each experiment was performed using the leave-one-out method for twelve femurs. When the femoral head was rotated by 30°, the average reconstruction error of the conventional SSM was 5.34 mm, which was reduced to 3.82 mm for the proposed SPSSM. When the femoral head size was decreased by 20%, the average reconstruction error of the SSM was 4.70 mm, which was reduced to 3.56 mm for the SPSSM. When the femoral head size was increased by 20%, the average reconstruction error of the SSM was 4.28 mm, which was reduced to 3.10 mm for the SPSSM. The experimental results for the two groups of deformation models showed that the proposed SPSSM outperformed the conventional SSM.

Real-time three-dimensional (3D) reconstruction of real-world environments has many significant applications in various fields, including telepresence technology. When depth sensors, such as those from Microsoft's Kinect series, are introduced simultaneously and become widely available, a new generation of telepresence systems can be developed by combining a real-time 3D reconstruction method with these new technologies. This combination enables users to engage with a remote person while remaining in their local area, as well as control remote devices while viewing their 3D virtual representation. There are numerous applications in which having a telepresence experience could be beneficial, including remote collaboration and entertainment, as well as education, advertising, and rehabilitation. The purpose of this systematic literature review is to analyze the recent advances in 3D reconstruction methods for telepresence systems and the significant related work in this field. Next, we determine the input data and the technological device employed to acquire the input data, which will be utilized in the 3D reconstruction process. The methods of 3D reconstruction implemented in the telepresence system as well as the evaluation of the system, have been extracted and assessed from the included studies. Through the analysis and summarization of many dimensions, we discussed the input data used for the 3D reconstruction method, the real-time 3D reconstruction methods implemented in the telepresence system, and how to evaluate the system. We conclude that real-time 3D reconstruction methods for telepresence systems have progressively improved over the years in conjunction with the advancement of machines and devices such as Red Green Blue-Depth (RGB-D) cameras and Graphics Processing Unit (GPU).

Statistical shape modeling (SSM) is an essential tool for analyzing variations in anatomical morphology. In a typical SSM pipeline, 3D anatomical images, gone through segmentation and rigid registration, are represented using lower-dimensional shape features, on which statistical analysis can be performed. Various methods for constructing compact shape representations have been proposed, but they involve laborious and costly steps. We propose Image2SSM, a novel deep-learning-based approach for SSM that leverages image-segmentation pairs to learn a radial-basis-function (RBF)-based representation of shapes directly from images. This RBF-based shape representation offers a rich self-supervised signal for the network to estimate a continuous, yet compact representation of the underlying surface that can adapt to complex geometries in a data-driven manner. Image2SSM can characterize populations of biological structures of interest by constructing statistical landmark-based shape models of ensembles of anatomical shapes while requiring minimal parameter tuning and no user assistance. Once trained, Image2SSM can be used to infer low-dimensional shape representations from new unsegmented images, paving the way toward scalable approaches for SSM, especially when dealing with large cohorts. Experiments on synthetic and real datasets show the efficacy of the proposed method compared to the state-of-art correspondence-based method for SSM.

Abstract. The current methods of non-contact livestock body measurement directly deal with the low-quality point cloud data of livestock, which have low robustness and lack practicality. On the one hand, the success rate of keypoint detection for livestock body measurement is low. Due to the severe occlusion and noise in the point cloud data, body measurements of some data cannot be performed. On the other hand, the key frames need to be manually selected from the point cloud sequence during processing. Inspired by the work of 3D reconstruction based on animal statistical shape models, we implement the construction and learning of the statistical shape model of real cattle. Given the establishment of the statistical shape model of cattle, a 3D reconstruction and body measurement approach of real cattle based on low-quality point cloud data is proposed. Nine indicators are calculated and the overall estimation MAPE (Mean Absolute Percentage Error) is 10.27%. The whole process of the body measurement algorithm proposed in our paper can be extended to other quadrupeds.