3D interactive modeling with capturing instruction interface based on area limitation

The Smart House Planner is an AI-powered solution designed to simplify the process of residential home design by combining intelligent planning, 3D modelling, and real-time cost estimation through an interactive conversational interface. With the rising demand for personalized housing solutions and the complexity of balancing aesthetics, functionality, and budget, there is a growing need for systems that can automate architectural planning while remaining user-friendly. This project addresses that challenge by integrating Gemini AI for intelligent design recommendations, Blender for automated 3D visualization, and a cost estimation engine for transparent financial planning. The system enables users to specify requirements such as housing type (1BHK, 2BHK, 3BHK, Duplex, Villa), dimensions, and style preferences via a modern Django-based web interface. Gemini AI processes these inputs to generate optimized layouts by considering space utilization, and functional flow. These layouts are then transformed into realistic, interactive 3D models using Blender, allowing users to explore their prospective homes virtually. Simultaneously, the cost estimation module calculates material, labour, costs, producing downloadable reports that support informed decision-making and budget control. By unifying AI-driven design intelligence, real-time 3D modelling, and detailed cost breakdowns, Smart House Planner provides a comprehensive platform that enhances user engagement, reduces reliance on professional intervention, and democratizes access to architectural planning. This solution demonstrates how AI, visualization technologies, and web-based interfaces can transform the way individuals approach housing design, making the process more efficient, transparent, and accessible to both professionals and non-experts.

Image-based 3D shape reconstruction is essential for 3D modeling in recognition, virtual reality, generation of video games, 3D animation, and in the creation of 3D virtual fitting rooms - the sought-after application in this dissertation. In this work, we propose a novel reconstruction method that uses a generic 3D model that roughly controls the overall reconstruction shape which in turn, reduces the number of 2D images needed to just two (frontal and profile) for obtaining a 3D point model. The generic model consists of a massive set of 3D points that lack saliency, topological meaning, and relational interconnections. This is also true about points in the two canonical images. In this work, we propose finding a small set of interconnected ordered intrinsic salient points (control points) residing on the silhouette of the projections of the generic model onto the two image spaces, as well as finding those for the canonical images. Points on the generic model and the images are automatically given saliency with order and interconnections through loop-subdivision operating on those control points and their equivalent points on the canonical images. The transformation of the generic model into the specific object is done through morphing the points on the generic model to follow and be consistent with their equivalent points on the canonical images. The control points on the canonical images are automatically obtained using an active shape model (ASM) that modifies an average trained control point set attained using an offline training, to account for class shape variability and boundary regularization guaranteeing the control points to reside on the silhouette (boundary) of the individual. The reconstructed 3D model is furtherly refined through smoothing the reconstructed surface, while fixing local holes using a principle component analysis (PCA) decomposition. This reconstruction method is convenient, simple, efficient, and results in an average geometric error of less than 0.5% over 700 diverse body models from the CAESAR dataset. We then implement the contour-based articulated model to the personalized 3D model for pose recovery. The evolution of the model through the articulation process is captured in a video clip. 3D transformations are found and applied to the 3D model on its parts so that the projections of the 3D model 'match' those observed in the video sequence at corresponding frames. This is done by minimizing the error between the frontal projection body region points and the target points from the image for each independent moving part, with sub-resolution recovery errors. Once the personalized 3D model is obtained and the articulated model is implemented, the algorithm simulates how garments virtually appear on the reconstructed person under different poses. Different types of clothes are classified as tight or loose, where for the first type of garments, the garment is mapped onto the person's body, whereas for the second type, the mapping adjusts to accommodate the loose nature of the garment, and its fitting on the body of the reconstructed person model. This creates a virtual in-home fitting room for garment fitting, which is timely and is a needed application that would go hand in hand with online clothes shopping, allowing the trying of garments at home with changing poses before ordering them, and can be updated as often as necessary to accommodate changes in physique, weight, aging, etc. This is also done with minimum requirements from the user aside from taking two images and a video of pose articulations using their cam or smart phone, and stands as a useful, needed, and attractive App.

Mechanical circulatory support emerged for the pediatric population in the late 1980s as a bridge to cardiac transplantation. The Total Artificial Heart (TAH-t) (SynCardia Systems Inc., Tuscon, AZ) has been approved for compassionate use by the Food and Drug Administration for patients with end-stage biventricular heart failure as a bridge to heart transplantation since 1985 and has had FDA approval since 2004. However, of the 1,061 patients placed on the TAH-t, only 21 (2%) were under the age 18. SynCardia Systems, Inc. recommends a minimum patient body surface area (BSA) of 1.7 m(2), thus, limiting pediatric application of this device. This unique case report shares this pediatric institution's first experience with the TAH-t. A 14-year-old male was admitted with dilated cardiomyopathy and severe biventricular heart failure. The patient rapidly decompensated, requiring extracorporeal life support. An echocardiogram revealed severe biventricular dysfunction and diffuse clot formation in the left ventricle and outflow tract. The decision was made to transition to biventricular assist device. The biventricular failure and clot formation helped guide the team to the TAH-t, in spite of a BSA (1.5 m(2)) below the recommendation of 1.7 m(2). A computed tomography (CT) scan of the thorax, in conjunction with a novel three-dimensional (3D) modeling system and team, assisted in determining appropriate fit. Chest CT and 3D modeling following implantation were utilized to determine all major vascular structures were unobstructed and the bronchi were open. The virtual 3D model confirmed appropriate device fit with no evidence of compression to the left pulmonary veins. The postoperative course was complicated by a left lung opacification. The left lung anomalies proved to be atelectasis and improved with aggressive recruitment maneuvers. The patient was supported for 11 days prior to transplantation. Chest CT and 3D modeling were crucial in assessing whether the device would fit, as well as postoperative complications in this smaller pediatric patient.

Heritage structures are important for tourism and for learning about nations’ history. Historical sites around the world are in damaged conditions due to various factors from the environment, man-made activities or natural calamities. To ensure safety and avoid further deterioration, digital re- construction of heritage sites can be used to create 3D virtual models of these structures for archiving and for inspection purpose. This paper presents a technique to reconstruct a high-quality image-based 3D model of a heritage structure. An exemplar-based inpainting algorithm was used for removing deformable obstacles such as trees in 2D images since such obstacles are unwanted in a final 3D model. They also create noise in the 3D modeling process, which makes the final 3D model less accurate. In this paper, an inpainting algorithm is applied to generate implied texture to fill holes that occurred from removing objects so that the generated 3D model does not contain any hole and becomes watertight. The modified exemplar-based inpainting algorithm was implemented on 2D images to remove unwanted objects, and then the image-based 3D modeling technique was applied to create a 3D model that did not contain any unwanted objects. The results show that the final 3D model is more accurate when applied the object removal process and the model provides better visualization for heritage structures.

In this paper we present a method for sharing interactive and dynamic 3D models that are collaboration-unaware, i.e., models that have not been designed to be used by multiple users at the same time. This functionality is an essential requirement for the inclusion of arbitrary 3D models, as generated by standard CAD or animation software, into teleconferencing sessions. A key aim of this work is to show that a large part of the required functionality can be developed in a way so that it is reusable for other applications such as shared whiteboards or networked computer games. Our method therefore consists of both an application dependent part that handles the specific tasks required for sharing 3D models, and of a number of generic services such as synchronization, scalable support for latecomers, and the ability to record and replay sessions. The generic services are based on an abstract media model and the RTP/I application level protocol for distributed interactive media. Any other application for a medium that shares this model and that uses RTP/I may reuse these generic services. We have implemented a prototype called TeCo3D demonstrating the feasibility of our approach.

Augmented Reality (AR) has emerged as a transformative technology with significant potential to enhance educational experiences. This Review provides an overview of recent advancements in the integration of Augmented Reality in education, exploring its applications, benefits, and challenges. Recent years have witnessed a growing interest in leveraging Augmented Reality to revolutionize traditional education methods. AR involves overlaying digital content onto the real-world environment, creating an interactive and immersive learning experience. This review explores the various ways in which AR is being applied in education, spanning diverse subjects and educational levels. Advancements in AR have introduced interactive textbooks, 3D models, and simulations, providing students with a more engaging and dynamic learning environment. AR-enhanced textbooks, for instance, can bring static images to life, offering interactive elements that deepen understanding and retention of complex concepts. Moreover, the use of AR in science, mathematics, and other STEM (Science, Technology, Engineering, and Mathematics) subjects has gained traction. Virtual experiments, interactive simulations, and 3D visualizations enable students to explore Review concepts in a hands-on manner, fostering a deeper comprehension of the subject matter. The benefits of integrating AR in education extend beyond traditional classroom settings. Remote and online learning platforms can leverage AR to create immersive virtual classrooms, allowing students to interact with digital content collaboratively. This can enhance the sense of presence and engagement in virtual learning environments. However, challenges such as the cost of implementing AR technology, access to compatible devices, and concerns about privacy and security must be addressed. Additionally, the need for teacher training in incorporating AR tools into pedagogy is crucial for successful integration. In conclusion, the integration of Augmented Reality in education represents a promising avenue for transforming the learning experience. Recent advancements demonstrate the potential of AR to make education more interactive, engaging, and accessible. As the technology continues to evolve, addressing challenges and promoting effective teacher training will be key to realizing the full benefits of AR in education.

One might wonder what can be gained from the image-laser fusion and in which measuresuch a hybrid system can generate automatically complete and photorealist 3D models ofdifficult to access and unstructured underground environments.Our research work is focused on developing a vision-based system aimed at automaticallygenerating in-situ photorealist 3D models in previously unknown and unstructuredunderground environments from image and laser data. In particular we are interested inmodeling underground prehistoric caves. In such environments, special attention must begiven to the main issue standing behind the automation of the 3D modeling pipeline whichis represented by the capacity to match reliably image and laser data in GPS-denied andfeature-less areas. In addition, time and in-situ access constraints require fast and automaticprocedures for in-situ data acquisition, processing and interpretation in order to allow forin-situ verification of the 3D scene model completeness. Finally, the currently generated 3Dmodel represents the only available information providing situational awareness based onwhich autonomous behavior must be built in order to enable the system to act intelligentlyon-the-fly and explore the environment to ensure the 3D scene model completeness.This chapter evaluates the potential of a hybrid image-laser system for generating in-situcomplete and photorealist 3D models of challenging environments, while minimizing humanoperator intervention. The presented research focuses on two main aspects: (i) the automationof the 3D modeling pipeline, targeting the automatic data matching in feature-less andGPS-denied areas for in-situ world modeling and (ii) the exploitation of the generated 3Dmodels along with visual servoing procedures to ensure automatically the 3D scene modelcompleteness.We start this chapter by motivating the jointly use of laser and image data and by listing themain key issues which need to be addressed when aiming to supply automatic photorealist3D modeling tasks while coping with time and in-situ access constraints. The next foursections are dedicated to a gradual description of the 3D modeling system in which we projectthe proposed image-laser solutions designed to be embedded onboard mobile plateforms,providing them with world modeling capabilities and thus visual perception. This is an

This chapter deals with four exemplary methods of virtual skull implants modeling. These methods combine simultaneous usage of three modeling systems: reverse engineering system, surface modeling system, and haptic modeling system, and their characteristic modeling methods and techniques. Using three different modeling systems, the authors obtain a synergy effect of the implant shape and model quality increasing. The target virtual model of the implant is always well suited to the coastline of bone lack in the skull. Additionally, time of the virtual model developed is very short compared to use of only one of the standard engineering CAx systems. The chapter describes four original methods developed by the author.

Abstract. Nowadays, in light of the latest development in three-dimensional (3D) modeling technology, an essential role is given to the research and development of fully-automated or semi-automated processes in order to increase workflow effectiveness. A key challenge is thus to automate the process leading to the geometric model which supports the Building Information Modeling (BIM) or 3D-Geographical Information Systems (3D-GIS). This 3D model usually originates from image-based or range-based point clouds. This research is the beginning of the development of a 3D modeling approach that is semi-automatic, and possibly fully-automatic, by combining polygon surface fitting (polyfit) technique and monoscopic multi-image measurement system. With the advent of dense matching and Structure from Motion methods (SfM), point clouds can be generated from multiple images obtained from digital cameras. Then, to reduce the data and to allow for efficient processing, it is necessary to extract polygonal surface data from point clouds delivered by the dense matching process. The polygonal surface is then used for the basis of further manual monoscopic measurements which are achieved separately on each image to obtain more detailed 3D model. Next, this approach analyzed the polygonal surface deformations in comparison to the initial point cloud data. It can be seen how the resolution and noise of the original point clouds affect the subsequent Polyfit-based modeling and monoscopic measurements. The deformations and the accuracy evaluation have been undertaken using different open source software. Also, the geometric error in the polyfit-derived polyhedral reconstruction propagating to the subsequent monoscopic-derived measurements was evaluated. Finally, our modeling approach shows that it can improve the processing speed and level of detail of the 3D models achieved using existing monoscopic measurements. Typically geometric accuracy itself doesn’t have enough information to make accurate geometry model.

Interactive 3D modeling in VR is both aided by immersive 3D input and hampered by model disjunct, tool-based or selection-action user interfaces. We propose a direct, signifier-based approach to the popular interactive technique of creating 3D models through a sequence of extrusion operations. Motivated by handles and signifiers that communicate the affordances of everyday objects, we define a set of design principles for an immersive, signifier-based modeling interface. We then present an interactive 3D modeling system where all modeling affordances are modelessly reachable and signified on the model itself.

The development of 3D technology allows the digitisation of cultural heritage objects. Despite the fact that 3D scanning technology is not fully developed, it offers great opportunities for recording spatial data. Three-dimensional digital recording can be made for museum exhibits as well as for historic architectural objects. The method used is a non-invasive (non-contact) method, which is a significant advantage when working with historic buildings. The use of 3D scanners makes it possible to reduce the risk of damage to the monument. The application of a safe method of 3D scanning facilitates digital archiving of objects, which gives many possibilities of their use. One of them is digital dissemination of three-dimensional models and even making replicas using 3D printing technology. These types of models make it possible to reach a wide audience. First of all, they provide access to monuments for people with special needs, who currently constitute over a dozen percent of the population. In particular, they are the elderly, sick or people with various types of disabilities, e.g. motionally or visually impaired people. Literature analysis as well as conversations with dysfunctional people show that 3D digitisation of cultural heritage objects is needed and expected. The article presents an example of the use of modern 3D technologies for the dissemination of cultural heritage on the example of objects from the area of the Silk Road. A two-track process of making small museum artefacts available is presented. The first track concerns making objects available in the form of interactive digital 3D models placed on websites. The second one uses real models printed in 3D technology, which can be made available to visually impaired people. The work discusses the course of joint activities to prepare these 3D models and specialised activities that are necessary to make both versions of 3D models for presentation on the web and for kinaesthetic cognition, i.e. by touch. The authors’ actions resulted in the preparation of 3D models of historic vessels from the turn of the 11th/12th centuries from the ancient city of Afrasiyab – a suburb of modern Samarkand in Uzbekistan.

The visual hull is used to 3D object modeling in real-time. In this paper, we propose a novel method to remove phantom volumes produced in the polyhedral visual hull (PVH) construction. This method calculates the visual hull by using polygon intersection. By making full use of the information PVH supplied for image planes, we finally obtain the safe polyhedral visual hull (SPVH). Unlike the method based image method, according to the construction process of the PVH, this paper presents a fast ray-volume intersection based on geometry method. Experiment results show that, without adding more cameras, this method can provide view-independent SPVH model with phantom volumes removed, which can be used in the 3D modeling and interactive system.

3D modeling of buildings is an important method in mapping and modeling the built environment. In this study, we analyzed the differences between the semantic state of actual buildings and 3D models of LoD3 buildings generated using aerial and terrestrial photogrammetric methods. We also evaluated the accuracy of the visual representation as well as the suitability of the building geometry and texture. Our method involves collecting aerial and terrestrial photographic data and processing it using SFM (structure from motion) technology. The photogrammetric data was then processed using image matching algorithms and 3D reconstruction techniques to generate 3D models of LoD3 buildings. The actual semantic state of the building was identified through field surveys and reference data collection. The 3D building model was successfully modeled from 1201 photos and 19 ground control points. The results of the evaluation of the geometry accuracy test, dimensions and semantic completeness of the 3D model, the use of aerial photographs and terrestrial photogrammetry in LoD3 3D modeling are assessed from the results of the automatic 3D modeling process using SfM (Structure from Motion) technology that produces 3D building models in Level of Detail (LoD) 3 with Root Mean Square Error values <0.5 meters and has semantic completeness of the building in accordance with the original object based on the City Geography Markup Language (CityGML) standard. The facade formed from the modeling almost follows the original model such as doors, windows, hallways, etc.

Growing evidence propagates those alternative technologies (relevant human cell-based—e.g., organ-on-chips or biofabricated models—or artificial intelligence-combined technologies) that could help in vitro test and predict human response and toxicity in medical research more accurately. In vitro disease model developments have great efforts to create and serve the need of reducing and replacing animal experiments and establishing human cell-based in vitro test systems for research use, innovations, and drug tests. We need human cell-based test systems for disease models and experimental cancer research; therefore, in vitro three-dimensional (3D) models have a renaissance, and the rediscovery and development of these technologies are growing ever faster. This recent paper summarises the early history of cell biology/cellular pathology, cell-, tissue culturing, and cancer research models. In addition, we highlight the results of the increasing use of 3D model systems and the 3D bioprinted/biofabricated model developments. Moreover, we present our newly established 3D bioprinted luminal B type breast cancer model system, and the advantages of in vitro 3D models, especially the bioprinted ones. Based on our results and the reviewed developments of in vitro breast cancer models, the heterogeneity and the real in vivo situation of cancer tissues can be represented better by using 3D bioprinted, biofabricated models. However, standardising the 3D bioprinting methods is necessary for future applications in different high-throughput drug tests and patient-derived tumour models. Applying these standardised new models can lead to the point that cancer drug developments will be more successful, efficient, and consequently cost-effective in the near future.

Chapter 25 - 3D modeling of the lung in health and disease