Stereo music visualization through manifold harmonics

We present an explicit method to compute a generalization of the Fourier Transform on a mesh. It is well known that the eigenfunctions of the Laplace Beltrami operator (Manifold Harmonics) define a function basis allowing for such a transform. However, computing even just a few eigenvectors is out of reach for meshes with more than a few thousand vertices, and storing these eigenvectors is prohibitive for large meshes. To overcome these limitations, we propose a band‐by‐band spectrum computation algorithm and an out‐of‐core implementation that can compute thousands of eigenvectors for meshes with up to a million vertices. We also propose a limited‐memory filtering algorithm, that does not need to store the eigenvectors. Using this latter algorithm, specific frequency bands can be filtered, without needing to compute the entire spectrum. Finally, we demonstrate some applications of our method to interactive convolution geometry filtering. These technical achievements are supported by a solid yet simple theoretic framework based on Discrete Exterior Calculus (DEC). In particular, the issues of symmetry and discretization of the operator are considered with great care.

Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding

This research introduces a multi-view consistent 3D modeling method CoGSD Cosistent Gaussian Splatting Dreamer , this is construct 3D models rapidly with multi-view consistency through 3D Gaussian Splatting. 3D Gaussian Splatting generation fails to construct effective 3D assets due to the lack of stable ground truth. In addition, the expansion characteristics of 3D Gaussian Splatting itself lead to abnormal expansion of saturated Gaussian points and multi-view inconsistency problems. At the same time, the lack of credible ground truth will also lead to multi-view inconsistency problems. To solve this problem, we use a pre-trained consistent diffusion model to generate consistent viewpoints. In our framework, instead of generating diffusion with a single a priori perspective, the 2D image generation method of SDS uses a controlnet-tuned pre-trained model to generate 2D images with coherent viewpoints, resulting in high-quality 3D model generation. The method in this paper provides an effective solution for 3D modeling and is expected to be widely used in the field of 3D modeling and visual effects.

This paper describes an image segmentation and normalization technique using 3D point distribution model and its counterpart in 2D space. This segmentation is efficient to work for holistic image recognition algorithm. The results have been tested with face recognition application using Cohn Kanade Facial Expressions Database (CKFED). The approach follows by fitting a model to face image and registering it to a standard template. The models consist of distribution of points in 2D and 3D. We extract a set of feature vectors from normalized images using principal components analysis and using them for a binary decision tree for classification. A promising recognition rate of up to 98.75% has been achieved using 3D model and 92.93% using 2D model emphasizing the goodness of our normalization. The experiments have been performed on more than 3500 face images of the database. This algorithm is capable to work in real time in the presence of facial expressions.

The digitization of the complete shape of real objects has essential applications in fields of intelligent manufacturing, industrial detection, and reverse modeling. In order to build the full geometric models of rigid objects, the object must be moved relative to the measurement system (or the scanner must be moved relative to the object) to obtain and integrate views of the object from all sides, which not only complicates the system configuration but makes the whole process time-consuming. In this Letter, we present a high-resolution real-time 360° three-dimensional (3D) model reconstruction method that allows one to rotate an object manually and see a continuously updated 3D model during the scanning process. A multi-view fringe projection profilometry system acquires high-precision depth information about a handheld object from different perspectives and, meanwhile, the multiple views are aligned and merged together in real time. Our system employs stereo phase unwrapping and an adaptive depth constraint that can unwrap the phase of dense fringe images robustly without increasing the number of captured patterns. We then develop an efficient coarse-to-fine registration strategy to match the 3D surface segments rapidly. Our experiments demonstrate that our method can reconstruct the high-precision complete 3D model of complex objects under arbitrary rotation without any instrument assist and expensive pre/post-processing.

In this work, efficient human activity recognition (HAR) algorithm based on deep learning architecture is proposed to classify activities into seven different classes. In order to learn spatial and temporal features from only 3D skeleton data captured from a “Microsoft Kinect” camera, the proposed algorithm combines both convolution neural network (CNN) and long short-term memory (LSTM) architectures. This combination allows taking advantage of LSTM in modeling temporal data and of CNN in modeling spatial data. The captured skeleton sequences are used to create a specific dataset of interactive activities; these data are then transformed according to a view invariant and a symmetry criterion. To demonstrate the effectiveness of the developed algorithm, it has been tested on several public datasets and it has achieved and sometimes has overcome state-of-the-art performance. In order to verify the uncertainty of the proposed algorithm, some tools are provided and discussed to ensure its efficiency for continuous human action recognition in real time.

Microblogging services have become among the most popular services on the web in the last few years. This led to significant increase in data size, speed, and applications. This paper presents Venus ; a system that supports real-time spatial queries on microblogs. Venus supports its queries on a spatial boundary $R$ and a temporal boundary $T$ , from which only the top- $k$ microblogs are returned in the query answer based on a spatio-temporal ranking function. Supporting such queries requires Venus to digest hundreds of millions of real-time microblogs in main-memory with high rates, yet, it provides low query responses and efficient memory utilization. To this end, Venus employs: (1) an efficient in-memory spatio-temporal index that digests high rates of incoming microblogs in real time, (2) a scalable query processor that prune the search space, $R$ and $T$ , effectively to provide low query latency on millions of items in real time, and (3) a group of memory optimization techniques that provide system administrators with different options to save significant memory resources while keeping the query accuracy almost perfect. Venus memory optimization techniques make use of the local arrival rates of microblogs to smartly shed microblogs that are old enough not to contribute to any query answer. In addition, Venus can adaptively, in real time, adjust its load shedding based on both the spatial distribution and the parameters of incoming query loads. All Venus components can accommodate different spatial and temporal ranking functions that are able to capture the importance of each dimension differently depending on the applications requirements. Extensive experimental results based on real Twitter data and actual locations of Bing search queries show that Venus supports high arrival rates of up to 64 K microblogs/second and average query latency of 4 msec.

Enhanced external counterpulsation (EECP) is a noninvasive treatment method for coronary artery atherosclerosis that acts on the vascular endothelial cells. The intracoronary hemodynamic parameters that influence long-term treatment effect are the fundamental factors for the inhibition of intimal hyperplasia, which cannot be measured in real time. In order to optimize the long-term treatment effect of coronary heart disease, it is necessary to establish a method for quantified calculation of intracoronary hemodynamic parameters during counterpulsation to research the long-term hemodynamic mechanism of EECP. A geometric multiscale model coupled by the zero-dimensional (0D) lumped parameter model and the three-dimensional (3D) model of narrow coronary artery was established for the simulation of intracoronary hemodynamic environment. The 3D model was used to calculate the hemodynamic parameters such as wall shear stress (WSS) and oscillatory shear index (OSI), while the 0D model was used to simulate the blood circulatory system. Sequential pressure was applied to calves, thighs, and buttocks module in 0D model with the consideration of vessel collapse. Hemodynamic performance was compared with clinical reports to verify the effectiveness of the method. There were significant increases of the diastolic blood pressure (DBP), coronary flow, and the area-averaged WSS during application of EECP, while OSI behind stenosis has some decrease. The waveforms of coronary flow has good similarity with the clinical measured waveforms, and the differences between calculated mean arterial pressures (MAPs) and clinical measurements were within 1%. The fundamental factor in the cure of coronary heart disease by EECP is the improvement of WSS and the decrease of OSI. Comparing with the clinical reports, the immediate hemodynamic changes demonstrate the effectiveness of model. Intracoronary hemodynamic parameters during EECP could be acquired and the method could be used to simulate the long-term treatment effect of EECP. Graphical abstract.

In contrast to traditional 2D cell cultures, both 3D models and organ-on-a-chip devices allow the study of the physiological responses of human cells. These models reconstruct human tissues in conditions closely resembling the body. Translation of these techniques into practice is hindered by associated labor costs, a need which may be remedied by automation. Impedance spectroscopy (IS) is a promising, automation-compatible label-free technology allowing to carry out a wide range of measurements both in real-time and as endpoints. IS has been applied to both the barrier cultures and the 3D constructs. Here we provide an overview of the impedance-based analysis in different setups and discuss its utility for organ-on-a-chip devices. Most attractive features of impedance-based assays are their compatibility with high-throughput format and supports for the measurements in real time with high temporal resolution, which allow tracing of the kinetics. As of now, IS-based techniques are not free of limitations, including imperfect understanding of the parameters that have their effects on the impedance, especially in 3D cell models, and relatively high cost of the consumables. Moreover, as the theory of IS stems from electromagnetic theory and is quite complex, work on popularization and explanation of the method for experimental biologists is required. It is expected that overcoming these limitations will lead to eventual establishing IS based systems as a standard for automated management of cell-based experiments in both academic and industry environments.

This research paper provides a base for the development of an integrated strategy to identify and represent the existing territorial systems and ongoing trends in the municipality of Finiq, located in southern Albania. The study explores the features of the territorial ecosystem, to propose an integrated innovative development process through the digitization of the assets. The analysis moves from three main driver topics - “Landscape”, “Tradition” and “Tourism”, showing that the Municipality of Finiq has an underestimated intrinsic value of attractiveness, characterized by its inland natural areas and rich cultural heritage. Starting from these condi- tions, the innovation of the territorial system through the involvement of the communities of the Municipality of Finiq is one of the main development and enhancement drivers. Based on a holistic approach to setting up and representing land, cultural, environmental, artistic, agro- alimentary, and local gastronomic assets, this research paper aims to propose the improvement of the attractiveness of the Finiq Municipality's, according to advanced international methodological standards, and the resulting territorial and social impact (Rossi, 2022). It is proposed to implement innovation in the gainful process in the Finiq Municipality by the digitalization of assets through the international BIM standard (Bianchini et al., 2021), creat- ing three-dimensional information models at different levels: individual assets, infrastructures, historical sites (Maietti et al., 2021), and relevant buildings. The three-dimensional model can be implemented in a unified data-sharing environment, allowing for the creation of a digital ecosystem (Banfi et al., 2022) through which different stakeholders and communities can cooperate in processes and exchange information. The ecosystem will create a Digital Twin of the assets (Wu et al., 2021) integrated into a territorial map. A digital model through which, the actors involved, with the support of enabling technologies, will be able to add information to the BIM model in real time, creating a cognitive three-dimensional decision-support model (EcoAlbania, 2021) to re-orient the current shrinking, isolation, and identity trends.

A significant reduction in the time required to obtain an estimate of the mean frequency of the spectrum of Doppler signals when seeking to measure the instantaneous velocity of dangerous near-Earth cosmic objects (NEO) is an important task being developed to counter the threat from asteroids. Spectral analysis methods have shown that the coordinate of the centroid of the Doppler signal spectrum can be found by using operations in the time domain without spectral processing. At the same time, an increase in the speed of resolving the algorithm for estimating the mean frequency of the spectrum is achieved by using fractional differentiation without spectral processing. Thus, an accurate estimate of location of the centroid for the spectrum of Doppler signals can be obtained in the time domain as the signal arrives. This paper considers the implementation of a fractional-differentiating filter of the order of ½ by a set of automation astatic transfer elements, which greatly simplifies practical implementation. Real technical devices have the ultimate time delay, albeit small in comparison with the duration of the signal. As a result, the real filter will process the signal with some error. In accordance with this, this paper introduces and uses the concept of a “pre-derivative” of ½ of magnitude. An optimal algorithm for realizing the structure of the filter is proposed based on the criterion of minimum mean square error. Relations are obtained for the quadrature coefficients that determine the structure of the filter.

Realistic 3D human model reconstruction is an important component in computer graphics and computer vision. In particular, texturing on the surface of models is a key stage of reconstruction. In this paper, we dispose the texture mapping on the model’s surface as an optimization of image stitching, and present an effective method to generate a seamless, integrated and smooth texture on the surface of 3D human model. First, we build a corresponding Markov Random Field model with respect to color images and triangular meshes of the surface. On the basis of alpha-expansion optimization for this Markov Random Field model, a 2D translation coordinate of color image, as an adaptive iterative factor, is introduced into the optimization to match the color content at the boundary of adjacent meshes. That compensates for the misalignment of adjacent color images, which caused by the inaccuracy of depth data and multi-view misregistration. Then we apply Poisson blending to a composite vector field in gradient domain, to resolve the small but noticeable illumination variations between different color images. To repair the blank regions, we parameterize the model’s surface and project it onto a 2D plane. Then the K-Nearest Neighbor algorithm is applied to fill up the blank regions with texture contents. Finally, we evaluate our method by comparison with another three advanced methods on some human models, and the results demonstrate that our method of images stitching creates a best texture on the surface of 3D human model both in visual effect and quantitative analysis.

Computerised 3D models are more intuitive and rich in landscape detail. They are considered an essential visualisation method for the presentation of environmental data with spatial contents. The 3D technology has been increasingly applied in environmental impact assessment (EIA) and urban planning to view and better appreciate human impacts on the environment. Their uses are not restricted to the professionals. Because of their great likeness to the natural world, 3D representations have also been employed to convey information to the general population through public hearings, workshops, and the Internet. The use of 3D visualisation in EIA applications is not without problems, particularly for those without the necessary skills in computer operations and map comprehension. This paper is an assessment of the applicability and effectiveness of 3D visualisation in EIA. First we illustrate different scenarios of 3D portrayals in environmental management. This is followed by a discussion about the problems and concerns of using 3D visualisation in presenting environmental data. These issues are examined in greater detail to highlight various technical considerations and types of data suitable (or not suitable) for the implementation of 3D models. A reference is made to the potential incorporation of feedback mechanisms in a 3D system intended for public participation.

Breast cancer is one of the most common cancer types among women in which early tumor invasion leads to metastases and death. EpCAM (epithelial cellular adhesion molecule) and HER2 (human epidermal growth factor receptor 2) are two main circulating tumor cell (CTC) subsets in HER2+ breast cancer patients. In this regard, the main aim of this study is to develop and characterize a three-dimensional (3D) breast cancer tumor model composed of CTC subsets to evaluate new therapeutic strategies and drugs. For this reason, EpCAM(+) and HER2(+) sub-populations were isolated from different cell lines to establish 3D tumor model that mimics in situ (in vivo) more closely than two-dimensional (2D) models. EpCAM(+)/HER2(+) cells had a high proliferation rate and low tendency to attach to the surface in comparison with parental MDA-MB-453 cells as CTC subsets. Aggressive breast cancer subpopulations cultured in 3D porous chitosan scaffold had enhanced cell-cell and cell-matrix interactions compared to 2D cultured cells and these 3D models showed more aggressive morphology and behavior, expressed higher levels of pluripotency marker genes, Nanog, Sox2 and Oct4. For the verification of the 3D model, the effects of doxorubicin which is a chemotherapeutic agent used in breast cancer treatment were examined and increased drug resistance was determined in 3D cultures. The 3D tumor model comprising EpCAM(+)/HER2(+) CTC subsets developed in this study has a promising potential to be used for investigation of an aggressive CTC microenvironment in vitro that mimics in vivo characteristics to test new drug candidates against CTCs.

Although abundant studies have shown how visualization can help software developers to understand software systems, visualization is still not a common practice since developers (i) have little support to find a proper visualization for their needs, and once they find a suitable visualization tool, they (ii) are unsure of its effectiveness. We aim to offer support for identifying proper visualizations, and to increase the effectiveness of visualization techniques. In this dissertation, we characterize proposed software visualizations. To fill the gap between proposed visualizations and their practical application, we encapsulate such characteristics in an ontology, and propose a meta-visualization approach to find suitable visualizations. Amongst others characteristics of software visualizations, we identify that the medium used to display them can be a means to increase the effectiveness of visualization techniques for particular comprehension tasks.We implement visualization prototypes and validate our thesis via experiments. We found that even though developers using a physical 3D model medium required the least time to deal with tasks that involve identifying outliers, they perceived the least difficulty when visualizing systems based on the standard computer screen medium. Moreover, developers using immersive virtual reality obtained the highest recollection. We conclude that the effectiveness of software visualizations that use the city metaphor to support comprehension tasks can be increased when city visualizations are rendered in an appropriate medium. Furthermore, that visualization of software visualizations can be a suitable means for exploring their multiple characteristics that can be properly encapsulated in an ontology.