GRCVS: A GPU-based and real-time cardiac visualization system

Implementation of a real-time image visualization system on a reconfigurable chip (FPGA) is proposed. The system utilizes an innovative stereoscopic image capture, processing and visualization technique. Implementation is done as a two stage process. In the first stage, the stereo pair is captured using two image sensors. The captured images are then synchronized and sent to the second stage for fusion. A controller module is developed, designed, and placed on the FPGA for this purpose. The second stage is used for reconstruction and visualization of the 3D image. An innovative technique employing dual-processor architecture on the same single FPGA is developed for this purpose. The whole system is placed on a single PCB resulting in a fast processing time and the ability to view 3D video in real-time. The system is simulated, implemented, and tested on real images. Results show that this system is a low cost solution for efficient 3D video visualization using a single chip.

Synthetic Aperture Radar (SAR) systems have become indispensable tools for observing the physical properties of the Earth and other planetary bodies, as well as for detecting and identifying both natural and man-made structures. In this paper, a realistic and efficient three-dimensional (3D) terrain targets model was developed to explore the relationship between the backscattering characteristics of the electromagnetics and the physical features of ground objects. In order to simulate the real land surface, we proposed an improved Diamond-square algorithm and CLAMP model is employed for vegetation modeling. Specifically, geometric electromagnetic(EM)-CAD modeling and a land surface model are established. Furthermore, the effective image simulating method of SAR for complex 3D targets in clutter environment based on electromagnetic scattering was utilized. Finally, numerical experiments indicate that 2D and 3D visualization graphics of SAR images for the terrain targets are generated by the EM simulation in reasonable runtime. It is further demonstrated that the real-time 3D SAR imaging visualization system could be successfully realized.

When designing a system capable of capturing and displaying three-dimensional (3-D) moving images in real time by the integral imaging (II) method, one challenge is to eliminate pseudoscopic images. To overcome this problem, we propose a simple system with an array of three convex lenses. This paper first describes by geometrical optics the lateral magnification of the elemental optics and expansion of an elemental image, confirming that the elemental optics satisfies the conditions under which pseudoscopic images can be avoided. By the II method, adjacent elemental images must not overlap, a condition also satisfied by the proposed optical system. Next, the paper describes an experiment carried out to acquire and display 3-D images. The real-time system we have constructed comprises elemental optics array with 54(H) x 59(V) elements, a CCD camera to capture a group of elemental images created by the lens array, and a liquid crystal panel to display these images. The experiment results confirm that the system produces orthoscopic images in real time and so is effective for real-time application of the II method.

Uncertainty propagation: Avoiding the expensive sampling process for real-time image-based measurements

A real-time recursive back projection (BP) imaging algorithm is presented in this paper. Real time imaging is an intense demand but a challenging task in impulse surface penetrating radar (ImpSPR)'s application. Based on 'delay-sum' operation in time domain, BP imaging algorithm can precisely focus the scattering intensity and obtain high quality subsurface profile. But it's heavy computation burden restricts it's application in ImpSPR's real-time processing. By minutely analyzing it's procedure, a recursive model of BP imaging algorithm is established and real-time BP imaging algorithm is educed subsequently. The computation complexity of both non real time BP imaging algorithm and real time BP imaging algorithm are analyzed. Through processing the experimental data obtained by a ImpSPR system- RadarEye, the imaging algorithm validates its capability at the aspect of ImpSPR's real time processing.

Ultrasound image fusion for external beam radiotherapy for prostate cancer

We are studying electronic holography and have developed a real-time color holography system for live scene which includes three functional blocks, capture block, processing block, and display block. In this paper, we will introduce our developed system after describing basic idea that quickly calculates hologram from IP image. The first block, capture block, uses integral photography (IP) technology to capture color 3-D objects under natural light in real time. The second block, processing block, consists of four general personal computers to generate holograms from IP images in real time. Three half-zone-plated holograms for red, green and blue (RGB) channels are generated for all captured IP images by using fast Fourier Transform. The last block, display block, mainly consists of three liquid crystal displays to display the holograms and three laser sources for RGB to reconstruct the color 3-D objects. All blocks work in real time, i.e., in 30 color frames per second.

Describes a parallel-processor LSI chip (the Integrated Memory Array Processor, IMAP) and a compact real-time vision system (RVS-2). The IMAP integrates 64 8-bit processors, which operate in a SIMD manner, and 2-Mbit image memory on a single chip, and has peak performance of 3.84 GIPS. The RVS-2 consists of 8 IMAPs, a video interface, a control LSI chip (the Real-time Vision System Controller, RVSC) and a host workstation. RVSC is a 16-bit processor which carries out global data operations as well as providing an instruction stream to IMAP processors. In the RVS-2 system, the IMAP processors accomplish data-parallel operations, the RVSC applies global data operations to the results, and the host workstation carries out higher-level recognition tasks using the results obtained by the IMAPs and the RVSC. The peak performance of the RVS-2 is 30 GIPS and most of the basic image processing is carried out in 0.1 to 0.7 ms, which is 50 to 300 times faster the video rate.

A concept for motion stereo is introduced. It is based on an explicit determination of the velocities with which features move in images of dynamic scenes. A mobile robot carrying a single TV-camera may use this method to determine its distance to external objects accurately and in real time. While the robot approaches an object the accuracy of the measurement improves continuously as the distance decreases, making the method particularly suitable for tasks like collision avoidance or docking. The method may be implemented in such a way that it does not require a camera calibration, provided the lens of the camera is sufficiently free from distortion. The method has been applied on a mobile robot equipped with a real-time vision system, and experiments have been performed to test its practicality in a real-world environment. Accuracies better than 1% of the distance have been demonstrated while the robot was moving in the direction towards the object. >

Image compression is a basic need for the progressive transmission or storage of image data via any media. For the effective processing of image data the coding standards were developed. The most commonly used standard in current scenario is the JPEG and JPEG-2000 coding. These standards have become the industry standards and are progressively been in use for almost all image processing applications. In the process of image coding various sub-processing operations occur which process the image blocks by transformation, quantization and encoding before transmitting or storing. In the process, quantization is observed to be a time consuming and is needed to be processed in high precision so as to achieve less processing error and also in reasonable time. The process of quantization has shown greater efficiency in vector quantization than earlier methods. Vector quantization is observed to be an efficient block based lossy compression technique. Due to simpler coding process and high compression ratio VQ are widely used. Predictive vector Quantization (PVQ) is commonly used memory based vector Quantization method. The main drawback with PVQ is the high computational complexity which limits PVQ to use in real time applications. Shorter coding time can be archived by reducing the number of code words or instructions, but the reconstructed image quality will degraded in the case of fewer code words. Hence, it is necessary to propose fast coding algorithms for PVQ. In this paper a modified version of the PVQ approach has been suggested in order to process faster, which ensue to be a compatible mechanism for real time image coding in JPEG based coding system. Keywords: Compression, quantization, PVQ encoder, mean-square-error, Discrete Cosine Transform.

The main advantage of confocal microscopes over their conventional counterparts arises from their ability to optically 'section' nearly transparent materials; the thin image slices thus obtained can be used to reconstruct three-dimensional images, a capability which is particularly useful for the study of biological specimens. Confocal microscopes have previously used either a single laser-illuminated point-source and single point-detector (which are scanned in tandem across the object) or white-light illumination with multiple point-sources and detectors. Single-point-source systems, however, do not usually form images in real time and are restricted to using available laser wavelengths. Multiple-point-source systems, on the other hand, produce images in real time but use light very inefficiently--typically 1% or less is used for imaging. Here we demonstrate a white-light, multiple-point-source method which can in principle produce images in real time with light efficiencies as high as 50%. This system is likely to find broad practical application, particularly in the imaging of weakly reflecting or weakly fluorescent specimens.

Interactive visual presentation of information can help an analyst gain faster and better insight from data. When combined with situational or context information, visualization on mobile devices is invaluable to in-field responders and investigators. However, several challenges are posed by the form-factor of mobile devices in developing such systems. In this paper, we classify these challenges into two broad categories - issues in general mobile computing and issues specific to visual analysis on mobile devices. Using NetworkVis and Infostar as example systems, we illustrate some of the techniques that we employed to overcome many of the identified challenges. NetworkVis is an OpenVG-based real-time network monitoring and visualization system developed for Windows Mobile devices. Infostar is a flash-based interactive, real-time visualization application intended to provide attendees access to conference information. Linked time-synchronous visualization, stylus/button-based interactivity, vector graphics, overview-context techniques, details-on-demand and statistical information display are some of the highlights of these applications.

The ability of children to combine syllables represents an important developmental milestone. This ability is often delayed or impaired in a variety of clinical groups, including children with autism spectrum disorders (ASD) and speech delays (SPD). Prior work has demonstrated successful use of computer-based voice visualizations to facilitate speech production and vocalization in children with and without ASD/SPD. While prior work has focused on increasing frequency of speech-like vocalizations or accuracy of speech sound production, we believe that there is a potential new direction of research: exploration of real-time visualizations to shape multisyllabic speech. Over two years we developed VocSyl, a real-time voice visualization system. Rather than building visualizations based on what adult clinicians and software designers may think is needed, we designed VocSyl using the Task Centered User Interface Design (TCUID) methodology throughout the design process. Children with ASD and SPD, targeted users of the software, were directly involved in the development process, allowing us to focus on what these children demonstrate they require. This paper presents the results of our TCUID design cycle of VocSyl, as well as design guidelines for future work with children with ASD and SPD.

Interest in 3D medical imaging continues to increase. However, in ultrasound, real-time imaging is an indispensable strength; and real-time 3D ultrasonic imaging is not practical when conventional steered, focused beam techniques are used. This is because the speed of sound severely limits the size of the volume that can be imaged in real time. For real-time 3D imaging, approaches like simultaneous multiple beams or holography have been considered but never commercially implemented for, in part, the following reasons: A new 3D ultrasound technology should provide the convenience of a hand-held scan head, should yield real-time 3D images, and should provide 2D images with quality equal to, or greater than, presently available 2D ultrasound images. Convenient size and a reasonable price are also requirements. In this paper, a 3D ultrasonic imaging method with the potential to meet the above criteria is described. It may also provide even higher quality 2D ultrasound images than are presently available. The new method relates more closely to computed tomography than to focused steered beams. It, however, uses projections and back-projections over 3D ellipsoids rather than straight lines; and it does this in a simple straight forward manner. Implementation in software of filtered ellipsoidal back-projection is described, resolution and side lobes are discussed, and examples of the 3D point image (re. point spread function) are given.

Laser aided deposition is a material additive based manufacturing process by metallurgically bonding the deposited material to the substrate. For a precise study of the process, a mathematical model was established to investigate thermal and mass transportation phenomena, which includes substrate melting and solidification as well as the powder heating process. The detailed process together with the temperature distribution is simulated. The simulation results of the melt pool length, width and peak temperature are validated for the laser deposition process through the measurements on the melt pool geometry and surface peak temperature by the CMOS camera and the dual-wavelength temperature sensor. A smart embedded vision system using CMOS camera is used to measure the size of the melt pool. The length and width of the melt pool are measured in real time using CMOS camera with an on-board DSP processing system which processes the images in real time and provides the output through a serial port to a real-time controller. A dual wavelength non-contact temperature sensor is used for measuring the temperature of the melt pool in real time. The comparison of the melt pool length and peak temperature was conducted between simulation and experiment and shows a good agreement.Laser aided deposition is a material additive based manufacturing process by metallurgically bonding the deposited material to the substrate. For a precise study of the process, a mathematical model was established to investigate thermal and mass transportation phenomena, which includes substrate melting and solidification as well as the powder heating process. The detailed process together with the temperature distribution is simulated. The simulation results of the melt pool length, width and peak temperature are validated for the laser deposition process through the measurements on the melt pool geometry and surface peak temperature by the CMOS camera and the dual-wavelength temperature sensor. A smart embedded vision system using CMOS camera is used to measure the size of the melt pool. The length and width of the melt pool are measured in real time using CMOS camera with an on-board DSP processing system which processes the images in real time and provides the output through a serial port to a real-t...