Implementation of FPGA Based Digital Camera System Controlled from an LCD Touch Panel

The trend in the development and manufacturing of Complementary Metal Oxide Semiconductor (CMOS) image sensors is to miniaturize pixels on the chips and hence to improve their imaging characteristics by providing a higher image resolution. As CMOS technology scales down into submicron regions, the conventional color filters are no longer suitable for generating the desired optical density. The major drawback of the conventional color filters produced from pigment-based positive tone photosensitive compositions, is the heterogeneous dispersion of pigments in photoresist composition resulting in color irregularities due to coarse particles of the pigments. One of the most perspective ways to solve this problem is a replacing the pigment with a dye as a coloring agent and thus, increasing solubility of the latter to obtain a homogeneous colored photoresist composition. In this paper, several novel red dye-containing materials are synthesized and tested to provide a redcolored photosensitive composition. This red-colored photosensitive composition is very promising for application as color filters for CMOS image sensors with high resolution and high level of integration architecture.

In this study, we used a Complementary Metal Oxide Semiconductor (CMOS) image sensor with immobilizing antibodies on its surface to detect human cytokines, which are activators that mediate intercellular communication including expression and control of immune responses. The CMOS image sensor has many advantages over the Charge Couple Device, including lower power consumption, operation voltage, and cost. The photodiode, a unit pixel component in the CMOS image sensor, receives light from the detection area and generates digital image data. About a million pixels are embedded, and size of each pixel is 3 x 3 μm. The chemiluminescence reaction produces light from the chemical reaction of luminol and hydrogen peroxide. To detect cytokines, antibodies were immobilized on the surface of the CMOS image sensor, and a sandwich immunoassay using an HRP-labeled antibody was performed. An HRP-catalyzed chemiluminescence reaction was measured by each pixel of the CMOS image sensor. Pixels with stronger signals indicated higher cytokine concentrations; thus, we were able to measure human interleukin-5 (IL-5) at femtomolar concentrations.

Field programmable gate arrays (FPGAs) are in use to build high performance image processing systems. This paper presents the design and implementation of such an open FPGA-based digital camera system for image capturing and real-time image processing. Images captured with a CMOS sensor are initially stored in the system's memory and then they are displayed on an LCD touch panel. The main goal of this proposed architecture is to be used as a platform to implement and test advance image processing algorithms. Apart of this, the system supports the control of the image sensor, through the LCD touch panel. In addition, has the ability to communicate with a PC through a JTAG interface for storing the images on it. The structural element for this proposed architecture was chosen to be the low cost and widely used at universities, Altera's DE2 development board.

This paper presents a new Electronic Travel Aid (ETA) ‘Acoustic Prototype’ which is especially suited to facilitate the navigation of visually impaired users. The device consists of a set of 3-Dimensional Complementary Metal Oxide Semiconductor (3-D CMOS) image sensors based on the three-dimensional integration and Complementary Metal-Oxide Semiconductor (CMOS) processing techniques implemented into a pair of glasses, stereo headphones as well as a Field-Programmable Gate Array (FPGA) used as processing unit. The device is intended to be used as a complementary device to navigation through both open known and unknown environments. The FPGA and the 3D-CMOS image sensor electronics control object detection. Distance measurement is achieved by using chip-integrated technology based on the Multiple Short Time Integration method. The processed information of the object distance is presented to the user via acoustic sounds through stereophonic headphones. The user interprets the information as an acoustic image of the surrounding environment. The Acoustic Prototype transforms the surface of the objects of the real environment into acoustical sounds. The method used is similar to a bat's acoustic orientation. Having good hearing ability, with few weeks training the users are able to perceive not only the presence of an object but also the object form (that is, if the object is round, if it has corners, if it is a car or a box, if it is a cardboard object or if it is an iron or cement object, a tree, a person, a static or moving object). The information is continuously delivered to the user in a few nanoseconds until the device is shut down, helping the end user to perceive the information in real time.

This paper proposes a novel beehive-shaped reflector for application to light-emitting diode (LED) transceivers for illumination and bi-directional visible light communication (VLC). By using a diffuse propagation model extended to line-of-sight and direct signals, the distribution of illuminance and the path loss of the transceiver are investigated to evaluate the performance of the beehive-shaped reflector. To verify bi-directional communication, a VLC-based image capture system, comprising a complementary metal-oxide semiconductor (CMOS) image sensor and video processor unit, is demonstrated. Real-time images captured by the CMOS camera are successfully transmitted to the monitoring system via a free-space channel at a rate of 115.2 kbps.

Radon (Rn-222) is the main source of radiation exposure to human beings from natural radiation; it is of great significance to study the measuring methods and measuring instruments of radon for natural radiation protection. In recent years, the application of pixel detectors in radiation detection has attracted attention. In this paper, a Commercial Off-the-Shelf Complementary Metal Oxide Semiconductor (COTS CMOS) image sensor which replaces the glass for protection covering in front of the sensors was used to perform a series of measurements to identify alpha particles. During the experiment, the CMOS image sensor was used to record a video during the sampling period, and then use the FFmpeg software to take screenshots of the video by frame. MATLAB was used to count bright spots from the image frames. A measurement chamber was designed to measure radon concentrations, and when the relative humidity was constant, the count of alpha particles by the CMOS image sensor increased along with the increase of the concentration. The experiments verified the feasibility of the low-cost COTS CMOS image sensors to monitor radon.

The behavior of random telegraph signal (RTS) noise in metal oxide semiconductor field effect transistor (MOSFETs) with different oxidation processes and its effects on the readout circuit in complementary MOS (CMOS) image sensor were experimentally studied. Statistically, RTS noise in large number of devices have been measured both in the device with single oxide and dual oxide and we analyzed its amplitude and power spectrum density. Through the analysis, we found that there are significantly different behaviors of RTS noise between single oxide devices and dual oxide devices due to different characteristic of oxide traps. We not only provided information of traps in both single and dual oxide devices but also applied different RTS noise behavior of both two cases to readout circuits in CMOS image sensor.

This paper reports on a portable imaging system using a complementary metal oxide semiconductor (CMOS) imager for microfluidic analysis and fluorescence imaging with an organic light emitting diode (OLED). The portable CMOS imager is useful for onsite microfluidic analysis, and the OLED works as a light source for fluorescent observations. The system needs only five elements: a laptop computer, a CMOS imaging device, an optical filter, microfluidic channels, and OLEDs. Using this system, we succeeded in a bead‐based microfluidic assay, capturing the video of the trapping and releasing process. Furthermore, we observed the fluorescent beads and the dye using an OLED as the light source in this system. As a result, we found that (i) submillimeter objects could be in focus with about 1 mm distance from CMOS imaging device surface without a lens; (ii) microfluidic experiments with poly(dimethylsiloxane) channels were possible on the CMOS imager; and (iii) OLED can potentially be used as a light source for this system. We believe that this system is useful for point‐of‐care diagnostic sensing and onsite microfluidic analysis including fluorescence detection. © 2011 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

Image sensors are the core components of computer, communication, and consumer electronic products. Complementary metal oxide semiconductor (CMOS) image sensors have become the mainstay of image-sensing developments, but are prone to leakage current. In this study, we simulate the CMOS image sensor (CIS) film stacking process by finite element analysis. To elucidate the relationship between the leakage current and stack architecture, we compare the simulated and measured leakage currents in the elements. Based on the analysis results, we further improve the performance by optimizing the architecture of the film stacks or changing the thin-film material. The material parameters are then corrected to improve the accuracy of the simulation results. The simulated and experimental results confirm a positive correlation between measured leakage current and stress. This trend is attributed to the structural defects induced by high stress, which generate leakage. Using this relationship, we can change the structure of the thin-film stack to reduce the leakage current and thereby improve the component life and reliability of the CIS components.

A 4 x 4 pixel array with analog on-chip processing has been fabricated within a 0.35 mum complementary metal oxide semiconductor process as a prototype sensor for laser Doppler blood flow imaging. At each pixel the bandpass and frequency weighted filters necessary for processing laser Doppler blood flow signals have been designed and fabricated. Because of the space constraints of implementing an accurate omega(0.5) filter at the pixel level, this has been approximated using the "roll off" of a high-pass filter with a cutoff frequency set at 10 kHz. The sensor has been characterized using a modulated laser source. Fixed pattern noise is present that is demonstrated to be repeatable across the array and can be calibrated. Preliminary blood flow results on a finger before and after occlusion demonstrate that the sensor array provides the potential for a system that can be scaled to a larger number of pixels for blood flow imaging.

Visible Light Positioning (VLP) is widely recognized as a cost-effective solution for indoor positioning with increasing demand. However, the nonlinearity and highly complex relationship between three-dimensional world coordinate and two-dimensional image coordinate hinders the good performance of image-sensor-based VLP. Therefore, there is a need to develop effective VLP algorithms to locate the positioning terminal using image sensor. Besides, due to the high computational cost of image processing, most existing VLP systems do not achieve satisfactory performance in terms of real-time ability and positioning accuracy, both of which are significant for the performance of indoor positioning system. In addition, the accurate identification of the ID information of each LED (LED-ID) is important for positioning, because if the LED-ID is not recognized well, the positioning can only be achieved in a particular positioning unit and cannot be applied to a large scene with many LEDs. Therefore, an effective image-sensor-based double-light positioning system is proposed in this paper to solve the above problems. We also set up relevant experiments to test the performance of the proposed system, which utilizes the rolling shutter mechanism of the Complementary Metal Oxide Semiconductor (CMOS) image sensor. Machine learning was used to identify the LED-ID for better results. Simulation results show that the proposed double-light positioning system could deliver satisfactory performance in terms of both the real-time ability and the accuracy of positioning. Moreover, the proposed double-light positioning algorithm has low complexity and takes the symmetry problem of angle into consideration, which has never been considered before. Experiments confirmed that the proposed double-light positioning system can provide an accuracy of 3.85 cm with an average computing time of 56.28 ms, making it a promising candidate for future indoor positioning applications.

As an application of visible light communication (VLC), visible light positioning (VLP) technology has great potential for vehicle positioning due to its characteristics of no electromagnetic interference, low cost, and high positioning accuracy. In addition, the light emitting diode (LED) in street lights, traffic lights and vehicle lighting systems makes this positioning solution attractive for vehicular applications. However, the modulated LED signal will bring blooming effects on the images captured by a complementary metal oxide semiconductor (CMOS) camera. And it will decrease the positioning performance. Meanwhile, positioning errors will happen when the CMOS camera is tilted. In the paper, a vehicle positioning scheme based on VLC is proposed and experimentally demonstrated. It uses LED street light as a transmitter and the CMOS camera as a receiver. To mitigate the blooming effect in the CMOS camera based VLC, a bit length estimation (BLE) based sampling scheme is proposed to obtain the reference location information from the captured images. In addition, a novel angle compensation scheme combined with a particle filter is proposed to improve the accuracy of vehicle positioning when the CMOS camera is tilted. The experiments are performed under moving speeds of 40 to 80 cm/s and the measured distances of 80 to 115 cm. Assuming the performance of the proposed demonstrator is not modified when upscaling its size to a real scenario (such as speeds of 4 to 8 m/s and distances between the LED and camera of several meters), it can be concluded that as the speed of the moving vehicle is 8 m/s, the proposed vehicle positioning scheme based on VLC can achieve positioning accuracy of 0.128 m and 0.13 m for the tilt angles of 9° and 15.5°, respectively.

The charge-coupled device (CCD) has been developed primarily as a compact image sensor for consumer and industrial markets, but is now also the preeminent visible and ultraviolet wavelength image sensor in many fields of scientific research including space-science and both Earth and planetary remote sensing. Today’s scientific or science-grade CCD will typically maximise pixel count, focal plane coverage, photon detection efficiency over the broadest spectral range and signal dynamic range whilst maintaining the lowest possible readout noise. The relatively recent re-emergence of complementary metal oxide semiconductor (CMOS) image sensor technology is arguably the most important development in solid-state imaging since the invention of the CCD. Current sub-micron CMOS technology now enables the integration on a single silicon chip of a large array of photodiode pixels alongside all of the ancillary electronics needed to address the array and digitise the resulting analogue video signal. Compared to the CCD, CMOS promises a more compact, lower mass, lower power and potentially more radiation tolerant camera.

In this study, we propose a new complementary metal-oxide semiconductor (CMOS) image sensor to extend the dynamic range. The proposed active pixel sensor (APS) uses a gate/body-tied PMOSFET-type (GBT) photodetector and an output voltage feedback structure. Although the size of the proposed APS is slightly larger than a conventional APS, the dynamic range of the proposed pixel is much wider than a conventional APS. And the proposed APS has a varied dynamic range from adjusting the reference voltage. The proposed APS has been designed and fabricated by using 0.35 μm 2-poly 4-metal standard CMOS technology, and its characteristics have been evaluated.

We demonstrate a silo-filter (SF) complementary metal-oxide semiconductor (CMOS) image sensor for a chip-scale fluorescence microscope. The extruded pixel design with metal walls between neighboring pixels guides fluorescence emission through the thick absorptive filter to the photodiode of a pixel. Our prototype device achieves 13 μm resolution over a wide field of view (4.8 mm × 4.4 mm). We demonstrate bright-field and fluorescence longitudinal imaging of living cells in a compact, low-cost configuration.