A 64 parallel integrated memory array processor and a 30 GIPS real-time vision system

This paper describes the real-time vision system (RVS-2) which shows quite high performance for low-level image processing while it is implemented in a one-board type compact size format with small power consumption. The RVS-2 consists of an IMAP board, a video board and a host workstation. The IMAP board consists of eight highly-integrated IMAP LSIs and a dedicated control LSI (RVSC). The IMAP chip integrates 2 Mb image memory and 64 processing elements that operate in the SIMD mode. The RVSC chip performs global data operations efficiently without interactions with the host workstation, as well providing an instruction stream to the IMAP chips. The peak performance of the RVS-2 is 30 GIPS and most of the basic image processing tasks are carried out within about 0.1-0.7 ms, which is about 50-300 times faster than the video frame rate.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Implementation of a real-time image visualization system on a reconfigurable chip (FPGA) is proposed. The system utilizes an innovative stereoscopic image capture, processing and visualization technique. Implementation is done as a two stage process. In the first stage, the stereo pair is captured using two image sensors. The captured images are then synchronized and sent to the second stage for fusion. A controller module is developed, designed, and placed on the FPGA for this purpose. The second stage is used for reconstruction and visualization of the 3D image. An innovative technique employing dual-processor architecture on the same single FPGA is developed for this purpose. The whole system is placed on a single PCB resulting in a fast processing time and the ability to view 3D video in real-time. The system is simulated, implemented, and tested on real images. Results show that this system is a low cost solution for efficient 3D video visualization using a single chip.

The tax big data supervision system and method, including the distributed real-time management and control system deployed in the superior unit and each subordinate unit, the superior distributed real-time management and control system is used to receive the management and control rules, and issue the management and control rules to the subordinate distributed real-time management and control System: The distributed real-time management and control system writes the massive data in the data source at the same level into the distributed message queue Kafka in real time, and uses the distributed stream computing engine Flink to compare and calculate based on the management and control rules, and write the data that conforms to the management and control rules. Enter the alarm information into Kafka; the lower-level distributed real-time management and control system pushes the alarm information in the Kafka subscription at this level to Kafka in the upper-level distributed real-time management and control system; the upper-level distributed real-time management and control system pushes the alarm information in the Kafka subscription to users , at the same time push the alarm information to the distributed search engine ElasticSearch to save, and provide the historical alarm information query function.

The paper is devoted to the problem of formalization of software-hardware solutions in designing real-time computer vision systems. The main attention is paid to the methods of implementation of low-level operations that find features (simple elements) in the image input to the system. Algorithmic types of detectors of simple elements in images are analyzed from the point of view of hardware organization in computer vision systems. In this connection, the necessary performance and memory resources are estimated. The capabilities of parallel and pipeline execution of detector algorithms are investigated. A method of using a field programmable gate array and a digital signal processor in solving the problem of image processing in real-time computer vision systems is considered in detail.

Programming a Pipelined Image Processor

Development of real-time visual monitoring system for vibration effects on fresh concrete

This paper presents a real-time Visual Content Description System (VCDS) based on MPEG-7 descriptors. In our approach the system's structure is divided into two parts, the first of which is the extraction of the descriptors using the VCDS. The second part uses the descriptors' values in a particular search algorithm. We propose here original solutions for both parts. The proposed system architecture could be used for real-time video indexing and retrieval, content summarization, content delivery, surveillance, personalized services, etc. The descriptor extractor IP core, which is part of the VCDS, implements four MPEG-7 visual descriptors and was designed for ASIC implementation in CMOS 0.35 μm, which is a novel solution for a real-time content description problem. The proposed hardware architecture splits the computational burden into several threads, so that calculations are made simultaneously in order to improve the system's speed. These methods make the hardware implementation of the most computationally demanding modules of the system more time- and power-efficient. Four different variations of the basic hardware architecture are discussed. New search algorithms based on the VCDS responses are also proposed. Experimental results demonstrate the effectiveness of the hardware architectures, and the new approach to similarity-based searching methods.

Visualization is very useful for the study of the heart, but it is still a challenging work to display the detailed heart because of the complex structure and expensive computation. Very few systems have been developed to satisfy this work specially. In this paper, we designed and implemented a GPU-based and real-time cardiac visualization system (GRCVS). The illumination model and the context-preserving model are integrated into the system, so that it can generate better images and preserve the important boundary information at the same time. The rendering process is programmed with CUDA, which helps to view the final image in real time. The system also provides strong interactive ability: it supplies visual and concise interfaces to set various parameters which are used to adjust image effect and user can also use simple ways to observe the images quickly and conveniently. The system has been proved to be valuable for the study of the heart in biomedical field.

In order to tackle a process-variation problem, we can define several scenarios, each of which corresponds to a particular LSI behavior, such as a typical-case scenario and a worst-case scenario. By designing a single LSI chip which realizes multiple scenarios simultaneously, we can have a process-variation-tolerant LSI chip. In this paper, we propose a process-variation-aware low-latency and multi-scenario high-level synthesis algorithm targeting new distributed-register architectures, called HDR architectures. We assume two scenarios, a typical-case scenario and a worst-case scenario, and realize them onto a single chip. We first schedule/bind each of the scenarios independently. After that, we commonize the scheduling/binding results for the typical-case and worst-case scenarios and thus generate a commonized area-minimized floorplan result. Experimental results show that our algorithm reduces the latency of the typical-case scenario by up to 50% without increasing the latency of the worst-case scenario, compared with several existing methods.

Gear factories are most typical discrete manufacturing factories. Many gear factories are striving to explore how to achieve intelligent manufacturing in order to improve efficiency and reduce costs. Digital twin technology is currently one of the most reliable ways to achieve intelligent manufacturing. This article aims to establish a real-time control system in order to promote intelligent manufacturing for discrete manufacturing factories. Firstly, a model for a digital twin gear factory is put forward based on the characteristics of gear factories, and the composition of a real-time control system for gear factories is clarified. Then, a human–computer interaction architecture for the real-time control system is proposed. The real-time control system consists of three parts as follows: a monitoring module, a virtualizing module, and a controlling module. At work, it appears as a kind of human–machine interaction form with the three following interfaces: a monitoring window, a virtualizing window, and a controlling window. Finally, a gear factory, which is specialized in manufacturing the intermediate shaft dual gear of a new energy vehicle gearbox, develops a set of software for the real-time control system. The prototype software is obtained through some development activities such as 3D MAX and WebGL virtualization modeling and OPC UA and REST communication design.

In this paper we present the architecture and framework for a benchmark suite that has been developed as part of the DeSiDeRaTa project. The benchmark suite is representative of the emerging generation of distributed, mission-critical, real-time control systems that operate in dynamic environments. Systems that operate in such environments may have unknown worst- case scenarios, may have large variances in the sizes of the data and event sets that they process (and thus, have large variances in execution latencies and resource requirements), and may be very difficult to characterize statically, even by time-invariant statistical distributions. The benchmark suite (called DynBench) is useful for evaluation of the Quality of Service (QoS) management and/or Resource Management (RM) services in distributed real-time systems. As such, DynBench includes a set of performance metrics for the evaluation of the QoS and RM technologies in dynamic, distributed real-time systems. The paper demonstrates the successful application of DynBench in evaluation of the DeSiDeRaTa QoS management middleware.

System monitoring for a real time local area network

For regular vehicles, the vibration generated when a vehicle passes through a groove or step is dampened but still remains and causes whole-body vibration (WBV) to occupants through vehicle seat. Several epidemiological studies have clearly demonstrated that prolonged exposure to vibration from vehicles is detrimental to human health and may cause motion sickness. To reduce this whole-body vibration. We designed a simple and effective feed-forward control system with compact actuator compatible to the limited under-seat dimension and power outlet of compact general passenger cars and successfully authenticated the possibility of vertical vibration reduction by controlling the vehicle seat surface vertical displacement. In this research, we designed a real-time feed-forward control system with transfer function model estimation. This real-time control system contains a commercial DSP device providing coherence input and output with a controllable delay. With the application of transfer function model and state space model, this system successfully estimated the upcoming vibration acceleration according to the input of the vibrational acceleration time-domain data acquired from lower arm when the test vehicle passing a step. Furthermore, it is possible to process the input data and control the linear actuator precisely to reduce the vertical impact observed as setting force reduction.

There is a growing interest in adopting object technologies for the development of real-time control systems. Several commercial tools, currently available, provide object-oriented modeling and design support for real-time control systems. While these products provide many useful facilities, such as visualization tools and automatic code generation, they are all weak in addressing the central characteristic of real-time control systems design, i.e., providing support for a designer to reason about timeliness properties. We believe an approach that integrates the advancements in both object modeling and design methods and real-time scheduling theory is the key to successful use of object technology for real-time software. Surprisingly several past approaches to integrate the two either restrict the object models, or do not allow sophisticated schedulability analysis techniques. This study shows how schedulability analysis can be integrated with UML for Real-Time (UML-RT) to deal with timing properties in real time control systems. More specifically, we develop the schedulability and feasibility analysis modeling for the external messages that may suffer release jitter due to being dispatched by a tick driven scheduler in real-time control system and we also develop the scheduliablity modeling for sporadic activities, where messages arrive sporadically then execute periodically for some bounded time. This method can be used to cope with timing constraints in realistic and complex real-time control systems. Using this method, a designer can quickly evaluate the impact of various implementation decisions on schedulability. In conjunction with automatic code-generation, we believe that this will greatly streamline the design and development of real-time control systems software.

Abstract. A real-time vision system has been developed that analyzes color videos taken from a forward-looking video camera in a car driving on a highway. The system uses a combination of color, edge, and motion information to recognize and track the road boundaries, lane markings and other vehicles on the road. Cars are recognized by matching templates that are cropped from the input data online and by detecting highway scene features and evaluating how they relate to each other. Cars are also detected by temporal differencing and by tracking motion parameters that are typical for cars. The system recognizes and tracks road boundaries and lane markings using a recursive least-squares filter. Experimental results demonstrate robust, real-time car detection and tracking over thousands of image frames. The data includes video taken under difficult visibility conditions.