A Fast Media Synchronization Mechanism for Streaming Screen Recording Applications

Recently, screen recording technology is widely used by lots of applications, such as remote control, distance learning, and distance conference etc. A problem, called Asymmetric Screen Resolution (ASR) in this paper, will occur in these applications. The ASR problem means that the resolution of a recording computer is different from that of a display computer. Different computer system will have different screen resolution and the ASR problem will result in screen recording resolution mismatch between the recording computer and display computer. This paper proposes a novel CRA algorithm to apply advantage of the CUDA parallel computing for adjusting the resolution on the Graphics Processing Unit (GPU). This algorithm effectively reduces CPU utilization and guarantees the display quality after adjusting resolution. Four different application scenarios, web browsing, text editing, slide presentation, and video playback are used to test the performance of our proposed CRA algorithm. These experiments measure CPU utilization and the PSNR of image adjusted by the CRA algorithm. The experimental results show that CRA algorithm effectively reduce CPU utilization 32%~40% while using whole screen in resolution adjustment. The CRA algorithm effectively reduces CPU utilization 0.1%~13% while using difference rectangle in resolution adjustment. On image quality measurements, the PSNR value is controlled between 25db~28db while using the CRA algorithm to adjust screen resolution from 1920×1080 to 1536×864. The PSNR value is controlled between 26db~34db by using the CRA algorithm to adjust screen resolution from 1920×1080 to 960×540. Using CRA algorithm presented in this paper will definitely get a good image quality, and effectively reduce CPU utilization.

Nowadays, new technology for imaging, information storage, and its transmission is almost everywhere. In the medical field, multi-slice computed tomography (CT), allowing for simultaneous acquisition of many images in parallel, and quick three-dimensional reconstruction is just one example that has the potential to make significant changes in the daily practice, not only for thoracic and cardio-vascular surgeons, but others too. The fact, that the lumen of the main coronary arteries can be demonstrated quite well with multi-slice CT makes clear, that for a number of questions, it is no longer necessary to realize a coronary angiography. There can be little doubt, that the advent of new players in the coronary artery scene will also impact its future development. In addition, the age of multislice CT is just beginning and numerous other applications can be expected like, e.g. systematic preoperative identification of the origin of Adamcievic’s artery in thoracoabdominal aortic aneurysms, postoperative functional assessment of a totally implantable left ventricular assist device [1], etc. For traditional access to information, it is sufficient to indicate its source (ref. [1]) in order to be able to retrieve the corresponding document. However, the function of a totally implanted pulsatile pump, that by definition includes moving parts, is best assessed by a streaming video (see video 1 in ref. [1]). Following the experience of Interactive Thoracic and Cardio-vascular Surgery [2,3] the European Journal of Cardio-thoracic Surgery [1] now offers and accepts short video clips for illustration of the manuscripts submitted (see Instructions to Authors, pp. 674–675 of this issue; http:www.elsevier.com/locate/ejcts). It is essential for the time being to keep these video clips short in order to achieve reasonable delays for downloading. However, the increasing availability of broad-band transmission will certainly allow for larger files shortly. Better availability of information brings up a new type of problem, which is its transformation into knowledge. We all know very well the daily practice in the operating theatre, where it is of prime importance for the life of the patient, to keep in sight his vital parameters (www.lifesight.org). As a matter of fact the information from the operating field (Fig. 1a) has to be frequently up-dated by the continuously collected information about haemodynamics, etc. (Fig. 1b). For the time being, it is for the surgeon necessary in most operating theatres, to slightly change the position of his head, to focus onto a remote screen, where he has to catch the displayed curves and numbers before he can return to the operating field, the place, where the focus of his activity is supposed to be. This sequential process happens several times a minute and increases in frequency during haemodynamically critical situations – exactly then, when full attention to the surgical field is required most. Although it has been standard for quite some time in endoscopic surgery to present on the same screen exposure parameters and video-endoscopically achieved operative views (Fig. 2), more integration of information is now not only feasible, but mandatory. Thoracic and cardio-vascular surgery is not the only stressful activity requiring rapid integration of visual information from various sources during critical missions. Head-up displays that bring important information into the optical field have been used by pilots and in other technology driven fields. Such devices, also called cyber displays, are carried close to one eye and allow either for intermittent feeding with still images, streaming video, or both. Alternatively, the information mentioned, can be displayed as an overlay into semi-transparent glasses, where it is positioned in the peripheral optical field, either a quadrant, or the upper and lower zones. A demonstration of continuous lifesight, and its potential is given in Video 1: vital parameters (curves, digital values, limits, and interpretation) are displayed as an overlay to the surgical view. Simulated ventricular tachycardia (near the end of Video 1) impacts all, EKG, percutaneous oxygen saturation

Screen recording has emerged as a powerful tool in cognitive translation and interpreting studies (CTIS) research. This method captures participants’ computer screens, offering a unique window into their translation processes, information-seeking skills, and human-computer interaction (HCI). Researchers can analyze user behavior through documented pauses, search strategies, and task completion steps. While screen recording offers advantages like unobtrusiveness and ease of storage, it also presents challenges in data analysis complexity and ethical considerations regarding privacy and informed consent. Often, researchers combine it with keylogging, eyetracking, and interviews to strengthen research validity. This chapters explores the rich nature of screen recording in CTIS research. We discuss both the methodological and ethical aspects, examining its applications, advantages, and limitations. Additionally, we explore its integration with complementary data collection methods and outline the types of data it captures. Finally, we acknowledge the evolving technological landscape and the emerging challenges it presents. Through this analysis, we aim to shed light on the potential of screen recording for advancing CTIS research.

Digital video playback on mobile devices is fast becoming widespread and popular. Since mobile devices are typically resource constrained in terms of network bandwidth, battery power and available screen resolution, it is often necessary to formulate special encoding techniques in order to optimize power consumption during video streaming and playback. The existing H.264 standard is popular for video encoding on mobile devices, since it results in a low-bitrate video with visual clarity that is adequate for video playback on mobile devices. However, due to the complexity of the H.264 representation, the video decoding procedure is typically computationally intensive. In this paper, we propose a novel lossy video representation termed as Ligne-Claire (LC) video. LC videos are obtained via graphics overlay of outlines or silhouettes of objects in the video over an approximated texture video. Since the playback of LC video is typically meant for mobile devices, the visual quality of video is adequate for most mobile applications wherein the semantic content of the video can be characterized by object shapes and approximate texture information. Experimental results presented in the paper demonstrate that the proposed lossy LC video encoding scheme results in power savings of 50% or more during video playback compared to standard H.264-encoded videos, of similar video file size. In order to evaluate the visual quality of the LC video, we compare the performance of LC videos with H.264-encoded videos in the context of some typical computer vision tasks. Our results indicate that the performance of the computer vision algorithms on these videos is similar. This fact, coupled with subjective evaluation, and the resulting significant power savings, indicates that the proposed LC representation can be used effectively to encode video for power-constrained mobile devices.

For its excellent performance compared with other cameras, GigE Vision cameras have been extensively applied in real-time image acquisition systems. But its features, such as the high CPU utilization and the dependency on network protocols, make it hard to be applied in embedded systems. This paper presents a hardware solution to access GigE Vision camera. It is a special Ethernet controller, which uses hardware logic to analyze network protocol as well as GigE Vision protocol, and can write image data into memory actively. Because the Ethernet controller is simplified and the protocols are analyzed by hardware, resource consumption and CPU utilization are both reduced. The experimental results prove that the CPU utilization of proposed solution is leading to zero, the acquisition speed of 1280 × 256 image is up to 228 frames per second, and the resource consumption is less than other solutions, which is only about 1393 logic unit blocks, 984 registers and 46,080 bits of memory.

We explored the use of computer screen plus audio recording as a methodological approach for collecting empirical data on how teams use their computers to coordinate work. Screen recording allowed unobtrusive collecting of a rich record of actual computer work activity in its natural work setting. The embedded nature of screen recording on laptops made it easy to follow the user's mobility among various work sites. However, the invasiveness of seeing all of the user's interactions with and through the computer raised privacy concerns that made it difficult to find people to agree to participate in this type of detailed study. We discuss measures needed to develop trust with the researchers to enable access to this rich, empirical data of computer usage in the field.

Content Centric Networking (CCN), a future Internet architecture, brings new challenges in maintaining the Quality of Experience (QoE) for video streaming. Because of the universal caching capability of CCN routers, streaming from multiple sources will be common, and switching between content sources might affect QoE by inducing delays and consequently stalls in video playback. This paper proposes a new QoE-aware multi-source video streaming scheme for CCN. First, the content distributions of video files among CCN nodes for different caching methods are studied. Second, an adaptive video streaming with distributed caching (ASDC) algorithm is designed to guarantee QoE during the switching between content sources. The ASDC algorithm considers the delivery of scalable video streams. It automatically adapts the layers in a video stream when there is source switching, based on a QoE model that characterizes the effect of stalling. Experimental results show that the ASDC algorithm outperforms dynamic adaptive streaming over HTTP (DASH) in the CCN platform in terms of the QoE obtained from human subjective tests.

Laboratory Industry Perspectives on the Role of Self-Collection and Self-Testing in Remote Care for Sexually Transmitted Infections: How Do We Bring These Services to Scale?

This paper proposes the method to improve the CPU utilization by using precedence evaluation of tentative offspring for the previous method. The previous research proposed the Interleaving Generation Evolutionary Algorithm (IGEA) that generates individuals which parents are evaluated before the evaluation of all individuals completed. IGEA can reduce the execution time for the optimization with EA. We compare the proposed method with the original IGEA and investigate the effectiveness of the proposed method. The experimental results show that the proposed method has higher CPU utilization than the original IGEA.

Video streaming services using Transmission Control Protocol (TCP) as a transport layerprotocol---represented by YouTube---are becoming increasingly popular and,accordingly, have come to account for asignificant portion of Internet traffic. TCP is greedy; that is, it tries to exhaust theentire bandwidth.Thus, video streaming over TCP tends to unnecessarilytake bandwidth from competing traffic. In this paper, we first investigate the data transfer mechanisms of the currentvideo streaming services using TCP and showthat they perform data transfer at much higher rates than the video playback rate.We then propose a new transfer mechanism for video streaming over TCP,one that controls the data transfer ratebased on the network congestion level and the amount of buffered video data at the receiver.Simulation results show that the proposed mechanism has two characteristics lacked bycurrent video streaming over TCP, specifically (1) a low frequency of buffer underflow at the receiverand (2) a lack of excessive bandwidth ``stealing'' from competing traffic.

Video streaming over wireless (networks) has gained popularity in recent times with the development of 3G and 4G mobile networks. The demand and market for video based services is expected to grow substantially in the future. When UDP is used for video streaming, the inherent unreliability of UDP frequently results in corrupted video packets and jitter during video playback. Such an aberration is especially pronounced in wireless networks due to the fading and multipath interference impediments in wireless channels. TCP based video transmission provides reliability at the cost of severely increased delay arising from frequent retransmissions in case of packet error over wireless links and constraints from session and application layers for in-sequence delivery. These delays are substantially worsened in low SNR (signal-to-noise power ratio) wireless environments. Multiple TCP connections, which efficiently utilize the bandwidth of the wireless channel, have been demonstrated to yield significantly improved quality of video streaming over wireless channels while enhancing the reliability of video delivery compared to UDP. In this paper we propose a new scalable hierarchical wavelet decomposition based layered video coding over parallel TCP scheme for reliable video transmission over MIMO wireless channels while reducing the delay and jitter of video streaming.

Video stream is converted to several formats to support the user's device, this conversion process is called video transcoding, which imposes high storage and powerful resources. With emerging of cloud technology, video stream companies adopted to process video on the cloud. Generally, many formats of the same video are made (pre-transcoded) and streamed to the adequate user's device. However, pre-transcoding demands huge storage space and incurs a high-cost to the video stream companies. More importantly, the pre-transcoding of video streams could be hierarchy carried out through different storage types in the cloud. To minimize the storage cost, in this paper, we propose a method to store video streams in the hierarchical storage of the cloud. Particularly, we develop a method to decide which video stream should be pre-transcoded in its suitable cloud storage to minimize the overall cost. Experimental simulation and results show the effectiveness of our approach, specifically, when the percentage of frequently accessed videos is high in repositories, the proposed approach minimizes the overall cost by up to 40 percent.

Panoramic, or 360° video streaming and playback are prime components of mixed-reality and panoramic movie-viewing experiences, they offer an immersive viewing experience, and they are becoming increasingly popular, albeit very resource-demanding. Caching of 360° video content at caches close to the user reduces content delivery delay and bandwidth consumption. In 360° video streaming, the recently proposed tiling approach allows the streaming of different parts (tiles) of the 360° content at different resolutions as opposed to monolithic single-stream transmission.We study the problem of optimal caching of 360° video streams. The difference from conventional video is that each tile may need to be cached simultaneously at multiple resolutions, since it may appear in different positions at different viewports, and the time proportions of these positions are dictated by users' viewing statistics. For example, a tile close to the center of a viewport must have high resolution, while the same tile close to the edge of another viewport can have low resolution. This leads us to a novel caching objective. Cached resolutions for each tile should be as close as possible to the required ones for each tile, according to tile viewing statistics. We study the cases of caching tile streams at different resolutions or in a layered encoding fashion. We seek to optimize an objective that combines (i) an error metric between requested and cached tile resolutions across viewports, and (ii) coverage of the tile set. For the case of multiple resolutions, we show that the problem of selecting the tile resolutions to cache so as to minimize the error metric above is equivalent to the K-Medoids problem. For layered encoding, the problem is to find the maximum-resolution layer to cache for each tile stream, and this is equivalent to a Multiple-Choice Knapsack problem. We present an implementation of the cache optimization scheme, we evaluate our model on a tiled 360° video distribution simulator and demonstrate a significant increase in cache hit ratio over conventional caching strategies.

The integration of computers and communications is able to automate storage, processing and transportation of information. Video information is considered most bulky as it needs high space and consequently high bandwidth for real time playback. Thereby, Video on Demand (VOD) systems are inherently resource intensive and demanding with respect to the performance for continuous playback. The data stream is to be maintained between server and consumer for longer periods once playback of video begins. The restricted bandwidth of all contemporary media and the need to maintain long duration connectivity have been major bottleneck for jitter and breaks free VOD services. In this paper, an analysis and evaluation of buffer requirements for jitter and break free playback of video from a streaming server has been presented. In practice, the ordered delivery of data packets through public domain networks is not guaranteed, which can break the sequential playback of streamed video data. The performance of VOD system thus is critically dependent upon buffer available with the user. The limits and bounds for continuous playback versus buffer and real transmission plan have been illustrated, which have been identified by the authors during their recent research work cited under references. This paper also overviews the video streaming and playback processes for VOD systems and provides for graphical and formal representation of limits and bounds for buffers.

The Active Service Environment Management system (ASEMA) provides best possible multimedia service experience to end user. One of the main aspects of the ASEMA is to provide a variable live streaming service to the end users of the ASEMA. The ASEMA implements this through dynamic change in the properties of the video stream delivered to the end user's end device. The live video stream used in the ASEMA is delivered to the end users is in MPEG 4 video format. The video itself is streamed on top of the real time protocol (RTP) and the parameters are negotiated with the real time streaming protocol (RTSP) before the streaming commences. The research problem of this is to provide easy solution for QoS measurements in networks that are closed nature. The research is based on the constructive method of the related publications and the results are deducted from the constructed quality of service management of the ASEMA system. The management is founded on the measuring of the receiving and sending bit rate values in both ends, in the sending end and in the receiving end. If a fluctuation in the values are detected the video stream's properties are changed dynamically.