Adaptive energy-efficient and QoE-aware optimization method for mobile video services

The integration of people devices and services through the use of Machine-to-Machine technology has been, and will continue to be for the foreseeable future, an important economic trend. Mobile video services have become more convenient with respect to mobility, but the quality of the video they produce is limited. In this study, an integrated video service framework "DMCT-S" based on Machine-to-Machine communications is proposed, in which a mobile video service can be integrated into a home video service. In the integrated framework, people can easily watch a low-quality video from a mobile service and transfer the video playing context to another video service to continue the twin high-quality video with same content played in a smart home. This seamless and integrated framework results in vastly increased people convenience.

International audience

Video communication requires sufficient resources to obtain the desired image quality. Availability of bandwidth and screen resolution from different devices on the client end, as well as compression techniques used for transmission also significantly influence to the video quality. Even though the H.264/AVC video compression standard and its scalable extension is known as Scalable Video Coding (SVC) was introduced and successfully addressed the challenge, some weaknesses persist especially for high-resolution video transmissions. The size of the bitstream generated by the SVC standard for ultra-high resolution video compression can only be met if transmitted on a network with a large bandwidth. The Scalable High-Efficiency Video Coding (SHVC) were introduced to overcome problems in the SVC standards. The new video compression standard is proven to reduce bandwidth requirements by up to 46.41 % compared to the SVC standards for the same video quality. This study introduces the performance analysis of SHVC standard video transmission as compared to SVC standard. Both compression standards are transmitted and emulated through network emulator called Mininet-Wifi to get the real transmission picture. The client-server video transmission scheme with different bandwidth and various client position are set in the experiment scenario. It is found that transmission time, packet loss, and video reconstruction quality on scalable video transmission with SHVC standard is better than scalable video transmissions with SVC standard.

Scalable video coding (SVC) has aroused a wide interest in the areas of video coding and transmission technology, since it provides desirable features for heterogeneous error-prone network environments. The layered video structure allows not only adaptation to the available bandwidth but also a device adaptation capability via multiple decodable sub-streams. In this paper, we focus on SVC Medium- Grain Scalability (MGS) and investigate the end user's quality of experience (QoE) in error-prone transmission conditions. We describe our error detection and concealment implementation on the JSVM 9.15 reference decoder and assess its effectiveness through several quality indicators. Results show an improvement of the proposed concealment strategy when compared to the standard Frame Copy (FC) and Interpolation, in terms of Peak Signal-to-Signal Noise Ratio (PSNR) and Structural Similarity Index Metric (SSIM) quality metrics. This improvement is evident in the case of concealment on quality enhancement layers, since video fluidity is preserved assuring an acceptable QoE to the end users.

This paper describes the design and implementation of a multimedia home gateway for threescreen television (3STV) service. The proposed in-home wireless network uses scalable video coding (SVC) and unequal error protection with Raptor forward error correction (FEC) for maximizing the quality of experience (QoE) over the variable-bandwidth, error-prone wireless network. The gateway incorporates (a) dynamic SVC layerswitching, which enables the server to perform selecting appropriate layers from SVC bitstreams, (b) adaptive Raptor FEC, which controls the overhead of Raptor FEC according to packet loss rate (PLR), (c) an efficient combination of (a) and (b), and (d) slice group-based selective streaming in the overall gateway architecture. The paper explains the home gateway architecture as well as experiments for performance evaluation as compared to that of traditional SVC streaming. In the experiments conducted, gains in video quality vary from 2 to 5dB in peak signal-to-noise ratio (PSNR), with corresponding subjective improvements. Overall reductions of bit rate at the input to the home gateway vary from 28% to 36% <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> .

HTTP adaptive streaming (HAS) is a state-of-the-art technology for video streaming. Optimal adaptive streaming schemes should be designed to maximize the quality of experience (QoE) in network environments with unstable bandwidths such as wireless networks. QoE is degraded for Advanced Video Coding (AVC)-based HAS due to frequent quality switching and rebuffering in wireless networks. Meanwhile, Scalable Video Coding (SVC)-based HAS can maximize the QoE by flexibly requesting the base layer (BL) and enhancement layer (EL) based on variable network conditions. However, in SVC-based HAS, the required bandwidth is significantly high due to the encoding overhead. In this paper, we propose a layer-assisted video quality adaptation for improving QoE in wireless networks. The proposed scheme employs a video encoding method, composed of multiple BLs and ELs, using both AVC and SVC. The quality of the BL is determined using the buffer occupancy level and measured bandwidth to minimize rebuffering. The quality of the EL is determined using the buffer region and segment quality differences to minimize instability. enhancement dummy (ED) consists of the selected ELs. The layer scheduler decides the segment that is to be requested based on the QoE model according to the BL and ED to maximize the QoE. Experimental results show that the proposed scheme achieves high QoE compared to the existing schemes because the instability is low and no rebuffering occurs.

The growing demand on video streaming services is the main motive power for video quality assessment. Due to the rapid development of video streaming services, customers are more enjoying higher quality videos, and their perceptions on video service will directly influence the service provider's performance, which makes it significant to study end-users' subjective perception, named as Quality of Experience (QoE), on video streaming for both service providers and end-users. In this paper, a QoE evaluation model is proposed to predict the end-users' perception on video streaming service considering different video content types. This QoE model, named as Video-Mean Opinion Score (VMOS) model, directly focuses on end-users' feeling. Thus, the Key Performance Indicators (KPIs), which can be straightly felt by end-users, are mapped to QoE score without considering the network parameters. The excellent performance of VMOS model for QoE evaluation on video quality has been verified via plenty subjective Mean Opinion Score (MOS) test, which includes 180 video samples with 1280 valid votes. The Pearson Correlation Coefficient between VMOS score and MOS is as high as 0.925, which indicates that this model can evaluate users' perception on video quality with almost the same accuracy as subjective test.

The transmission of video data is a major part of traffic on today's Internet. Since the Internet is a highly dynamic environment, quality adaptation is essential in matching user device resources with the streamed video quality. This can be achieved by applying mechanisms that follow the Scalable Video Coding (SVC) standard, which enables scalability of the video quality in multiple dimensions. In SVC-based streaming, adaptation decisions have long been driven by Quality of Service (QoS) metrics, such as throughput. However, these metrics do not well match the way human users perceive video quality. Therefore, in this paper, the classical SVC-based video streaming approach is expanded to consider Quality of Experience (QoE) for adaptation decisions. The video quality is assessed using existing objective techniques with a high correlation to the human perception. The approach is evaluated in context of a P2P-based Video-on-Demand (VoD) system and shows that by making peers favor always layers with a high estimated QoE but not necessarily high bandwidth requirements, the performance of the entire system can be enhanced in terms of playback delay and SVC video quality by up to 20%. At the same time, content providers are able to reduce up to 60 of their server costs, compared to the classical QoS-based approach.

The growing consumer demand for mobile video services is one of the key drivers of the evolution of new wireless multimedia solutions requiring exploration of new ways to optimize future wireless networks for video services towards delivering enhanced quality of experience (QoE). One of these key video enhancing solutions is HTTP adaptive streaming (HAS), which has recently been spreading as a form of Internet video delivery and is expected to be deployed more broadly over the next few years. As a relatively new technology in comparison with traditional push-based adaptive streaming techniques, deployment of HAS presents new challenges and opportunities for content developers, service providers, network operators and device manufacturers. One of these important challenges is developing evaluation methodologies and performance metrics to accurately assess user QoE for HAS services, and effectively utilizing these metrics for service provisioning and optimizing network adaptation. In that vein, this article provides an overview of HAS concepts, and reviews the recently standardized QoE metrics and reporting framework in 3GPP. Furthermore, we present an end-to-end QoE evaluation study on HAS conducted over 3GPP LTE networks and conclude with a discussion of future challenges and opportunities in QoE optimization for HAS services.

Current digital video applications require delivery of digital video content to different clients over heterogeneous networks. These clients may have different system resources and bandwidth capabilities. Thus, delivering of digital video data compressed at specific spatial resolution, quality levels, frame rates and encoding those video data at specific bit rates according to the client resources and the available network is essential. The characteristics of current video transmission system pose many problems for video delivery and scalable video coding is a highly attractive solution. This thesis investigates the existing video coding standards, especially the newest H.264/advanced video coding and its scalable extension: scalable video coding. In this thesis, we address two issues related to the state-of-the-art scalable video coding: 1) computational complexity reduction; and 2) video coding efficiency enhancement. In the first part of this thesis, we address the complexity issue of spatial, signal-to-noise ratio (SNR), temporal and combined scalable video coding. Our goal is to find a good tradeoff between computational complexity and video coding efficiency. We first establish the need to reduce computational complexity for current H.264/advanced video coding and scalable video coding framework. We then evaluate the mode distribution correlations between the base layer and its enhancement layers for different video scalabilities. After the exhaustive search over all possible block partitions is performed at the base layer, the number of candidate modes for luma and chroma blocks in a macroblock that take part in rate distortion optimization calculation at enhancement layers could be greatly reduced based on the correlations. Finally, adaptive fast mode decision schemes for spatial, SNR and temporal scalable video coding are presented. Our schemes could achieve consistent and significant computational complexity reduction with negligible loss in objective and subjective video quality and insignificant increments in bit rate consumption. The second part of this thesis is to provide a solution for the problem of high computational complexity of scalable video decoders. An adaptive encoding algorithm is proposed to reduce decoder complexity in coarse grain SNR scalable video coding.

As the demand for mobile services grows exponentially, the focus on wireless network optimization has been changed from Quality of Service (QoS) for the network to Quality of Experience (QoE) for users. The network optimization research about QoS in the past cannot surely meet the requirements of the users' QoE. Therefore, in this paper, a handover solution is proposed to improve the QoE while considering the QoE balance for a LTE network that provides different services. Compared with other optimization of QoE nowadays, the proposed solution balances and improves the QoE of users. The proposed solution controls handover parameter by running a handover optimization algorithm based on the dynamic particle swarm optimization (DPSO) in a central controller, which finally optimizes the overall QoE and reduces the proportion of users with extremely poor QoE. The simulation results show that the DPSO algorithm ensures the quality of the solution and increases the speed of convergence by nearly twice that of the standard particle swarm optimization algorithm (SPSO). After adopting the DPSO handover solution, the overall QoE of users is increased by 6.22 % and 4.59 % while the variance of users' QoE is decreased by 14.2 % and 22.6 %, compared with the full handover solution and the traditional handover solution respectively. The number of users with QoE less than 1.9 is reduced to 0 with the proposed solution.

This paper presents a novel web-based crowdsourcing platform for the assessment of the subjective and objective quality of experience (QoE) of the video service in the cloud-server environment. The user has the option to enter subjective QoE data for video service by filling out a web questionnaire. The objective QoE data of the cloud-server, network condition, and the user device is automatically captured by the crowdsourcing platform. Our proposed system collects both objective and subjective QoE simultaneously in real-time. The paper presents the key technologies used in the development of the platform and describes the functional requirements and design ideas of the system in detail. The system collects real-time comprehensive data to enhance the quality of the user experience to provide a valuable reference. The system is tested in a real-time environment and the test results are given in terms of the system performance. The crowdsourcing platform has new features of real-time network monitoring, the client device, and cloud monitoring, which currently has not been provided by existing web platforms and crowdsourcing frameworks. The results show that 1MB buffer is filled 100% very soon after starting watching videos from the crowdsourcing platform.

The digital set-top box (STB) has evolved to provide not only broadcast channel videos to TV watchers but also streaming videos to mobile device users. The users connected to a STB may request the same video content with disparate bitrate requirements. In this case, applying the conventional multicast or unicast technique causes a waste of transmission bandwidth. To resolve this problem, in this study we realized a novel hybrid multicast and unicast video streaming system. The unicast service was based on MPEG-DASH (Dynamic Adaptive Streaming over Hypertext Transfer Protocol). For multirate streamed users, we incorporated the H.264 SVC (Scalable Video Coding) for bitrate adaptation into the multicast groups under the FLUTE (File Delivery over Unidirectional Transport) protocol. Furthermore, we optimized the system performance that intelligently determined the transmitted video segment and quality level according to the bandwidth efficiency and the marginal quality benefit to users. Simulation results showed that the proposed algorithm effectively reduced the waiting time and enhanced the received video quality of mobile device users.

The measurements of Quality of Experience (QoE) are essential to research for better analysis and optimization of Multi-View and 3D (MV/3D) videos. However, there is a lack of systematic description of QoE mechanism in MV/3D videos yet. This paper aims to give a comprehensive account of QoE assessment and management for MV/3D video services. We first conclude distinctive QoE influencing factors (IFs) in MV/3D videos by dividing them into immersion and interaction related IFs. Then the methods of QoE assessment in MV/3D video services (including subjective assessment and objective assessment) are presented. Finally, we summarize QoE management for improving immersion and interaction. We hope our work is capable of providing a useful guideline on the related issues and the future research directions in MV/3D video services.KeywordsQuality of Experience (QoE)Multi-View Video (MVV)3D video

Introduction and penetration of high-speed and innovative mobile data services including social media and video services have been increasing significantly across the globe. This growth is driven by deployment and availability of capable and affordable mobile networks and smartphones. These trends have also been observed in Ethiopia as the country’s sole incumbent operator ethio telecom has expanded coverage and capacity of its mobile data network, especially for universal mobile telecommunications system (UMTS) network. The successful provision of these innovative services requires mobile operators to have continuous monitoring of the quality of their networks and customer satisfaction. To that end, this monitoring allows the operator to make timely network optimization, marketing and other relevant decisions that enhance service quality. Traditionally measurement and analysis of network quality of service (QoS) is performed using data from network management system (NMS) and drive/walk test (DT/WT). In recent times, the usage QoS data from crowdsourcing (CS) is also emerging as useful monitoring tool. However, all these methods do not fully capture users’ quality of experience (QoE), which is a function of not only network QoS but also other factors including subjective users’ technical literacy and opinion. As a result, operators have recently provided attention not only for QoS but also QoE. Yet, most quality related analyses are performed using data from only subjective survey, NMS, DT/WT, or CS. It is not straightforward to find quality investigation based on data from all the methods. More importantly, such quality investigation has not been made in the context of Ethiopia’s mobile market. In this paper, we perform QoS and QoE evaluation for UMTS mobile data service based on quality data from all NMS, WT, CS and subjective survey for a business area in Addis Ababa. The evaluation is made using downlink user throughput and mean opinion score (MOS) metrics. The obtained 50th percentile throughput results from NMS, WT and CS are good enough for web browsing and offline video streaming but not for high definition (HD) video calls and live HD video streaming. Furthermore, CS provides optimistic results compared to NMS and WT and its 90th percentile throughput is very good even for live HD video streaming. Moreover, the obtained MOS results from subjective survey almost fit to the QoS results, thus indicating that the network QoS is a significant contributor to users’ perceived QoE.