Buffer Based Adaptation Using Scalable Video Coding for 360-Degree Video Streaming over NDN

Live and on-demand video streaming service systems consume significant portion of Internet traffic all over the world. HTTP adaptive streaming is becoming the de-facto standard for adaptive video streaming solutions. Conventional estimation scheme for bandwidth estimation is not appropriate to estimate the bandwidth when multiple clients compete for a common bottleneck link, due to the ON–OFF traffic pattern. They overestimate the network bandwidth which leads to degradation of quality of experience by unnecessary changes in video quality, average video quality and unfairness of video quality. In this paper, we proposed receiver-side bandwidth-measured method to achieve a better quality of experience in multiple-client scenario. The proposed method estimates the obtainable network bandwidth based on the buffer status and segment throughput. The video buffer model is associated with three thresholds (i.e., one for initial start-up and two for operating thresholds). NS-3 network simulator has been deployed to measure the performance of HTTP adaptive streaming. Simulation outputs reflect that the proposed method enhances the quality of experience than conventional methods.

The rapid growth of user expectations and network technologies has proliferated the service needs of 360-degree video streaming. In the light of the unprecedented bitrates required to deliver entire 360-degree videos, tile-based streaming, which associates viewport and non-viewport tiles with different qualities, has emerged as a promising way to facilitate 360-degree video streaming in practice. Existing work on viewport prediction primarily targets prediction accuracy, which potentially gives rise to excessive computational overhead and latency. In this paper, we propose a sinusoidal viewport prediction (SVP) system for 360-degree video streaming to overcome the aforementioned issues. In particular, the SVP system leverages 1) sinusoidal values of rotation angles to predict orientation, 2) the relationship between prediction errors, prediction time window and head movement velocities to improve the prediction accuracy, and 3) the normalized viewing probabilities of tiles to further improve adaptive bitrate (ABR) streaming performance. To evaluate the performance of the SVP system, we conduct extensive simulations based on real-world datasets. Simulation results demonstrate that the SVP system outperforms state-of-the-art schemes under various buffer thresholds and bandwidth settings in terms of viewport prediction accuracy and video quality, revealing its applicability to both live and video-on-demand streaming in practical scenarios.

Smartphones have recently become a popular platform for deploying the computation-intensive virtual reality (VR) applications, such as immersive video streaming (a.k.a., 360-degree video streaming). One specific challenge involving the smartphone-based head mounted display (HMD) is to reduce the potentially huge power consumption caused by the immersive video. To address this challenge, we first conduct an empirical power measurement study on a typical smartphone immersive streaming system, which identifies the major power consumption sources. Then, we develop QuRate, a quality-aware and user-centric frame rate adaptation mechanism to tackle the power consumption issue in immersive video streaming. QuRate optimizes the immersive video power consumption by modeling the correlation between the perceivable video quality and the user behavior. Specifically, QuRate builds on top of the user's reduced level of concentration on the video frames during view switching and dynamically adjusts the frame rate without impacting the perceivable video quality. We evaluate QuRate with a comprehensive set of experiments involving 5 smartphones, 21 users, and 6 immersive videos using empirical user head movement traces. Our experimental results demonstrate that QuRate is capable of extending the smartphone battery life by up to 1.24X while maintaining the perceivable video quality during immersive video streaming. Also, we conduct an Institutional Review Board (IRB)-approved subjective user study to further validate the minimum video quality impact caused by QuRate.

By using a data-driven communication pattern other than location-driven pattern, Named Data Networking (NDN) offers better support for content distribution applications such as video playback application. We propose NDNlive, which exploits the features of NDN to stream live and prerecorded video captured by the camera to multiple players. Instead of fixed-size segmentation, NDNlive chops video stream into frames which are the Application Data Units (ADU)—units of information represented in a most suitable form. NDNlive adopts different data retrieval strategies for the audio, video content and the media metadata according to their data properties and different data generation patterns. NDNlive can tolerate small network problems thanks to the flexibility provided by the frame fetch pipelining strategy. We have deployed NDNlive over the world-wide NDN Testbed. Our experiments show that NDNlive can provide fluent and synchronized video streaming across 11 time zones in the worldwide. This case study gives plenty of details in design, implementation and measurement, which can be regarded as a tutorial to study NDN applications.

Data centers consume significant amounts of energy, contributing indirectly to environmental pollution through greenhouse gas emissions during electricity generation. According to the Natural Resources Defense Council, information and communication technologies and networks account for roughly 10% of global energy consumption. Reducing power consumption in Data Center Networks (DCNs) is crucial, especially given that many data center components operate at full capacity even under low traffic conditions, resulting in high costs for both service providers and consumers. Current solutions often prioritize power optimization without considering Quality of Service (QoS). Services such as video streaming and Voice over IP (VoIP) are particularly sensitive to loss or delay and require QoS to be maintained below certain thresholds. This paper introduces a novel framework called QoS-Aware Power-Optimized Path Selection (Q-PoPS) for software-defined DCNs. The objective of Q-PoPS is to minimize DCN power consumption while ensuring that an acceptable QoS is provided, meeting the requirements of DCN services. This paper describes the implementation of a prototype for the Q-PoPS framework that leverages the POX Software-Defined Networking (SDN) controller. The performance of the prototype is evaluated using the Mininet emulator. Our findings demonstrate the performance of the proposed Q-PoPS algorithm in three scenarios. Best-case: Enhancing real-time traffic protocol quality without increasing power consumption. midrange-case: Replacing bottleneck links while preserving real-time traffic quality. Worst-case: Identifying new paths that may increase power consumption but maintain real-time traffic quality. This paper underscores the need for a holistic approach to DCN management, optimizing both power consumption and QoS for critical real-time applications. We present the Q-PoPS framework as evidence that such an approach is achievable.

Tile-based 360-degree video (360 video) streaming, employed with adaptive bitrate (ABR) algorithms, is a promising approach to offer high video quality of experience (QoE) within limited network bandwidth. Existing ABR algorithms, however, fail to achieve optimal performance in real-world fluctuated network conditions as they heavily rely on unbiased bandwidth predictions. Recently, reinforcement learning (RL) has shown promising potential in generating better ABR algorithms in 2D video streaming. However, unlike existed work in 2D video streaming, directly applying RL in the tile-based 360 video streaming is infeasible due to the resulting exponential decision space. To overcome these limitations, we propose in this paper 360SRL, an improved ABR algorithm employing Sequential RL (360SRL). Firstly, we reduce the decision space of 360SRL from exponential to linear by introducing a sequential ABR decision structure, thus making it feasible to be employed with RL. Secondly, instead of relying on accurate bandwidth predictions, 360SRL learns to make ABR decisions solely through observations of the resulting QoE performance of past decisions. Finally, we compare 360SRL to state-of-the-art ABR algorithms using trace-driven experiments. The experiment results demonstrate that 360SRL outperforms state-of-the-art algorithms with around 12% improvement in average QoE.

Lately, HTTP Adaptive Streaming (HAS) has become dominant among different video streaming techniques. However, owing to the unpredictable nature of the wireless radio channel and device mobility, using HAS over mobile wireless networks is still very challenging. In this paper, we propose a novel Quality of Experience (QoE) optimization mechanism for HAS in the context of mobile wireless networks. The proposed mechanism leverages recent advances in HAS specification, which includes new features for QoE measurements and reporting. First, we formulate a discrete optimization problem aiming at maximizing the overall average quality, and minimizing the negative impact of temporal video quality changes for all HAS users simultaneously. Second, in order to take advantage of well-known continuous optimization techniques and to decrease the computational complexity, we convert the formulated problem into a continuous form, and propose a gradient based algorithm to solve the continuous optimization problem. The results of our simulations demonstrate that our system attained better perceived video quality by almost 8% on average, while lowering the freezing period by 20% on average across HAS users when compared to other approaches where HAS users only rely on local adaptation logics.

Digital compression methods based on MPEG2 are now in widespread use for broadcasting of video content. Multiple television and radio programs can be multiplexed and transmitted altogether within the same bandwidth where formerly only one analog program fit. With the analog television video quality was very much a matter of the transmission chain and all the elements along the line. Once a sufficiently high video quality level was achieved, it was nearly independent from the content. In using digital compression and transmission techniques the video quality is now strongly content and compression dependent. The changes in video quality can be very abrupt from scene to scene. A method that is capable of following all these changes in real time and displaying the picture quality, as a function of time, is required for continuous video quality monitoring. — This paper describes a single ended method that does not require a reference signal and is capable of processing the video in real time concerning picture deficiencies of a compressed video.

The 360-degree video streaming has higher bandwidth requirements compared with traditional video to achieve the same user-perceived playback quality. Since users only view part of the entire videos, viewport-adaptive streaming is an effective approach to guarantee video quality. However, the performance of viewport-adaptive schemes is highly dependent on the bandwidth estimation and viewport prediction. To overcome these issues, we propose a novel reinforcement learning (RL) based viewport-adaptive streaming framework called RLVA, which optimizes the 360-degree video streaming in viewport prediction, prefetch scheduling and rate adaptation. Firstly, RLVA adopts t location-scale distribution rather than Gaussian distribution to describe the viewport prediction error characteristic more accurately and achieve the tile viewing probability based on the distribution. Besides, a tile prefetch scheduling algorithm is proposed to update the tiles according to the latest prediction results, which further reduces the adverse effect of prediction error. Furthermore, the tile viewing probabilities are treated as input status of RL algorithm. In this way, RL can adjust its policy to adapt to both of the network conditions and viewport prediction error. Through extensive evaluations, the simulation results show that the proposed RLVA outperforms other viewport-adaptive methods by about 4.8%-66.8% improvement of Quality of Experience (QoE) and effectively reduces the impact of viewport prediction errors.

The increasing popularity of virtual reality and 360-degree video streaming has created a demand for streaming high-quality video content over cellular networks. However, streaming 360-degree videos over cellular networks poses a challenge due to the need for ultra-low latency and high bandwidth. Although viewport adaptive streaming presents a promising solution to reduce the bandwidth requirement of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$360^{\circ }$</tex-math></inline-formula> video, it remains challenging to predict the Field of View (FoV) due to the adverse impact of prediction errors on the user's Quality of Experience (QoE). Moreover, bitrate adaptation gets complicated due to <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$360^{\circ }$</tex-math></inline-formula> videos and the dynamic nature of the cellular network. Therefore, in this paper, we propose an intelligent framework, termed Seer, to fully realize <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$360^{\circ }$</tex-math></inline-formula> video streaming over cellular networks by leveraging Multi-access Edge Computing (MEC). It incorporates an FoV prediction scheme and a bitrate adaptation policy into the MEC platform. In particular, the FoV prediction scheme uses perceived video features coupled with time-series based viewport prediction to achieve higher prediction accuracy. For an effective bitrate selection in cellular network conditions, a Reinforcement Learning (RL) based bitrate adaptation policy is further employed. The results demonstrate that Seer's FoV prediction scheme delivers higher prediction accuracy, while the streaming framework significantly reduces the bandwidth requirements and improves the user's QoE.

The number of data centers has been increased for various reasons such as cloud computing, big-data analysis, multimedia service, etc. With public interests on data center, many novel technologies for data center networks have been proposed and deployed to support data center operations more efficiently and effectively. However, the construction of data center network incurs significant costs. Moreover, various technologies interplay each other to achieve multiple objectives, and it makes difficult to validate and/or verify characteristics of data center network. In addition, it difficult to perform experiments with a number of hosts and switches. Therefore, it is necessary to observe the characteristics of target data center network before building it. A common approach to evaluate data center is to run simulations that should be similar with real-world data center environment. However, generating traffic with the characteristics of data center networks is not matured yet. People still employ a traffic generator based on the characteristics of Internet traffic. We design a traffic generator that shows more accurate characteristics of data center network traffic. Various traffic characteristics exploited explored by several studies are considered. The proposed method generates flow-level network traffic matrix based on Poisson Shot-Noise model. We implemented the traffic generator using Python programming language to create traffic matrix. To evaluate the proposed method, we compare the results with real data center network traffic. Our results show that the generated traffic owns similar characteristics with the real network traffic in terms of flow size, duration, and the mean and variance of total traffic rate.

The large expansion in network services and applications seen in the last few years requires new network architectures to satisfy an increasing number of users and enhance content delivery. Named Data Networking (NDN) has recently appeared as a new paradigm to solve many shortcomings in the current TCP/IP architecture. Its main characteristics like stateful forwarding and in-network caching made NDN networks an efficient environment for data delivery where the data is retrieved based on content names rather than IP addresses. The NDN, by its nature, defends against the well-known Distributed Denial of Service (DDoS) attacks that take place in the traditional TCP/IP architecture. However, a special kind of DoS attack called Collusive Interest Flooding Attack (CIFA) has appeared to overwhelm the resources of NDN routers by filling their Pending Interest Tables (PIT) with long-lasting malicious entries. The network throughput and consumer satisfaction rate are highly affected by CIFA. A lightweight yet efficient stateless CIFA detection algorithm is proposed in this research utilizing the non-parametric CUSUM algorithm; a change point detection approach that detects the point in time when a transition occurs in the network. The proposed algorithm is characterized by its low computational overhead, highly accurate detection, and quick response. To detect the malicious name prefixes and eliminate the CIFA effect, a mitigation algorithm that uses the average response time vales of all name prefixes is proposed in this research. Experimental results show that this approach detects CIFA after 199.5 ms from when an attack is launched in the large-scale topology. In addition, the mitigation approach effectively reduces the PIT utilization and increases the average consumer satisfaction rate.

Research in Information-Centric Networking (ICN) and Named Data Networking (NDN) has produced many protocol designs and software prototypes, but they need to be validated and evaluated by real usage on the Internet, which is also critical to the realization of the ICN/NDN vision in the long run. This article presents the first Internet-scale adaptive video streaming service over NDN, which allows regular users to watch videos using NDN technology with no software installation or manual configuration. Since mid-2019, the official NDN website [1] has started using our service to deliver its videos to Internet users over the global NDN testbed, showcasing the feasibility of NDN. We conduct real-world experiments on the NDN testbed to validate the proper implementation of the client, network, and server sides of the proposed system and also evaluate the performance of our video streaming service.

Virtual reality and 360-degree video streaming are growing rapidly; however, streaming 360-degree video is very challenging due to high bandwidth requirements. To address this problem, the video quality is adjusted according to the user viewport prediction. High quality video is only streamed for the user viewport, reducing the overall bandwidth consumption. Existing solutions use shallow buffers limited by the accuracy of viewport prediction. Therefore, playback is prone to video freezes which are very destructive for the Quality of Experience (QoE). We propose using layered encoding for 360-degree video to improve QoE by reducing the probability of video freezes and the latency of response to the user head movements. Moreover, this scheme reduces the storage requirements significantly and improves in-network cache performance.

In the tile-based 360-degree video streaming, predicting user's future viewpoints and developing adaptive bitrate (ABR) algorithms are essential for optimizing user's quality of experience (QoE). Traditional single-user based viewpoint prediction methods fail to achieve good performance in long-term prediction, and the recently proposed reinforcement learning (RL) based ABR schemes applied in traditional video streaming can not be directly applied in the tile-based 360-degree video streaming due to the exponential action space. Therefore, we propose a sequential reinforced 360-degree video streaming scheme with cross-user attentive network. Firstly, considering different users may have the similar viewing preference on the same video, we propose a cross-user attentive network (CUAN), boosting the performance of long-term viewpoint prediction by selectively utilizing cross-user information. Secondly, we propose a sequential RL-based (360SRL) ABR approach, transforming action space size of each decision step from exponential to linear via introducing a sequential decision structure. We evaluate the proposed CUAN and 360SRL using trace-driven experiments and experimental results demonstrate that CUAN and 360SRL outperform existing viewpoint prediction and ABR approaches with a noticeable margin.