Edge Intelligence for Energy-Efficient Computation Offloading and Resource Allocation in 5G Beyond

Computation offloading services provide required computing resources for vehicles with computation-intensive tasks. Past computation offloading research mainly focused on mobile edge computing (MEC) or cloud computing, separately. This paper presents a collaborative approach based on MEC and cloud computing that offloads services to automobiles in vehicular networks. A cloud-MEC collaborative computation offloading problem is formulated through jointly optimizing computation offloading decision and computation resource allocation. Since the problem is non-convex and NP-hard, we propose a collaborative computation offloading and resource allocation optimization (CCORAO) scheme, and design a distributed computation offloading and resource allocation algorithm for CCORAO scheme that achieves the optimal solution. The simulation results show that the proposed algorithm can effectively improve the system utility and computation time, especially for the scenario where the MEC servers fail to meet demands due to insufficient computation resources.

Vehicle Edge Computing (VEC) leverages compact cloud computing at the mobile network edge to meet the processing and latency needs of vehicles. By bringing computation closer to the vehicles, VEC reduces data transmission, minimizes latency, and boosts performance for compute-intensive applications. However, during peak hours of urban road traffic, the scarce computational resources available at edge servers could pose challenges in fulfilling the processing needs of vehicles. Introducing Unmanned Aerial Vehicles (UAVs) as supplementary edge computing nodes could significantly mitigate the aforementioned issue. In this paper, we propose a flexible edge computing framework in which a fleet of UAVs function as mobile computational service providers, offering computation offloading services to multiple vehicles. We design and optimize a computation offloading model for the UAV-enabled vehicle edge computing environment. The proposed model tackles the task offloading challenge, aiming to optimize UAV revenue and task processing efficiency while considering the constraints of UAVs’ restricted computational power and energy resources. Towards this end, our model jointly considers two key factors: task partitioning and computational resource allocation. To tackle the challenges posed by the aforementioned non-convex optimization problem, we construct a Markov Decision Process (MDP) model for the multi-UAV-enabled mobile edge computing system and introduce an innovative Multi-Agent Deep Reinforcement Learning (MADRL) framework addressing the decision-making challenge represented by MDP model. Comprehensive simulation outcomes illustrate that our devised task offloading technique outperforms other optimization methods.

In this paper, we study the joint computation offloading and resource allocation problem in the two-tier wireless heterogeneous network (HetNet). Our design aims to optimize the computation offloading to the cloud jointly with the subchannel allocation to minimize the maximum (min-max) weighted energy consumption subject to practical constraints on bandwidth, computing resource and allowable latency for the multi-user multitask computation system. To tackle this non-convex mixed integer non-linear problem (MINLP), we employ the bisection search method to solve it where we propose a novel approach to transform and verify the feasibility of the underlying problem in each iteration. In addition, we propose a low-complexity algorithm, which can decrease the number of binary optimization variables and enable more scalable computation offloading optimization in the practical wireless HetNets. Numerical studies confirm that the proposed design achieves the energy saving gains about 55% in comparison with the local computation scheme under the strict required latency of 0.1s.

In the current fifth-generation (5G) and Beyond 5G (B5G) era, the Unmanned Aerial Vehicles (UAVs) have been playing a vital role and attracting interest in different application areas in the military, and civil applications such as communications, disaster management, search and rescue, security, control, agriculture, Internet of things (IoT), etc. In these networks, ultra-heterogeneous IoT devices generate time-sensitive traffic. However, those devices have limited resources to compute tasks. Recently, Mobile Edge Computation Offloading (MECO) has been considered as an encouraging model to enable the computation tasks of IoT devices to be performed by MEC servers and support ultra-low latency IoT applications to ensure Quality of services (QoS). However, terrestrial network failure due to natural and human-made disasters has been increasing, and difficult to provide reliable computation offloading and resource allocation services to IoT networks. Nowadays, UAVs have been promising technology to quickly deploy and recover the system to provide efficient services to edge nodes. The offloading and resource allocation problems in current network technology are complex, and offloading task to edge server is vulnerable to security risks. Hence, we utilize a deep reinforcement learning method to handle a complex problem for computation offloading and resource allocations in a dynamic environment. And also, we explore a blockchain-based multi-UAV-assisted MEC architecture in securing and optimizing the offloading problems.

Multi-unmanned aerial vehicle (UAV)-assisted communication is a critical technology for the low-altitude economy, supporting applications from logistics to emergency response. Semantic communication effectively enhances transmission efficiency and improves the communication performance of multi-UAV-assisted systems. Existing research on multi-UAV semantic communication networks predominantly assumes static ground devices, overlooking computation offloading and resource allocation challenges when ground devices are mobile. This overlooks the critical challenge of dynamically managing computation offloading and resources for mobile users, whose varying channel conditions and semantic compression needs directly impact system performance. To address this gap, this paper proposes a multi-UAV-assisted semantic communication model that novelly integrates user mobility with adaptive semantic compression, formulating a joint optimization problem for computation offloading and resource allocation. The objective is to minimize the maximum task processing latency through the joint optimization of UAV–device association, UAV trajectories, transmission power, task offloading ratios, and semantic compression depth. To solve this problem, we design a MAPPO-APSO algorithm integrating alternating iteration, multi-agent proximal policy optimization (MAPPO), and adaptive particle swarm optimization (APSO). Simulation results demonstrate that the proposed algorithm reduces the maximum task latency and system energy consumption by up to 20.7% and 16.1%, respectively, while maintaining transmission performance and outperforming benchmark approaches.

Computation offloading via device-to-device communications can improve the performance of mobile edge computing by exploiting the computing resources of user devices. However, most proposed optimization-based computation offloading schemes lack self-adaptive abilities in dynamic environments due to time-varying wireless environment, continuous-discrete mixed actions, and coordination among devices. The conventional reinforcement learning based approaches are not effective for solving an optimal sequential decision problem with continuous-discrete mixed actions. In this paper, we propose a hierarchical deep reinforcement learning (HDRL) framework to solve the joint computation offloading and resource allocation problem. The proposed HDRL framework has a hierarchical actor-critic architecture with a meta critic, multiple basic critics and actors. Specifically, a combination of deep Q-network (DQN) and deep deterministic policy gradient (DDPG) is exploited to cope with the continuous-discrete mixed action spaces. Furthermore, to handle the coordination among devices, the meta critic acts as a DQN to output the joint discrete action of all devices and each basic critic acts as the critic part of DDPG to evaluate the output of the corresponding actor. Simulation results show that the proposed HDRL algorithm can significantly reduce the task computation latency compared with baseline offloading schemes.

Collaborative computation offloading and wireless charging scheduling in multi-UAV-assisted MEC networks: A TD3-based approach

In this paper, we propose a double-edge-assisted computation offloading and resource allocation scheme tailored for space-air-marine integrated networks (SAMINs). Specifically, we consider a scenario where both unmanned aerial vehicles (UAVs) and a low earth orbit (LEO) satellite are equipped with edge servers, providing computing services for maritime autonomous surface ships (MASSs). Partial computation workloads of MASSs can be offloaded to both UAVs and the LEO satellite, concurrently, for processing via a multi-access approach. To minimize the energy consumption of SAMINs under latency constraints, we formulate an optimization problem and propose energy efficient algorithms to jointly optimize offloading mode, offloading volume, and computing resource allocation of the LEO satellite and the UAVs, respectively. We further exploit an alternating optimization (AO) method and a layered approach to decompose the original problem to attain the optimal solutions. Finally, we conduct simulations to validate the effectiveness and efficiency of the proposed scheme in comparison with benchmark algorithms.

Application-aware computation offloading in edge computing networks

In Industrial Internet of Things (IIoT), in order to satisfy the requirements of delay-sensitive service, devices with limited computing resources could offload computing task to edge server via wireless network. However, limited spectrum resource restricts the computation offloading of massive devices and may cause high transmission delay. Non-orthogonal multiple access (NOMA) is a promising technique to handle the issue which allows multiple devices to share the same frequency resource simultaneously. Thus in order to improve spectrum efficiency, this paper investigates computation offloading in NOMA-enabled IIoT. Specially, we consider co-channel interference in our model which complicates network spectrum resource allocation. A computation offloading scheme is designed by solving the minimum total completion delay problem which jointly optimizes computation resources allocation, transmission power allocation and subchannel assignment. In order to reduce the computational complexity, we decompose the original problem into three subproblems and propose an iterative algorithm based on optimization theory and many-to-one matching. Simulation results show that compared with orthogonal multiple access (OMA) based method, our method outperforms in total completion delay and network transmission rate.

In a mobile edge computing (MEC) system with a large number of low power mobile terminals, proper computation offloading and resource allocation is crucial to achieving desirable system performance. In this paper, we consider the joint computation offloading and resource allocation problem for an uplink MEC system under the min-max fairness criterion. The proposed optimization problem is difficult to solve due mainly to the nonconvex nondifferentialbe objective and the nonlinear coupling of design variables in the constraints. By exploiting binary relaxation and introducing auxiliary variables, we first convert this problem into a more tractable form. We then develop a novel algorithm based on the concave-convex procedure (CCCP) technique to address the problem. Furthermore, by exploiting the problem structure, an efficient algorithm based on inexact block coordinate descent (IBCD) method is proposed to reduce the computational complexity. Numerical results validate the efficiency of the proposed algorithms.

This paper considers the computation offloading and resource allocation for system sum cost minimization in a mobile edge computing (MEC)network. The computation offloading decision of the user equipments (UEs)can be made through wireless link to access the MEC server. Our intent is to minimize the weighted sum cost of the system, which takes into account the energy consumption and time delay, for both task processing and data transmissions, subject to the force delay requirement of the devices. We first formulate the problem as a mixed-integer and non-convex optimization scheme. Enlightened by the superior performance of reinforcement learning (RL)on solving resource control problems, we put forward a novel RL-based scheme for computation offloading and resource allocation in MEC network. Specifically, the MEC node is considered as an “agent”, which first makes decision on whether to offloading the computing task to the MEC server, and then utilizes convex optimization algorithms to settle the radio spectrum and computation resource scheduling problem in each decision phase. The simulation results present that the RL-based method can achieve better computation offloading and resource allocation performance compared to those of local computing and remote computing modes. It also achieves very similar or slightly better performance compared to the genetic algorithm based method.

Internet of Things (IoT) is a promising technology to connect tremendous devices together, where the major challenges are that the available energy is limited and computing capability is low. In this paper, we propose an efficient IoT computing tasks offloading mechanism based on cooperative communication and mobile cloud computing (MCC) system. The problem will be formulated as a joint optimization problem of computation and radio resource allocation aiming to minimize the system energy consumption, under the constraints of latency and transmission power. We will first propose a joint iterative computation offloading and resource allocation algorithm to solve the non-convex optimization problem. To further reduce the computation complexity, we also propose a matching based sub- optimal algorithm to solve this problem. Simulation results demonstrate that the proposed iterative algorithm achieves the goal to substantially reduce energy consumption by offloading computation. Moreover, the sub-optimal algorithm significantly reduces the computation complexity with only a small portion of performance loss.

A Novel Lyapunov based Dynamic Resource Allocation for UAVs-assisted Edge Computing

Due to the urgent emergence of computation-intensive intelligent applications on end devices, edge computing has been put forward as an extension of cloud computing, to satisfy the low-latency requirements of these applications. To process heterogenous computation tasks on an edge node, the corresponding services should be placed in advance, including installing softwares and caching databases/libraries. Considering the limited storage space and computation resources on the edge node, services should be elaborately selected and deployed on the edge node and its computation resources should be carefully allocated to placed services, according to the arrivals of computation workloads. The joint service placement and computation resource allocation problem is particularly complicated, in terms of considering the stochastic arrivals of tasks, the additional latency incurred by service migration, and the waiting time of unprocessed tasks. Benefiting from deep reinforcement learning, we propose a novel approach based on parameterized deep Q networks to make the joint service placement and computation resource allocation decisions, with the objective of minimizing the total latency of tasks in a long term. Extensive simulations are conducted to evaluate the convergence and performance achieved by our proposed approach.