• Home
  • Search
  • Q-Learning-Based Task Offloading and Resources Optimization for a Collaborative Computing System
  • Cite Icon39
  • https://doi.org/10.1109/access.2020.3015993Copy DOI Icon

Q-Learning-Based Task Offloading and Resources Optimization for a Collaborative Computing System

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Mobile edge computing (MEC) can effectively overcome the shortcomings of high-latency in mobile cloud computing (MCC) by deploying the cloud resources, e.g., storage and computational capability, to the edge. However, the limited computation capability of the MEC restricts the scalability of offloading. Therefore, the basic requirements of the MEC system are to explore effective offloading decisions and resource allocation methods. To address it, we develop a collaborative computing system composed of local computing (mobile device), MEC (edge cloud) and MCC (central cloud). Based on the proposed collaborative computing system, we design a novel Q-learning based computation offloading (QLCOF) policy to achieve the optimal resource allocation and offloading scheme by prescheduling the computation side for each task from a global perspective. Specifically, we first model the offloading decision process as a Markov decision process (MDP) and design a state loss function (STLF) to measure the quality of experience (QoE). After that, we define the cumulation of STLFs as the system loss function (SYLF) and formulate an SYLF minimization problem. Due to the difficulty to directly solve the formulated problem, we decompose it into multiple subproblems and preferentially optimize the transmission power and computation frequency of the edge cloud by the quasi-convex bisection and polynomial analysis method, respectively. Based on the precalculated offline transmission power and edge cloud computation frequency, we develop a Q-learning based offloading (QLOF) scheme to minimize the SYLF by optimizing offloading decisions. Finally, the numeral results show that the proposed QLOF scheme effectively reduces the SYLF under different parameters.

Loading PDF

Similar Papers
  • Conference Article
  • Citations6

System Revenue Maximization for Offloading Decisions in Mobile Edge Computing

  • Jun 01, 2021
  • Juan Zhang +2
  • PDF
  • Research Article
  • Citations13

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

  • Mar 24, 2024
  • Sensors (Basel, Switzerland)
  • Wei Zhuang +2
  • Research Article
  • Citations18

Federated deep reinforcement learning for task offloading and resource allocation in mobile edge computing-assisted vehicular networks

  • Jun 25, 2024
  • Journal of Network and Computer Applications
  • Xu Zhao +4
  • PDF
  • Research Article
  • Citations41

Joint Offloading and Charge Cost Minimization in Mobile Edge Computing

  • Jan 01, 2020
  • IEEE Open Journal of the Communications Society
  • Kehao Wang +7
  • Research Article
  • Citations198

A Multihop Task Offloading Decision Model in MEC-Enabled Internet of Vehicles

  • Feb 15, 2023
  • IEEE Internet of Things Journal
  • Chen Chen +4
  • Research Article
  • Citations51

Unmanned-Aerial-Vehicle-Assisted Computation Offloading for Mobile Edge Computing Based on Deep Reinforcement Learning

  • Jan 01, 2020
  • IEEE Access
  • Hui Wang +2
  • Research Article
  • Citations25

Multi-Layer Computation Offloading in Distributed Heterogeneous Mobile Edge Computing Networks

  • Jun 01, 2022
  • IEEE Transactions on Cognitive Communications and Networking
  • Pengfei Wang +3
  • Conference Article
  • Citations5

Towards the Advanced Data Processing for Medical Applications Using Task Offloading Strategy

  • Oct 10, 2022
  • Daria Alekseeva +2
  • Research Article
  • Citations14

Workload Balancing in Mobile Edge Computing for Internet of Things: A Population Game Approach

  • May 01, 2022
  • IEEE Transactions on Network Science and Engineering
  • Dongqing Liu +2
  • PDF
  • Research Article
  • Citations5

Secured Optimized Resource Allocation in Mobile Edge Computing

  • Aug 21, 2022
  • Mobile Information Systems
  • Asma Bibi +5
  • Research Article
  • Citations5

Energy consumption optimisation based on mobile edge computing in power grid internet of things nodes

  • Jan 01, 2020
  • International Journal of Web and Grid Services
  • Hongbin Sun +4
  • Research Article
  • Citations49

Computation offloading and resource allocation for mobile edge computing with multiple access points

  • Oct 01, 2019
  • IET Communications
  • Qiuping Li +2
  • Conference Article
  • Citations6

Joint Network Selection and Task Offloading in Mobile Edge Computing

  • May 01, 2021
  • Xin Qi +3
  • PDF
  • Research Article
  • Citations9

A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload.

  • Feb 16, 2023
  • Sensors
  • Song Liu +3
  • Book Chapter
  • Citations2

Energy-aware Application Scheduling on DVFS-Enabled Edge Computing with Mobile–Edge–Cloud Cooperation

  • Jan 01, 2022
  • Vishal Deka +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.