Jiang, Feibo and Peng, Yubo and Wang, Kezhi and Dong, Li and Yang, Kun (2023) MARS: A DRL-Based Multi-Task Resource Scheduling Framework for UAV With IRS-Assisted Mobile Edge Computing System. IEEE Transactions on Cloud Computing, 11 (4). pp. 3700-3712. DOI https://doi.org/10.1109/tcc.2023.3307582
Jiang, Feibo and Peng, Yubo and Wang, Kezhi and Dong, Li and Yang, Kun (2023) MARS: A DRL-Based Multi-Task Resource Scheduling Framework for UAV With IRS-Assisted Mobile Edge Computing System. IEEE Transactions on Cloud Computing, 11 (4). pp. 3700-3712. DOI https://doi.org/10.1109/tcc.2023.3307582
Jiang, Feibo and Peng, Yubo and Wang, Kezhi and Dong, Li and Yang, Kun (2023) MARS: A DRL-Based Multi-Task Resource Scheduling Framework for UAV With IRS-Assisted Mobile Edge Computing System. IEEE Transactions on Cloud Computing, 11 (4). pp. 3700-3712. DOI https://doi.org/10.1109/tcc.2023.3307582
Abstract
This article studies a dynamic Mobile Edge Computing (MEC) system assisted by Unmanned Aerial Vehicles (UAVs) and Intelligent Reflective Surfaces (IRSs). We propose a scaleable resource scheduling algorithm to minimize the energy consumption of all UEs and UAVs in the MEC system with a variable number of UAVs. We propose a Multi-tAsk Resource Scheduling (MARS) framework based on Deep Reinforcement Learning (DRL) to solve the problem. First, we present a novel Advantage Actor-Critic (A2C) structure with the state-value critic and entropy-enhanced actor to reduce variance and enhance the policy search of DRL. Then, we present a multi-head agent with three different heads in which a classification head is applied to make offloading decisions and a regression head is presented to allocate computational resources, and a critic head is introduced to estimate the state value of the selected action. Next, we introduce a multi-task controller to adjust the agent to adapt to the varying number of UAVs by loading or unloading a part of weights in the agent. Finally, a Light Wolf Search (LWS) is introduced as the action refinement to enhance the exploration in the dynamic action space. The numerical results demonstrate the feasibility and efficiency of the MARS framework.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Mobile edge computing (MEC); intelligent reflecting surface (IRS); unmanned aerial vehicle (UAV); deep reinforcement learning (DRL); resource scheduling |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 21 Mar 2024 17:11 |
Last Modified: | 21 Mar 2024 17:20 |
URI: | http://repository.essex.ac.uk/id/eprint/36504 |
Available files
Filename: TCC2023.pdf