Authors : Salman Alam; Sami Ud Din; Imtiaz Ali Shah; Saeed Ur Rahman; Aneesa Bibi

Volume/Issue : Volume 11 - 2026, Issue 7 - July

Google Scholar : https://tinyurl.com/mutmw6sm

Scribd : https://tinyurl.com/bpa5rewh

DOI : https://doi.org/10.38124/ijisrt/26jul612

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Abstract : The rapid growth of real-time and computation-intensive applications, such as face recognition, virtual reality, 3D gaming, augmented reality, and intelligent transportation systems, has significantly increased the demand for efficient data processing and low-latency services. However, mobile devices are constrained by limited computational capabilities and battery capacity, making them unsuitable for executing heavy workloads locally. Mobile Edge Computing (MEC) has emerged as a promising paradigm to offload computation tasks to nearby edge servers, thereby reducing latency and improving service quality. Despite its advantages, task offloading in MEC environments remains challenging due to the distributed nature of edge resources, energy constraints of end devices, and dynamic net- work conditions. Existing solutions based on heuristic methods, genetic algorithms, NOMA-based techniques, and mobility-aware services often suffer from high latency, excessive energy consumption, and task migration overhead. To address these limitations, this paper investigates a reinforcement learning-based computation offloading strategy using an improved Deep Deterministic Policy Gradient (IDDPG) algorithm. The proposed IDDPG approach enables decentralized decision-making by learning optimal offloading policies from local observations, effectively balancing local execution and task offloading. By minimizing computation costs, power consumption, and latency, the proposed method outperforms greedy offloading strategies and demonstrates improved efficiency in dynamic MEC environments.

Keywords : Mobile Edge Computing; Deep Reinforcement Learning; Task Offloading; IDDPG; Energy Efficiency; Latency Minimization.

References :

1. L. Ale, N. Zhang, H. Wu, D. Chen, and T. Han, "Online proactive caching in mobile edge computing using bidirectional deep recurrent neural network," IEEE Internet of Things Journal, vol. 6, no. 3, pp. 5520-5530, 2019.
2. S. Wang, T. Lei, L. Zhang, C.-H. Hsu, and F. Yang, "Offloading mobile data traffic for QoS-aware service provision in vehicular cyber-physical systems," Future Generation Computer Systems, vol. 61, pp. 118-127, 2016.
3. J. Dai, Z. Zhang, and D. Liu, "Proactive caching over cloud radio access network with user mobility and video segment popularity," IEEE Access, vol. 6, pp. 44396-44405, 2018.
4. N. Abbas, Y. Zhang, A. Taherkordi, and T. Skeie, "Mobile edge computing: A survey," IEEE Internet of Things Journal, vol. 5, no. 1, pp. 450-465, 2017.
5. D. Liu and C. Yang, "A deep reinforcement learning approach to proactive content pushing and recommendation for mobile users," IEEE Access, vol. 7, pp. 83120-83136, 2019.
6. A. Islam, A. Debnath, M. Ghose, and S. Chakraborty, "A survey on task offloading in multi-access edge computing," Journal of Systems Architecture, p. 102225, 2021.
7. G. Lu and W. H. Zeng, "Cloud computing survey," in Proc. Trans Tech Publications, 2014, pp. 650-661.
8. H. Jin, S. Ibrahim, T. Bell, W. Gao, D. Huang, and S. Wu, "Cloud types and services," in Handbook of Cloud Computing, pp. 335-355, Springer, Boston, MA, 2010.
9. A. Poniszewska-Maranda, R. Matusiak, N. Kryvinska, and A. U. H. Yasar, "A real-time service system in the cloud," Journal of Ambient Intelligence and Humanized Computing, vol. 11, no. 3, pp. 961-977, 2020.
10. A. Asaduzzaman, A. R. Joseph, F. N. Sibai, and N. Mohamed, "Cloud computing: A cloudy future?" in Proc. IEEE IIT, 2012, pp. 78-82.
11. S. K. Yoo and B. Y. Kim, "A decision-making model for adopting a cloud computing system," Sustainability, vol. 10, no. 8, p. 2952, 2018.
12. X. Zhang, H. Chen, Y. Zhao, Z. Ma, Y. Xu, H. Huang, H. Yin, and D. O. Wu, "Improving cloud gaming experience through mobile edge computing," IEEE Wireless Communications, vol. 26, no. 4, pp. 178-183, 2019.
13. A. Sunyaev, "Cloud computing," in Internet Computing, Springer, 2020, pp. 195-236.
14. M. U. Bokhari, Q. Makki, and Y. K. Tamandani, "A survey on cloud computing," in Big Data Analytics, pp. 149-164, Springer, Singapore, 2018.
15. M. F. Mushtaq, U. Akram, I. Khan, S. N. Khan, A. Shahzad, and A. Ullah, "Cloud computing en- vironment and security challenges: A review," International Journal of Advanced Computer Science and Applications, vol. 8, no. 10, pp. 183-195, 2017.
16. S. K. Garg, S. Versteeg, and R. Buyya, "A framework for ranking of cloud computing services," Future Generation Computer Systems, vol. 29, no. 4, pp. 1012-1023, 2013.
17. C. N. Hoefer and G. Karagiannis, "Taxonomy of cloud computing services," in Proc. IEEE Globecom Workshops, 2010, pp. 1345-1350.
18. K. Gai and A. Steenkamp, "Feasibility of a Platform-as-a-Service implementation using cloud com- puting," in Proc. CONISAR, vol. 2167, 2013.
19. K. K. M. Kumar, "Software as a service for efficient cloud computing," 2014.
20. C. Jiang, X. Cheng, H. Gao, X. Zhou, and J. Wan, "Toward computation offloading in edge com- puting: A survey," IEEE Access, vol. 7, pp. 131543-131558, 2019.
21. Y. C. Hu, M. Patel, D. Sabella, N. Sprecher, and V. Young, "Mobile edge computing—A key technology towards 5G," ETSI White Paper, vol. 11, no. 11, pp. 1-16, 2015.
22. Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "Mobile edge computing: Survey and research outlook," arXiv:1701.01090, 2017.
23. J. Lee, J.-W. Kim, and J. Lee, "Mobile personal multi-access edge computing architecture composed of individual user devices," Applied Sciences, vol. 10, no. 13, p. 4643, 2020.
24. M. Zhang, H. Luo, and H. Zhang, "A survey of caching mechanisms in information-centric network- ing," IEEE Communications Surveys & Tutorials, vol. 17, no. 3, pp. 1473-1499, 2015.
25. T. Hou et al., "Proactive content caching by exploiting transfer learning for mobile edge computing," International Journal of Communication Systems, vol. 31, no. 11, p. e3706, 2018.
26. P. Cong, J. Zhou, L. Li, K. Cao, T. Wei, and K. Li, "A survey of hierarchical energy optimization for mobile edge computing," ACM Computing Surveys, vol. 53, no. 2, pp. 1-44, 2020.
27. H. Guo and J. Liu, "Collaborative computation offloading for multiaccess edge computing over fiber-wireless networks," IEEE Transactions on Vehicular Technology, vol. 67, no. 5, pp. 4514-4526, 2018.
28. H. Yu, B. Ng, and W. Seah, "Multi-gateway polling for nanonetworks under dynamic IoT backhaul bandwidth," in Proc. IEEE, 2018, pp. 1-4.
29. A. L. Samuel, "Some studies in machine learning using the game of checkers," IBM Journal of Research and Development, vol. 3, no. 3, pp. 210-229, 1959.
30. M. Mohri, A. Rostamizadeh, and A. Talwalkar, Foundations of Machine Learning, MIT Press, 2018.
31. B. Adam, I. F. C. Smith, and F. Asce, "Reinforcement learning for structural control," Journal of Computing in Civil Engineering, vol. 22, no. 2, pp. 133-139, 2008.
32. P. C. Sen, M. Hajra, and M. Ghosh, "Supervised classification algorithms in machine learning: A survey and review," in Emerging Technology in Modelling and Graphics, Springer, Singapore, 2020, pp. 99-111.
33. G. K. Uyanik and N. Güler, "A study on multiple linear regression analysis," Procedia—Social and Behavioral Sciences, vol. 106, pp. 234-240, 2013.
34. T. O. Ayodele, "Types of machine learning algorithms," New Advances in Machine Learning, vol. 3, pp. 19-48, 2010.
35. A. I. Karoly, R. Fuller, and P. Galambos, "Unsupervised clustering for deep learning: A tutorial survey," Acta Polytechnica Hungarica, vol. 15, no. 8, pp. 29-53, 2018.
36. R. Xu and D. Wunsch, "Survey of clustering algorithms," IEEE Transactions on Neural Networks, vol. 16, no. 3, pp. 645-678, 2005.
37. X. Wu et al., "Top 10 algorithms in data mining," Knowledge and Information Systems, vol. 14, no. 1, pp. 1-37, 2008.
38. M. Espadoto et al., "Toward a quantitative survey of dimension reduction techniques," IEEE Trans- actions on Visualization and Computer Graphics, vol. 27, no. 3, pp. 2153-2173, 2019.
39. G. Chao, Y. Luo, and W. Ding, "Recent advances in supervised dimension reduction: A survey," Machine Learning and Knowledge Extraction, vol. 1, no. 1, pp. 341-358, 2019.
40. K. Arulkumaran et al., "Deep reinforcement learning: A brief survey," IEEE Signal Processing Magazine, vol. 34, no. 6, pp. 26-38, 2017.
41. B. Kiumarsi et al., "Optimal and autonomous control using reinforcement learning: A survey," IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 6, pp. 2042-2062, 2017.
42. F. Li et al., "Multi-armed-bandit-based spectrum scheduling algorithms in wireless networks: A survey," IEEE Wireless Communications, vol. 27, no. 1, pp. 24-30, 2020.
43. G. Miller, "The smartphone psychology manifesto," Perspectives on Psychological Science, vol. 7, no. 3, pp. 221-237, 2012.
44. Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "A survey on mobile edge computing: The communication perspective," IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322-2358, 2017.
45. M. Chen and Y. Hao, "Task offloading for mobile edge computing in software defined ultra-dense network," IEEE Journal on Selected Areas in Communications, vol. 36, no. 3, pp. 587-597, 2018.
46. Z. Ali, L. Jiao, T. Baker, G. Abbas, Z. H. Abbas, and S. Khaf, "A deep learning approach for energy efficient computational offloading in mobile edge computing," IEEE Access, vol. 7, pp. 149623- 149633, 2019.
47. H. Ke, H. Wang, W. Sun, and H. Sun, "Adaptive computation offloading policy for multi-access edge computing in heterogeneous wireless networks," IEEE Transactions on Network and Service Management, 2021.
48. Z. Chen and X. Wang, "Decentralized computation offloading for multi-user mobile edge computing: A deep reinforcement learning approach," EURASIP Journal on Wireless Communications and Networking, vol. 2020, no. 1, pp. 1-21, 2020.
49. M. Tang and V. W. Wong, "Deep reinforcement learning for task offloading in mobile edge computing systems," IEEE Transactions on Mobile Computing, 2020.
50. Z. Ali, S. Khaf, Z. H. Abbas, G. Abbas, F. Muhammad, and S. Kim, "A deep learning approach for mobility-aware and energy-efficient resource allocation in MEC," IEEE Access, vol. 8, pp. 179530- 179546, 2020.
51. S. U. Malik, T. Kanwal, S. U. Khan, H. Malik, and H. Pervaiz, "A user-centric QoS-aware multi-path service provisioning in mobile edge computing," IEEE Access, vol. 9, pp. 56020-56030, 2021.
52. J. B. Hamrick et al., "On the role of planning in model-based deep reinforcement learning," 2020.
53. C. Qiu, Y. Hu, Y. Chen, and B. Zeng, "Deep deterministic policy gradient (DDPG)-based energy harvesting wireless communications," IEEE Internet of Things Journal, vol. 6, no. 5, pp. 8577-8588, 2019.
54. Z. Li et al., "Energy-aware task offloading with deadline constraint in mobile edge computing," 2021.
55. T.-Y. Kan, Y. Chiang, and H.-Y. Wei, "Task offloading and resource allocation in mobile-edge computing system," in Proc. IEEE WOCC, 2018, pp. 1-4.
56. P. Mach and Z. Becvar, "Mobile edge computing: A survey on architecture and computation of- floading," IEEE Communications Surveys & Tutorials, vol. 19, no. 3, pp. 1628-1656, 2017.
57. X. Zhang, J. Wu, W. Shi, Y. Wu, and Y. Miu, "Low-latency cooperative computation offloading for mobile edge computing," in Proc. IEEE ISPA/BDCloud, 2019, pp. 155-159.
58. Z. Jin, C. Zhang, G. Zhao, Y. Jin, and L. Zhang, "A context-aware task offloading scheme in collaborative vehicular edge computing systems," KSII Transactions on Internet and Information Systems, vol. 15, no. 2, 2021.
59. N. Abdenacer, H. Wu, N. N. Abdelkader, S. Dhelim, and H. Ning, "A novel framework for mobile edge computing by optimizing task offloading," IEEE Internet of Things Journal, 2021.
60. X. Chen and G. Liu, "Energy-efficient task offloading and resource allocation via deep reinforcement learning for augmented reality in mobile edge networks," IEEE Internet of Things Journal, 2021.
61. Z. Sun and M. R. Nakhai, "An online learning algorithm for distributed task offloading in multi- access edge computing," IEEE Transactions on Signal Processing, vol. 68, pp. 3090-3102, 2020.
62. H. A. Alameddine, S. Sharafeddine, S. Sebbah, S. Ayoubi, and C. Assi, "Dynamic task offloading and scheduling for low-latency IoT services in multi-access edge computing," IEEE Journal on Selected Areas in Communications, vol. 37, no. 3, pp. 668-682, 2019.
63. T. Yang, R. Chai, and L. Zhang, "Latency optimization-based joint task offloading and scheduling for multi-user MEC system," in Proc. IEEE WOCC, 2020, pp. 1-6.
64. M. D. Hossain et al., "Collaborative task offloading for overloaded mobile edge computing in small- cell networks," in Proc. IEEE ICOIN, 2020, pp. 717-722.