ISSN (Online): 2321-3418
server-injected
Education And Language
Open Access

Energy-Efficient Task Scheduling in Distributed Edge Networks Using Reinforcement Learning

DOI: 10.18535/ijsrm/v7i3.ec02· Pages: 248-268· Vol. 7, No. 03, (2019)· Published: March 28, 2019
PDF
Views: 619 PDF downloads: 207

Abstract

Energy efficiency has become a critical concern in distributed edge networks due to the increasing demand for real-time processing in applications such as IoT, autonomous systems, and industrial automation. Efficient task scheduling is essential to optimize resource utilization and reduce energy consumption while maintaining system performance. This paper explores the application of reinforcement learning (RL) as an innovative approach for energy-efficient task scheduling in distributed edge networks. The proposed RL-based framework dynamically allocates tasks to edge devices, adapting to varying workloads and network conditions. By formulating the scheduling problem as a Markov Decision Process (MDP), the framework employs an intelligent agent to learn optimal scheduling policies through a reward mechanism designed to minimize energy consumption and ensure timely task execution. Experimental evaluations demonstrate the proposed method's superiority over traditional scheduling techniques, achieving significant energy savings while maintaining high task throughput. The findings highlight the potential of RL in transforming task scheduling strategies for energy-efficient and sustainable edge computing environments.

Keywords

Energy-efficient computingTask schedulingDistributed edge networksReinforcement learning (RL)Resource optimizationEdge computingReal-time applicationsMarkov Decision Process (MDP)Dynamic schedulingIntelligent task allocation

References

  1. Kanoun, K., Mastronarde, N., Atienza, D., & Van der Schaar, M. (2014). Online energy-efficient task-graph scheduling for multicore platforms. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 33(8), 1194-1207.Google Scholar ↗
  2. Atallah, R. F., Assi, C. M., & Yu, J. Y. (2016). A reinforcement learning technique for optimizing downlink scheduling in an energy-limited vehicular network. IEEE Transactions on Vehicular Technology, 66(6), 4592-4601.Google Scholar ↗
  3. Ranadheera, S., Maghsudi, S., & Hossain, E. (2017). Mobile edge computation offloading using game theory and reinforcement learning. arXiv preprint arXiv:1711.09012.Google Scholar ↗
  4. Guo, W., Wang, S., Wu, Y., Rigelsford, J., Chu, X., & O'Farrell, T. (2013, April). Spectral-and energy-efficient antenna tilting in a HetNet using reinforcement learning. In 2013 IEEE Wireless Communications and Networking Conference (WCNC) (pp. 767-772). IEEE.Google Scholar ↗
  5. Wang, S., Zhang, X., Zhang, Y., Wang, L., Yang, J., & Wang, W. (2017). A survey on mobile edge networks: Convergence of computing, caching and communications. Ieee Access, 5, 6757-6779.Google Scholar ↗
  6. Liu, T., Chen, F., Ma, Y., & Xie, Y. (2016). An energy-efficient task scheduling for mobile devices based on cloud assistant. Future Generation Computer Systems, 61, 1-12.Google Scholar ↗
  7. Thembelihle, D., Rossi, M., & Munaretto, D. (2017). Softwarization of mobile network functions towards agile and energy efficient 5G architectures: a survey. Wireless Communications and Mobile Computing, 2017(1), 8618364.Google Scholar ↗
  8. Atallah, R., Assi, C., & Khabbaz, M. (2017, May). Deep reinforcement learning-based scheduling for roadside communication networks. In 2017 15th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) (pp. 1-8). IEEE.Google Scholar ↗
  9. Zhang, Y., Wang, Y., & Hu, C. (2015, December). CloudFreq: Elastic energy-efficient bag-of-tasks scheduling in DVFS-enabled clouds. In 2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS) (pp. 585-592). IEEE.Google Scholar ↗
  10. Shi, T., Yang, M., Li, X., Lei, Q., & Jiang, Y. (2016). An energy-efficient scheduling scheme for time-constrained tasks in local mobile clouds. Pervasive and Mobile Computing, 27, 90-105.Google Scholar ↗
  11. Alam, K., Mostakim, M. A., & Khan, M. S. I. (2017). Design and Optimization of MicroSolar Grid for Off-Grid Rural Communities. Distributed Learning and Broad Applications in Scientific Research, 3.Google Scholar ↗
  12. Integrating solar cells into building materials (Building-Integrated Photovoltaics-BIPV) to turn buildings into self-sustaining energy sources. Journal of Artificial Intelligence Research and Applications, 2(2).Google Scholar ↗
  13. Agarwal, A. V., & Kumar, S. (2017, November). Unsupervised data responsive based monitoring of fields. In 2017 International Conference on Inventive Computing and Informatics (ICICI) (pp. 184-188). IEEE.Google Scholar ↗
  14. Agarwal, A. V., Verma, N., Saha, S., & Kumar, S. (2018). Dynamic Detection and Prevention of Denial of Service and Peer Attacks with IPAddress Processing. Recent Findings in Intelligent Computing Techniques: Proceedings of the 5th ICACNI 2017, Volume 1, 707, 139.Google Scholar ↗
  15. Mishra, M. (2017). Reliability-based Life Cycle Management of Corroding Pipelines via Optimization under Uncertainty (Doctoral dissertation).Google Scholar ↗
  16. Agarwal, A. V., & Kumar, S. (2017, October). Intelligent multi-level mechanism of secure data handling of vehicular information for post-accident protocols. In 2017 2nd International Conference on Communication and Electronics Systems (ICCES) (pp. 902-906). IEEE.Google Scholar ↗
  17. Malhotra, I., Gopinath, S., Janga, K. C., Greenberg, S., Sharma, S. K., & Tarkovsky, R. (2014). Unpredictable nature of tolvaptan in treatment of hypervolemic hyponatremia: case review on role of vaptans. Case reports in endocrinology, 2014(1), 807054.Google Scholar ↗
  18. Shakibaie-M, B. (2013). Comparison of the effectiveness of two different bone substitute materials for socket preservation after tooth extraction: a controlled clinical study. International Journal of Periodontics & Restorative Dentistry, 33(2).Google Scholar ↗
  19. Gopinath, S., Janga, K. C., Greenberg, S., & Sharma, S. K. (2013). Tolvaptan in the treatment of acute hyponatremia associated with acute kidney injury. Case reports in nephrology, 2013(1), 801575.Google Scholar ↗
  20. Shilpa, Lalitha, Prakash, A., & Rao, S. (2009). BFHI in a tertiary care hospital: Does being Baby friendly affect lactation success?. The Indian Journal of Pediatrics, 76, 655-657.Google Scholar ↗
  21. Singh, V. K., Mishra, A., Gupta, K. K., Misra, R., & Patel, M. L. (2015). Reduction of microalbuminuria in type-2 diabetes mellitus with angiotensin-converting enzyme inhibitor alone and with cilnidipine. Indian Journal of Nephrology, 25(6), 334-339.Google Scholar ↗
  22. Gopinath, S., Giambarberi, L., Patil, S., & Chamberlain, R. S. (2016). Characteristics and survival of patients with eccrine carcinoma: a cohort study. Journal of the American Academy of Dermatology, 75(1), 215-217.Google Scholar ↗
  23. Lin, L. I., & Hao, L. I. (2024). The efficacy of niraparib in pediatric recurrent PFA⁃ type ependymoma. Chinese Journal of Contemporary Neurology & Neurosurgery, 24(9), 739.Google Scholar ↗
  24. Swarnagowri, B. N., & Gopinath, S. (2013). Ambiguity in diagnosing esthesioneuroblastoma--a case report. Journal of Evolution of Medical and Dental Sciences, 2(43), 8251-8255.Google Scholar ↗
  25. Swarnagowri, B. N., & Gopinath, S. (2013). Pelvic Actinomycosis Mimicking Malignancy: A Case Report. tuberculosis, 14, 15.Google Scholar ↗
  26. Krishnan, S., Shah, K., Dhillon, G., & Presberg, K. (2016). 1995: FATAL PURPURA FULMINANS AND FULMINANT PSEUDOMONAL SEPSIS. Critical Care Medicine, 44(12), 574.Google Scholar ↗
  27. Krishnan, S. K., Khaira, H., & Ganipisetti, V. M. (2014, April). Cannabinoid hyperemesis syndrome-truly an oxymoron!. In JOURNAL OF GENERAL INTERNAL MEDICINE (Vol. 29, pp. S328-S328). 233 SPRING ST, NEW YORK, NY 10013 USA: SPRINGER.Google Scholar ↗
  28. Krishnan, S., & Selvarajan, D. (2014). D104 CASE REPORTS: INTERSTITIAL LUNG DISEASE AND PLEURAL DISEASE: Stones Everywhere!. American Journal of Respiratory and Critical Care Medicine, 189, 1.Google Scholar ↗
  29. Mahmud, U., Alam, K., Mostakim, M. A., & Khan, M. S. I. (2018). AI-driven micro solar power grid systems for remote communities: Enhancing renewable energy efficiency and reducing carbon emissions. Distributed Learning and Broad Applications in Scientific Research, 4.Google Scholar ↗
  30. Nagar, G. (2018). Leveraging Artificial Intelligence to Automate and Enhance Security Operations: Balancing Efficiency and Human Oversight. Valley International Journal Digital Library, 78-94.Google Scholar ↗
  31. Agarwal, A. V., Verma, N., Saha, S., & Kumar, S. (2018). Dynamic Detection and Prevention of Denial of Service and Peer Attacks with IPAddress Processing. Recent Findings in Intelligent Computing Techniques: Proceedings of the 5th ICACNI 2017, Volume 1, 707, 139.Google Scholar ↗
  32. Mishra, M. (2017). Reliability-based Life Cycle Management of Corroding Pipelines via Optimization under Uncertainty (Doctoral dissertation).Google Scholar ↗
  33. Agarwal, A. V., Verma, N., & Kumar, S. (2018). Intelligent Decision Making Real-Time Automated System for Toll Payments. In Proceedings of International Conference on Recent Advancement on Computer and Communication: ICRAC 2017 (pp. 223-232). Springer SingaporeGoogle Scholar ↗
  34. Gadde, H. (2019). Integrating AI with Graph Databases for Complex Relationship Analysis. InternationalGoogle Scholar ↗
  35. Gadde, H. (2019). AI-Driven Schema Evolution and Management in Heterogeneous Databases. International Journal of Machine Learning Research in Cybersecurity and Artificial Intelligence, 10(1), 332-356.Google Scholar ↗
  36. Gadde, H. (2019). Exploring AI-Based Methods for Efficient Database Index Compression. Revista de Inteligencia Artificial en Medicina, 10(1), 397-432.Google Scholar ↗
Author details
Sai Dikshit Pasham
University of Illinois, Springfield
✉ Corresponding Author
👤 View Profile →