Authors : Shankar Dheeraj Konidena

Volume/Issue : Volume 9 - 2024, Issue 7 - July

Google Scholar : https://tinyurl.com/bd5um9f7

Scribd : https://tinyurl.com/2sx8u472

DOI : https://doi.org/10.38124/ijisrt/IJISRT24JUL607

Abstract : Kubernetes is a distinguished open-source container orchestration system in cloud computing and containerized applications. Google developed it, and the Cloud Native Computing Foundation now maintains it. Kubernetes offers a robust framework for automating application deployment scaling and management, revolutionizing how organizations use their containerized workloads and providing huge flexibility and feasibility. The current paper explores the application of machine learning algorithms to optimize resource allocation in Kubernetes environments. As the complexity of cloud-native applications increases because of various engagements, it is vital to maintain performance and cost- effectiveness. This study also evaluates various machine learning models and techniques and their relevancy in areas such as anomaly detection and enhancing overall cluster utilization. Our findings include machine learning-driven methodologies that will significantly improve performance utilizing historical data. Kubernetes's decentralized nature requires a scalable structure for task scheduling to accommodate dynamic workloads conveniently. The AIMD algorithm, a celebrated method for congestion avoidance in network management, inspires our approach. Computing clusters can be challenging to deploy and manage due to their complexity. Monitoring systems collect large amounts of data, which is daunting to understand manually. Machine learning provides a viable solution to detect anomalies in a Kubernetes cluster. KAD (Kubernetes et al.) is one such algorithm that can solve the Cluster anomalies problem. Enormous Cloud native applications market is projected to reach 17.0 billion USD by 2028, which was USD 5.9 billion in 2023. On par with those numbers is the global Machine Learning (ML) market size, which was valued at $19.20 billion in 2022 and is expected to grow from $26.03 billion in 2023 to $225.91 billion by 2030 (As per Fortune Business Insights). At the conjecture, both markets will take innovation to a new level, offering more adaptive solutions for contemporary cloud infrastructures.

Keywords : Kubernetes, Machine Learning, Optimization, Resource Allocation, Efficiency, ML Algorithms.

References :

1. J. Kosińska and M. Tobiasz, "Detection of Cluster Anomalies With ML Techniques," in IEEE Access, vol. 10, pp. 110742-110753, 2022, doi: 10.1109/ACCESS.2022.3216080.
2. D. Spatharakis, I. Dimolitsas, E. Vlahakis, D. Dechouniotis, N. Athanasopoulos and S. Papavassiliou, "Distributed Resource Autoscaling in Kubernetes Edge Clusters," 2022 18th International Conference on Network and Service Management (CNSM), Thessaloniki, Greece, 2022, pp. 163-169, doi: 10.23919/CNSM55787.2022.9965056.
3. G. Liu, B. Huang, Z. Liang, M. Qin, H. Zhou and Z. Li, "Microservices: architecture, container, and challenges," 2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C), Macau, China, 2020, pp. 629-635, doi: 10.1109/QRS-C51114.2020.00107.
4. Ghofrani, Javad & Lübke, Daniel. (2018). Challenges of Microservices Architecture: A Survey on the State of the Practice.
5. V. Medel, O. Rana, J. Á. Bañares and U. Arronategui, "Modelling Performance & Resource Management in Kubernetes," 2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC), Shanghai, China, 2016, pp. 257-262.
6. Ishak, Harichane & Makhlouf, Sid Ahmed & Belalem, Ghalem. (2020). A Proposal of Kubernetes Scheduler Using Machine-Learning on CPU/GPU Cluster. 10.1007/978-3-030-51965-0_50.
7. L. Toka, G. Dobreff, B. Fodor and B. Sonkoly, "Machine Learning-Based Scaling Management for Kubernetes Edge Clusters," in IEEE Transactions on Network and Service Management, vol. 18, no. 1, pp. 958-972, March 2021, doi: 10.1109/TNSM.2021.3052837.
8. Ou, M., Lau, K., Ospinsa, J., & Balkhi, S. (n.d.). Kubernetes and Big Data: A Gentle Introduction. Medium. https://medium.com/sfu-cspmp/kubernetes-and-big-data-a-gentle-introduction-6f32b5570770
9. Gosh, B. (n.d.). Boosting Kubernetes with AI/ML. Medium. https://medium.com/@bijit211987/ boosting-kubernetes-with-ai-ml-f8f459ffbed4
10. Glushach, R. (n.d.). Kubernetes Scheduling: Understanding the Math Behind the Magic. Medium. https://romanglushach.medium.com/kubernetes-scheduling-understanding-the-math-behind-the-magic-2305b57d45b1
11. Butcher, M. (n.d.). 10 Years of Kubernetes: Past, Present, and Future. The New Stack. https://thenewstack.io/10-years-of-kubernetes-past-present-and-future/
12. Using Machine Learning to Automate Kubernetes Optimization | StormForge. https://www.stormforge. io/blog/using-machine-learning-automate-kubernetes -optimization/
13. [eBook] Getting Started with Kubernetes Resources Management. https://www.stormforge.io/ebook/ getting-started-kubernetes-resource-management-optimization-thank-you/
14. Machine learning techniques: An overview. https://www.leewayhertz.com/machine-learning-techniques/
15. Senjab, K., Abbas, S., Ahmed, N. et al. A survey of Kubernetes scheduling algorithms. J Cloud Comp 12, 87 (2023). https://doi.org/10.1186/s13677-023-00471-1