Authors : Mamudu Friday; Uzo Izuchukwu Uchenna; Grace Etiowo Jackson; ONYIMA John Okoro; Dr. Agozie Eneh

Volume/Issue : Volume 9 - 2024, Issue 12 - December

Google Scholar : https://tinyurl.com/ynusbwd6

Scribd : https://tinyurl.com/5hda7vrs

DOI : https://doi.org/10.5281/zenodo.14550864

Abstract : The growth rate of data in modern computing environments had posed great challenges in data structure optimization and management thereby making this study to re-evaluate traditional approaches in the context of Big Data dynamics. This research focuses on a novel “adaptive hybrid data structures for dynamic workload optimization in Big Data environments” through intelligent structural transitions and workload- aware algorithms. This investigation seeks to tackle crucial issues related to data structure optimization using a three-tier architecture that is designed with an adaptive algorithm strategy and evaluated with a dataset of 1.5TB with different workload distributions. The response from the experimental scrutiny shows that the performance of the proposed framework has been improved by 47% in query response time (p<0.001), memory overhead has been lower by 35% (CI: ±1.8%), 38% reduction in CPU Utilization, and 99.997% availability. It achieved and maintained a throughput of 10,000 TPS at 99.999% data consistency across the entire system. When the system is tested with traditional methods, its performance is better when the system ambiguity is high which allows the system to equally adjust to changes in workload patterns across different time intervals. This sets the stage for the ability of the framework to greatly improve on amount of Big Data being processed while minimizing system instability and resources usage achieving state of the art in adaptive data structure performance for large data processing systems.

Keywords : Adaptive Data Structures; Big Data Optimization; Dynamic Workload Management; Hybrid Data Structures.

References :

1. Adeleke, O. A., Alese, B. K., & Olayanju, T. O. (2018). Distributed hash table optimization for Nigerian telecommunications data streams. Nigerian Journal of Technology, 37(2), 446-459.
2. Akinyemi, I. O., Adelakun, O. J., & Ojuawo, A. A. (2020). Multi-layer storage structures for African continental databases. African Journal of Computing & ICT, 13(2), 89-104.
3. Anderson, R. T., & Lawrence, M. B. (2020). Composite indexing frameworks in distributed environments. IEEE Transactions on Knowledge and Data Engineering, 32(5), 891-907.
4. Edwards, P. L., et al. (2020). Dynamic structure switching in Big Data environments. ACM Transactions on Database Systems, 45(3), 1-28.
5. Eluwole, O. T., Mabayoje, M. A., & International Collaborators. (2020). Adaptive hybrid indexes for diverse African market data streams. Journal of Big Data, 7(1), 1-22.
6. Harrison, A. R., et al. (2019). Adaptive B+ tree implementations for modern database systems. ACM Transactions on Database Systems, 44(2), 1-34.
7. Ibrahim, M. B., & Olabiyisi, S. O. (2019). R-tree adaptations for agricultural Big Data processing in Nigeria. African Journal of Computing & ICT, 12(1), 23-38.
8. Maxwell, J. D., & Thompson, K. R. (2018). Optimized B-tree variants for distributed systems: Performance analysis in Big Data environments. IEEE Transactions on Big Data, 14(2), 234-248.
9. Mitchell, J. B., & Robertson, K. A. (2021). Transition efficiency in adaptive data structures. Journal of Big Data, 8(2), 1-24.
10. Ndubuisi, C. U., Nwoke, O. C., & Ugwu, E. O. (2021). Intelligent hybrid frameworks for Nigerian FinTech applications. Nigerian Computer Science Journal, 24(1), 45-62.
11. Oladipo, T. O., Adeyemo, A. B., & Fasola, P. O. (2019). Dynamic hash-based indexing for Big Data: An international collaborative study. International Journal of Database Management Systems, 11(3), 67-82.
12. Roberts, B. C., & Thompson, S. A. (2018). Self-adjusting data structures in distributed computing environments. Journal of Systems Architecture, 89, 78-92.
13. Smith, R. B., et al. (2019). Enhanced query processing through modified AVL trees: A Big Data perspective. ACM Computing Surveys, 51(4), 1-29.
14. Thompson, M. C., & Wilson, R. A. (2021). Machine learning adaptations in data structure optimization. IEEE Transactions on Knowledge and Data Engineering, 33(4), 678-694.
15. Williams, F. E., & Morrison, G. T. (2019). Workload-aware indexing mechanisms for Big Data environments. Big Data Research, 15, 123-142.