Whale Optimized Distributed Computing Data Lake for Energy Storage

Sekhar Vempati

doi:10.69996/jcai.2024022

Authors

Sekhar Vempati Assistant Professor, Department of ECE, Rajiv Gandhi University of Knowledge Technologies, Nuzvid (RGUKT-Nuzvid), Krishna District, Andhra Pradesh - 521201, India. Author

DOI:

https://doi.org/10.69996/jcai.2024022

Keywords:

Whale Optimization, Distributed Computing, Seahorse Optimization, Classification, Resource Allocation, Lake Architecture

Abstract

This paper presents the Whale Seahorse Optimization Distributed Computing (WSODS) algorithm, a novel approach that combines the Whale Optimization Algorithm (WOA) and Seahorse Optimization Algorithm (SOA) within a distributed computing framework. WSODS aims to address
complex optimization challenges across various domains, including power storage systems and data lake architectures. The algorithm's performance was evaluated based on key metrics such as data processing time, system throughput, resource utilization, and scalability. The evaluation results indicate that WSODS significantly enhances system performance. In the context of power storage systems, WSODS improves energy efficiency, storage capacity, charging and discharging rates, and round-trip efficiency. For data lake architectures, WSODS achieves lower data processing times, higher system throughput, and competitive resource utilization while demonstrating good scalability with increasing data loads. The evaluation results indicate that WSODS significantly enhances system performance. In the context of power storage systems, WSODS improves energy efficiency from 92% to 98%, storage capacity from 480 MWh to 500 MWh, charging rate from 45 MW to 55 MW, discharging rate from 55 MW to 64 MW, and round-trip efficiency from 88% to 94% over 100 iterations. For data lake architectures, WSODS achieveslower data processing times (450 seconds compared to 600 seconds for GA), higher system throughput (75 MB/s compared to 55 MB/s for GA), and competitive resource utilization (80% CPU and 65%memory), while demonstrating good scalability with processing time for a 2x data load at 920 seconds compared to 1250 seconds for GA. These findings suggest that WSODS is a versatile and robust optimization tool capable of driving advancements in energy efficiency, data analytics, and distributed computing. Further research and real-world applications are recommended to fully explore its potentialand capabilities.

References

[1] S.A Errami, H.Hajji, K.A El Kadi and H.Badir, “Spatial big data architecture: from data warehouses and data lakes to the Lakehouse,” Journal of Parallel and Distributed Computing, vol.176, pp.70-79, 2023.

[2] S.Usman, R.Mehmood, I.Katib and A.Albeshri, “Data locality in high performance computing, big data, and converged systems: An analysis of the cutting edge and a future system architecture,” Electronics, vol.12, no.1, pp.53, 2022.

[3] J.Li, S.Cai, L.Wang, M.Li, J.Li and H.Tu, “A novel design for data processing framework of park-level power system with data mesh concept,” In 2022 IEEE International Conference on Energy Internet (ICEI), pp. 153-158, 2022.

[4] C.Rucco, A.Longo and M.Zappatore, “Supporting Energy Digital Twins with Cloud Data Spaces: An Architectural Proposal,” In International Conference on Image Analysis and Processing, pp. 47-58, 2022.

[5] X.D Duan, X.Y Wang, L.Lu, N.X. Shi, C.Liu et al., “6G Architecture Design: from Overall, Logical and Networking Perspective,” IEEE Communications Magazine, vol.61, no.7, pp.158- 164, 2023.

[6] R.Saadane, A.Chehri and S.Jeon, “AI-based modeling and data-driven evaluation for smart farming-oriented big data architecture using IoT with energy harvesting capabilities,” Sustainable Energy Technologies and Assessments, vol.52, pp.102093, 2022.

[7] T.Dolci, L.Amata, C.Manco, F.Azzalini, M.Gribaudo and L.Tanca, “Tools for Healthcare Data Lake Infrastructure Benchmarking,” Information Systems Frontiers, pp.1-22, 2024.

[8] M.Farhan, T.N Reza, F.R Badal, M,R Islam, S.M Muyeen et al., “Towards Next Generation Internet of Energy System: Framework and Trends,” Energy and AI, pp.100306, 2023.

[9] S.N.G Gourisetti, S.Bhadra, D.J Sebastian-Cardenas, M.Touhiduzzaman and O.Ahmed, “A theoretical open architecture framework and technology stack for digital twins in energy sector applications,” Energies, vol.16, no.13, pp.4853, 2023.

[10] H.Y Youssef, M.Ashfaque and J.V Karunamurthy, “Dewa randd data lake: Big data platform for advanced energy data analytics,” In 2023 International Conference on IT Innovation and Knowledge Discovery (ITIKD), pp. 1-6, 2023.

[11] V.Khare and P.Chaturvedi, “Design, control, reliability, economic and energy management of microgrid: A review,” e-Prime-Advances in Electrical Engineering, Electronics and Energy, pp.100239, 2023.

[12] V.Khare and P.Chaturvedi, “Design, control, reliability, economic and energy management of microgrid: A review,” e-Prime-Advances in Electrical Engineering, Electronics and Energy, pp.100239, 2023.

[13] A.Cuzzocrea, C.K Leung, S.Soufargi and A.M Olawoyin, “The emerging challenges of big data lakes, and a real-life framework for representing, managing and supporting machine learning on big Arctic data,” In International Conference on Intelligent Networking and Collaborative Systems, pp. 161-174, 2022.

[14] H.Jamil, F.Qayyum, N.Iqbal, M.A Khan, S.S.A Naqvi et al., “Secure Hydrogen Production Analysis and Prediction Based on Blockchain Service Framework for Intelligent Power Management System,” Smart Cities, vol.6, no.6, pp.3192-3224, 2023.

[15] G.S Ramos, D.Fernandes, J.A.P.D.M Coelho and A.L Aquino, “Toward Data Lake Technologies for Intelligent Societies and Cities,” In Sustainable, Innovative and Intelligent Societies and Cities, pp. 3-29, 2023.

[16] F.L John, D.Lakshmi and B.S Kumar, “An Overview of Artificial Intelligence, Big Data, and Internet of Things for Future Energy Systems,” Applications of Big Data and Artificial Intelligence in Smart Energy Systems, pp.25-48, 2023.

[17] M.Thirunavukkarasu, Y.Sawle and H.Lala, “A comprehensive review on optimization of hybrid renewable energy systems using various optimization techniques,” Renewable and Sustainable Energy Reviews, vol.176, pp.113192, 2023.

[18] W.Yu, Y.Liu, T.Dillon and W.Rahayu, “Edge computing-assisted IoT framework with an autoencoder for fault detection in manufacturing predictive maintenance,” IEEE Transactions on Industrial Informatics, vol.19, no.4, pp.5701-5710, 2022.

[19] W.C Shih, C.T Yang, C.T Jiang and E.Kristiani, “Implementation and visualization of a netflow log data lake system for cyberattack detection using distributed deep learning,” The Journal of Supercomputing, vol.79, no.5, pp.4983-5012, 2023.

[20] S.Park, C.S Yang and J.Kim, “Design of Vessel Data Lakehouse with Big Data and AI Analysis Technology for Vessel Monitoring System,” Electronics, vol.12, no.8, pp.1943, 2023.