The Future of Multi-cloud Infrastructures in Data Engineering for Challenge of Handling Large and Dynamic Datasets
Keywords:
Big data, cloud computing, data engineering, information retrieval, manageabilityAbstract
This paper explores the future of multi-cloud infrastructures in data engineering for the challenge of handling large and dynamic datasets. It delves into the opportunities and challenges presented by multi-clouds, focusing on their role in managing large volumes of data and complex computational tasks. The paper discusses the advantages of multi-clouds, such as manageability, flexibility, and cost-effectiveness, and their potential to enhance the efficiency and accuracy of recommender systems. It also addresses the challenges associated with implementing multi-clouds, including data privacy, resource management, and compatibility issues. The paper concludes by highlighting the promising future of hybrid cloud infrastructures in driving significant advancements in data engineering and their potential impact on various sectors.
References
Gupta U, Hsia S, Saraph V, Wang X, Reagen B, Wei GY, Lee HH, Brooks D, Wu CJ. DeepRecSys: a system for optimizing end-to-end at-scale neural recommendation inference. In: 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA), Valencia, Spain, May 30–June 3, 2020. pp. 982–995.
Zhang M, Ranjan R, Nepal S, Menzel M, Haller A. A declarative recommender system for cloud infrastructure services selection. InEconomics of Grids, Clouds, Systems, and Services: 9th International Conference, GECON 2012, Berlin, Germany, November 27-28, 2012. Proceedings 9 2012 (pp. 102-113). Springer Berlin Heidelberg.
Mell P, Grance T. The NIST Definition of Cloud Computing. Special Publication 800–145. Gaithersburg, MD, USA: National Institute of Standards and Technology; 2011.
Reddy D, Rajput RS. The future of hybrid cloud infrastructures in data engineering for scalable recommender systems. Int J Computer Appl. 2023; 185 (31): 1–4.
Verma A, Cherkasova L, Campbell RH. Aria: automatic resource inference and allocation for mapreduce environments. In: Proceedings of the 8th ACM International Conference on Autonomic Computing, Karlsruhe, Germany, June 14–18, 2011. pp. 235–244.
Mansouri Y, Prokhorenko V, Babar MA. An automated implementation of hybrid cloud for performance evaluation of distributed databases. J Netw Computer Appl. 2020; 167: 102740.
Ullah F, Dhingra S, Xia X, Babar MA. Evaluation of distributed data processing frameworks in hybrid clouds. arXiv preprint arXiv:2201.01948. January 6, 2022. Available at https://arxiv.org/pdf/2201.01948.pdf
Swapna AI, Rahman Z, Rahman MH, Akramuzzaman M. Performance evaluation of fuzzy integrated firewall model for hybrid cloud based on packet utilization. In: 2016 First IEEE International Conference on Computer Communication and the Internet (ICCCI), Wuhan, China, October 13–15, 2016. pp. 253–256.
Labba C, Ben Saoud N. Cost-based assessment of partitioning algorithms of agent-based systems on hybrid cloud environments. arXiv preprint arXiv:1709.05708. September 17, 2017. Available at https://arxiv.org/abs/1709.05708
Khalaji M, Dadkhah C. FNHSM_HRS: hybrid recommender system using fuzzy clustering and heuristic similarity measure. arXiv preprint arXiv:1909.13765. September 26, 2019. Available at https://arxiv.org/abs/1909.13765
Khalaji M, Mohammadnejad N. FCNHSMRA_HRS: improve the performance of the movie hybrid recommender system using resource allocation approach. arXiv preprint arXiv:1908.05608. August 13, 2019. Available at https://arxiv.org/abs/1908.05608
Machuca R, Sankare F. Remote data auditing and how it may affect the chain of custody in a cloud environment. arXiv preprint arXiv:2208.12759. August 26, 2022. Available at https://arxiv.org/abs/2208.12759
