Robust MLOps Frameworks for Automating the AI/ML Lifecycle in Cloud Environments
Keywords:
MLOps, Automated AI Pipelines, Hyperparameter Optimization, Cloud AI Lifecycle, CI/CD for AI.Abstract
MLOps has emerged as a critical practice for managing the lifecycle of AI/ML models, from development to deployment. This paper presents a comprehensive MLOps framework designed for automating model training, validation, deployment, and monitoring in cloud environments. The framework incorporates automated hyperparameter optimization, continuous integration/continuous deployment (CI/CD) pipelines, and scalable cloud-native tools to streamline the AI/ML lifecycle. Case studies demonstrate improved model reliability, faster deployment times, and reduced operational overhead. These advancements highlight the transformative potential of MLOps for enterprise-grade AI adoption.
Downloads
References
Ahmad, K., Maabreh, M., Ghaly, et al., 2022. Developing future human-centered smart cities: critical analysis of smart city security, data management, and ethical challenges. Comp. Sci. Review 43 (Feb.), 100452.
Alzahrani, T., Al-Nuaimy, W., Al-Bander, B., 2019. Hybrid feature learning and engineering based approach for face shape classification. In: 2019 International Conference on Intelligent Systems and Advanced Computing Sciences (ISACS). IEEE, pp. 1–4.
Anik, A.I., Bunt, A., 2021. In: Data-centric explanations: explaining training data of machine learning systems to promote transparency. IEEE, pp. 1–13.
Ben-David, E., Rabinovitz, C., Reichart, R., 2020. PERL: pivot-based domain adaptation for pre-trained deep contextualized embedding models. Trans. Assoc. Comp. Linguistics 8 (Jul.), 504–521.
Berard, A., Kim, Z.M., Nikoulina, V., et al., 2020. A multilingual neural machine translation model for biomedical data. arXiv:2008.02878.
Bifulco, I., Cirillo, S., Esposito, C., et al., 2021. An intelligent system for focused crawling from Big Data sources. Expert Syst. Appl. 184 (1), 115560.
Bogner, J., Verdecchia, R., Gerostathopoulos, I., 2021. Characterizing technical debt and antipatterns in AI-based systems: a systematic mapping study. In: 2021 IEEE/ACM International Conference on Technical Debt (TechDebt). IEEE, pp. 64–73.
Bosser, J.D., S€ orstadius, E., Chehreghani, M.H., 2020. Model-centric and data-centric aspects of active learning for neural network models. arXiv:2009.10835.
Caruccio, L., Cirillo, S., Deufemia, V., et al., 2021. In: Efficient discovery of functional dependencies from incremental databases. ACM, pp. 400–409.
Chakraborty, G., Krishna, M., 2014. Analysis of unstructured data: applications of text analytics and sentiment mining. In: SAS Global Forum, pp. 1288–2014.
Chao, Z., Yue, W., Guanghan, Z., 2021. Pseudo-label generation method based on wind turbine SCADA data. In: 2021 7th International Conference on Condition Monitoring of Machinery in Non-stationary Operations. CMMNO), IEEE, pp. 90–94.
Chen, A., Chow, A., Davidson, A., et al., 2020a. Developments in mlflow: a system to accelerate the machine learning lifecycle. In: Proceedings of the Fourth International Workshop on Data Management for End-To-End Machine Learning. ACM, pp. 1–4.
Chen, S., Gao, D., Wang, L., et al., 2020b. Cervical cancer single cell image data augmentation using residual condition generative adversarial networks. In: 2020 3rd International Conference on Artificial Intelligence and Big Data. ICAIBD), IEEE, pp. 237–241.
Chen, K.H., Su, H.P., Chuang, W.C., et al., 2022. In: Apache submarine: a unified machine learning platform made simple. ACM, pp. 101–108.
Cooney, R., Wan, A.H., O’Donncha, F., et al., 2021. Designing environmentally efficient aquafeeds through the use of multicriteria decision support tools. Curr. Opinion Environ. Sci. Health 23 (3), 100276.
Crawshaw, M., 2020. Multi-task learning with deep neural networks: a Survey. arXiv: 2009.09796.
Czakon, J., 2020. ML experiment tracking: what it is, why it matters, and how to implement it. Available at: https://neptune.ai/blog/ml-experiment-tracking.
Dilmegani, C., 2021. MLOps tools & platforms landscape: in-depth guide for 2022. Available at: https://research.aimultiple.com/mlops-tools/.
Dou, Z.Y., Hu, J., Anastasopoulos, A., et al., 2019. Unsupervised domain adaptation for neural machine translation with domain-aware feature embeddings. arXiv: 1908.10430.
Eberendu, A.C., 2016. Unstructured data: an overview of the data of big data. Int. J. Comput. Trends Technol. 38 (1), 46–50.
Fursin, G., Guillou, H., Essayan, N., 2020. CodeReef: an open platform for portable MLOps, reusable automation actions and reproducible benchmarking. arXiv: 200107935.
Gandomi, A., Haider, M., 2015. Beyond the hype: big data concepts, methods, and analytics. Int. J. Info Manage. 35 (2), 137–144.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
