Open Access
An Advanced Analytical Architecture for Leveraging Big Data in Artificial Intelligence Systems: Techniques, Optimization Strategies, and Case-Based Evaluation
4
Faculty of Information Technology Vietnam Institute of Intelligent Computing Hanoi, Vietnam
4
Department of Machine Learning and Analytics Ho Chi Minh Digital Technology University Ho Chi Minh City, Vietnam
Abstract
The rapid evolution of Artificial Intelligence (AI) systems has been significantly accelerated by the proliferation of Big Data, enabling more accurate, scalable, and adaptive computational models. However, integrating Big Data with AI systems introduces critical challenges related to data heterogeneity, computational scalability, privacy constraints, and system optimization. This paper proposes an advanced analytical architecture designed to efficiently leverage Big Data for AI-driven systems through structured data pipelines, optimization strategies, and case-based evaluation frameworks. The study synthesizes foundational theories in machine learning, distributed computing, and data analytics while critically examining architectural models such as MapReduce-based frameworks, edge-cloud hybrid systems, and machine learning pipelines. Drawing upon established literature, including healthcare analytics, Industry 4.0 systems, and privacy-preserving data models, the proposed framework integrates multi-layered data processing, adaptive optimization mechanisms, and AI model orchestration techniques. The research also highlights the socio-technical implications of Big Data systems, emphasizing ethical concerns, interpretability, and scalability constraints as emphasized in prior scholarly discourse (Boyd and Crawford, 2012). Findings suggest that a unified analytical architecture improves computational efficiency, reduces latency in decision-making, and enhances predictive accuracy across domains such as healthcare, smart systems, and financial analytics. The paper contributes a structured conceptual model for researchers and practitioners aiming to design next-generation AI systems powered by Big Data ecosystems.
Keywords
Big Data Analytics,
Artificial Intelligence,
Analytical Architecture,
Machine Learning Systems
References
Abdellatif, A.A., Mohamed, M.A., Chiasserini, C.F. and Erbad, A. (2019). Edge Computing for Smart Health:Context-Aware Approaches, Opportunities, and Challenges. IEEE Network, 33(3), 196-203.
Aggarwal, C.C. (2015). Data Mining: The Textbook. Springer.
Alpaydin, E. (2020). Introduction to Machine Learning, 4th Edition, MIT Press.
Boyd, D. and Crawford, K. (2012). Critical Questions for Big Data: Provocations for a Cultural, Technological,and Scholarly Phenomenon. Information, Communication & Society, 15(5), 662-679.
Chen, C., Zhang, B. and He, X. (2015). A Survey on Big Data Analytics in Healthcare. Journal of Biomedical andHealth Informatics, 19(4), 1193-1209.
Chen, H., Chiang, R.H.L. and Storey, V.C. (2012). Business Intelligence and Analytics: From Big Data to BigImpact. MIS Quarterly, 36(4), 1165-1188.
Dakup, P.P. et al. (2023). Targeted Quantification of Protein Phosphorylation and its Contributions towardsMathematical Modeling of Signaling Pathways. Molecules, 28(3), 1143.
Dean J. and Ghemawat, S. (2008). MapReduce: Simplified Data Processing on Large Clusters. Communications of the ACM, 51(1).
Emmert-Streib, F. (2020). From the Digital Data Revolution to Digital Health and Digital Economy Toward aDigital Society: Pervasiveness of Artificial Intelligence. arXiv preprint arXiv, 2008.12672, August.
Gandomi, A. and Haider, M. (2015). Beyond the Hype: Big Data Concepts, Methods, and Analytics. InternationalJournal of Information Management, 35(2), 137-144.
Goodfellow, I., Bengio, Y. and Courville, A. (2016). Deep Learning. MIT Press.
Hajkowicz, S., Sanderson, C., Karimi, S., Bratanova, A. and Naughtin, C. (2023). Artificial Intelligence Adoptionin the Physical Sciences, Natural Sciences, Life Sciences, Social Sciences and the Arts and Humanities: ABibliometric Analysis of Research Publications from 1960-2021. arXiv preprint arXiv:2306.09145, June.
Himeur, Y. et al. (2023). AI-Big Data Analytics for Building Automation and Management Systems: A Survey,Actual Challenges and Future Perspectives. Artificial Intelligence Review, 56(6), 4929-5021.
Hiniduma, K., Byna, S. and Bez, J.L. (2024). Data Readiness for AI: A 360-Degree Survey. arXiv preprintarXiv:2404.05779, April.
Hinton, G. (2018). Deep Learning—A Technology with the Potential to Transform Health Care. JAMA, 320(11),1101-1102.
Jagatheesaperumal, H., Rahouti, M., Ahmad, K., Al-Fuqaha, A. and Guizani, M. (2021). The Duo of ArtificialIntelligence and Big Data for Industry 4.0: Review of Applications, Techniques, Challenges, and FutureResearch Directions. IEEE Access, 9, 127527-127552.
Kua, J., Loke, S.W., Arora, C., Fernando, N. and Ranaweera, C. (2021). Internet of Things in Space: A ReviewofOpportunities and Challenges from Satellite-Aided Computing to Digitally-Enhanced Space Living. Sensors,21(23), 8117.
L’Heureux, A., Grolinger, K., Elyamany, H.F. and Capretz, M.A.M. (2017). Machine Learning with Big Data:Challenges and Approaches. IEEE Access, 5, 7776-7797.
Laney, D. (2001). 3D Data Management: Controlling Data Volume, Velocity, and Variety. META Group ResearchNote, February.
Lynch, C. (2008). Big Data: How Do Your Data Grow?. Nature, 455(7209), 28-29.
Marr, B. (2016). Big Data in Practice: How 45 Successful Companies Used Big Data Analytics to DeliverExtraordinary Results. Wiley.
Mehta, N., Pandit, A. and Shukla, S. (2019). Transforming Healthcare with Big Data Analytics and ArtificialIntelligence: A Systematic Mapping Study. Journal of Biomedical Informatics, 100, 103311.
Obschonka, M. and Audretsch, D.B. (2019). Artificial Intelligence and Big Data in Entrepreneurship: A NewEra has Begun. arXiv preprint arXiv:1906.00553, June.
Palermo, C., Leith, E., Cutrona, L. and Porcello, L. (1960). Optical Data Processing and Filtering Systems. IRETransactions on Information Theory, 6(3), 386-400.
Rahmani, M., Babanejad, R., and Mirian, M.S. (2021). Artificial Intelligence Approaches and Mechanisms forBig Data Analytics: A Systematic Study. Journal of Big Data, 8(1), 1-25.
Rubel, M.T.H., Emran, A.K.M., Borna, R.S., Saha, R. and Hasan, M. (2024). AI-Driven Big Data Transformationand Personally Identifiable Information Security in Financial Data: A Systematic Review. Journal of MachineLearning, Data Engineering and Data Science, 1(01), 114-128.
Sarma, A.A.D., Jain, A. and Machanavajjhala, A. (2014). Privacy-Preserving Data Analytics: The Next Frontier.IEEE Data Eng. Bull., 37(4), 52-58.
Senthil, R., Anand, T., Somala, C.S. and Saravanan, K.M. (2024). Bibliometric Analysis of Artificial Intelligencein Healthcare Research: Trends and Future Directions. Future Healthcare Journal, 11(3), 100182.
Sultana, R. (2024). Artificial Intelligence for Decision Making in the Era of Big Data Evolution. Journal ofBusiness Intelligence and Management Information Systems Research, 1(01), 17-40.
Wang, L. and Alexander, C.A. (2020). Big Data Analytics in Medical Engineering and Healthcare: Methods,Advances and Challenges. Journal of Medical Engineering & Technology, 44(6), 267-283.
Similar Articles
- Dr. Sara Mohammadi, A Scalable Python-Based Architecture for Causal Structure Learning in Non-Gaussian Linear Systems Using the PyCD-LiNGAM Framework , International Journal of Intelligent Data and Machine Learning: Vol. 3 No. 06 (2026): Volume 03 Issue 06
- Dr. Eleanor Vance, Dr. Kenji Sato, Architectural Frameworks and Security Challenges in Wireless Sensor Networks: A Critical Review , International Journal of Intelligent Data and Machine Learning: Vol. 2 No. 10 (2025): Volume 02 Issue 10
- Dr. Elias R. Hoffmann, Predictive Behavioral Cybersecurity for Smart Healthcare and Mobile Ecosystems: An Ensemble Machine Learning Framework for Dynamic Malware Intelligence , International Journal of Intelligent Data and Machine Learning: Vol. 3 No. 01 (2026): Volume 03 Issue 01
- Ahmed Z. Farouk, QUANTUM COMPUTATIONAL AND MACHINE LEARNING PARADIGMS FOR FINANCIAL OPTIMIZATION, RISK MANAGEMENT, AND DATA DIVERSITY: A COMPREHENSIVE THEORETICAL SYNTHESIS , International Journal of Intelligent Data and Machine Learning: Vol. 3 No. 02 (2026): Volume 03 Issue 02
- Dr. Priya Sharma, A Deep Learning-Based Personalized Recommendation Architecture for E-Commerce Using CNN-Driven Sequential Representation Learning and Temporal User Behavior Optimization , International Journal of Intelligent Data and Machine Learning: Vol. 3 No. 05 (2026): Volume 03 Issue 05
- Ananya Patel (Ph.D. Candidate), ADVANCING FINANCIAL PREDICTION THROUGH QUANTUM MACHINE LEARNING , International Journal of Intelligent Data and Machine Learning: Vol. 2 No. 02 (2025): Volume 02 Issue 02
- Dr. Hannah Brown, Ahmed Al-Farsi, BRIDGING DEEP LEARNING AND ADAPTIVE SYSTEMS: A PERFORMANCE STUDY ON CIFAR-10 IMAGE CLASSIFICATION , International Journal of Intelligent Data and Machine Learning: Vol. 2 No. 03 (2025): Volume 02 Issue 03
- Mr. Ram Pratap Singh, An Intelligent Machine Learning Framework for Customer Churn Prediction in CRM Systems , International Journal of Intelligent Data and Machine Learning: Vol. 3 No. 07 (2026): Volume 03 Issue 07
- Dr. Ali H. Al-Najjar, Dr. Peter M. Osei, ADVANCED MACHINE LEARNING FOR CARDIAC DISEASE CLASSIFICATION: A PERFORMANCE ANALYSIS , International Journal of Intelligent Data and Machine Learning: Vol. 1 No. 01 (2024): Volume 01 Issue 01
- Dr. Elena Petrova, Prof. David J. Hernandez, MACHINE LEARNING MODEL IMPLEMENTATION STRATEGIES AND PREDICTIVE FACTORS FOR PREECLAMPSIA FORECASTING: A REVIEW , International Journal of Intelligent Data and Machine Learning: Vol. 1 No. 01 (2024): Volume 01 Issue 01
You may also start an advanced similarity search for this article.