Open Access
Enhancing Clinical Decision-Making Using Generative AI-Powered Knowledge Retrieval Systems: A Review of Emerging Approaches and Challenges
4
Independent Researcher, USA
Abstract
A wealth of biomedical information and literature, complex electronic health records (EHRs), disjointed guidance, and time pressures associated with the care process are all affecting clinical decision-making. The objective of this review was to discuss the potential of generative AI-driven knowledge retrieval systems for clinical decision-making and to describe some of the technical, compliance, ethical, and implementation challenges and limitations. This purposively selected, 42-source structured narrative review with scoping review elements was conducted based on publications retrieved from PubMed, Scopus, IEEE Xplore, Google Scholar, WHO/FDA, Web of Science, and major clinical informatics journals from 2020-2026. Study results demonstrate that retrieval-augmented generation (RAG) systems can provide accurate and relevant information by grounding content generated by large language models (LLMs) in clinical guidelines, biomedical literature, drug databases, EHR data, and institutional protocols. The results showed that RAG systems yielded better biomedical system performance than the baseline LLM, with an OR of 1.35 (95% CI: 1.19, 1.53). There are potential impacts, however, such as hallucinations, incomplete retrieval, incomplete and comprehensive datasets, privacy breaches, and lack of multilingual validation. The study concludes that evidence-based, auditable, locally adaptable, and supervised by licensed clinician retrieval systems with generative AI can support safer, faster, and more relevant decision-making processes in clinical settings. Future studies should involve prospective multi-site implementation, a clear retrieval pipeline, multilingual datasets, EHR integration, ongoing monitoring, and clinical governance models to ensure safe use.
Keywords
Generative AI in healthcare,
Clinical decision support systems,
Retrieval-augmented generation,
Medical knowledge retrieval,
Electronic health records,
Evidence-based clinical decision-making.
References
N. C. Apathy, A. J. Holmgren, and D. A. Cross, “Physician EHR time and visit volume following adoption of team-based documentation support,” JAMA Internal Medicine, vol. 184, no. 10, pp. 1212–1221, 2024. https://jamanetwork.com/journals/jamainternalmedicine/articlepdf/2822382/jamainternal_apathy_2024_oi_240052_1727970846.4993.pdf
A. Nooruddin, A. Lal, S. M. F. Ahmed, M. H. Ghori, N. Adnan, and F. Umer, “Use of generative artificial intelligence models in healthcare: A scoping review,” BMC Artificial Intelligence, vol. 2, no. 1, p. 11, 2026. https://link.springer.com/content/pdf/10.1186/s44398-026-00029-6.pdf
R. T. Sutton, D. Pincock, D. C. Baumgart, D. C. Sadowski, R. N. Fedorak, and K. I. Kroeker, “An overview of clinical decision support systems: Benefits, risks, and strategies for success,” npj Digital Medicine, vol. 3, no. 1, p. 17, 2020. https://www.nature.com/articles/s41746-020-0221-y.pdf
S. A. Rabbani, M. El-Tanani, S. Sharma, S. S. Rabbani, Y. El-Tanani, R. Kumar, and M. Saini, “Generative artificial intelligence in healthcare: Applications, implementation challenges, and future directions,” BioMedInformatics, vol. 5, no. 3, p. 37, 2025. https://www.mdpi.com/2673-7426/5/3/37
P. K. R. Prakashkumar, “Analytical Study of Vertex–Oracle Cloud Integration in Enterprise ERP Systems for Automated Tax Compliance and Efficient Financial Closings,” International Journal of Accounting and Management Sciences, vol. 4, no. 4, 2025. https://scipubhouse.com/international-journal-of-accounting-and-management-sciences-ijams/content/ijams-vol-4-no-4-october-2025/analytical-study-of-vertex-oracle-cloud-integration-in-enterprise-erp-systems-for-automated-tax-compliance-and-efficient-financial-closings/
P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, et al., “Retrieval-augmented generation for knowledge-intensive NLP tasks,” in Advances in Neural Information Processing Systems, vol. 33, pp. 9459–9474, 2020. https://proceedings.neurips.cc/paper/2020/file/6b493230205f780e1bc26945df7481e5-Paper.pdf
L. M. Amugongo, P. Mascheroni, S. Brooks, S. Doering, and J. Seidel, “Retrieval augmented generation for large language models in healthcare: A systematic review,” PLOS Digital Health, vol. 4, no. 6, p. e0000877, 2025. https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0000877&type=printable
K. D. Pagana, T. J. Pagana, and T. N. P. Bullen, Mosby’s Manual of Diagnostic and Laboratory Tests. Elsevier Health Sciences, 2021. https://books.google.com/books?hl=en&lr=&id=laQsEAAAQBAJ&oi=fnd&pg=PP1&dq=The+symptoms,+risk+factors,+lab+test+results,+and+comorbidities+are+also+processed,+and+differential+diagnoses+for+conditions+are+provided+in+line+with+the+guidelines+to+support+diagnosis.&ots=oV31_zhTYV&sig=9Ch-gkLZjyx3k0aSlGlak4y-g3Q
P. Fritz, A. Kleinhans, R. Raoufi, A. Sediqi, N. Schmid, S. Schricker, et al., “Evaluation of medical decision support systems (DDX generators) using real medical cases of varying complexity and origin,” BMC Medical Informatics and Decision Making, vol. 22, no. 1, p. 254, 2022. https://link.springer.com/content/pdf/10.1186/s12911-022-01988-2.pdf
F. F. Alu and S. Oluwadare, “An auditable and source-verified framework for clinical AI decision support: Integrating retrieval-augmented generation with data provenance,” Frontiers in Artificial Intelligence, vol. 9, p. 1737532, 2026. https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2026.1737532/pdf
L. Huang, W. Yu, W. Ma, W. Zhong, Z. Feng, H. Wang, et al., “A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions,” ACM Transactions on Information Systems, vol. 43, no. 2, pp. 1–55, 2025. https://dl.acm.org/doi/pdf/10.1145/3703155
S. Pretorius, V. Bartle, S. Bellass, E. R. Blackburn, H. Bold, R. Cooper, et al., “Making clinical guidelines work for people with multiple long term conditions: Analysis and recommendations from review of single condition guidelines,” BMJ Medicine, vol. 5, no. 1, p. e001495, 2026. https://pmc.ncbi.nlm.nih.gov/articles/PMC12933760/
Sardana, K. S. Chadha, and S. Durgam, “Advancing Healthcare Technology Through Secure Data Systems,” 2025. https://doi.org/10.12732/ijam.v38i10s.1138
S. Bedi, Y. Liu, L. Orr-Ewing, D. Dash, S. Koyejo, A. Callahan, et al., “Testing and evaluation of health care applications of large language models: A systematic review,” JAMA, vol. 333, no. 4, pp. 319–328, 2025. https://pmc.ncbi.nlm.nih.gov/articles/PMC11480901/
S. K. Vishwakarma, “AI-driven predictive risk modelling for aerospace supply chains,” International Journal of Innovation in Business & Economics and Applied Journal, 2025. https://www.iibajournal.org/index.php/iibeaj/article/view/64
S. Rangu and K. S. Chadha, “Cloud-powered healthcare & insurance transformation with CRM and advanced analytics,” International Journal of Intelligent Systems and Applications in Engineering, 2025. https://www.ijisae.org/index.php/IJISAE/article/view/7915
G. Lichtner, B. S. Alper, C. Jurth, C. Spies, M. Boeker, J. J. Meerpohl, and F. von Dincklage, “Representation of evidence-based clinical practice guideline recommendations on FHIR,” Journal of Biomedical Informatics, vol. 139, p. 104305, 2023. https://www.sciencedirect.com/science/article/pii/S1532046423000266
S. K. RaoVanama, “AI-Augmented CI/CD Pipeline Optimization for Scalable Cloud-Native Deployment,” International Journal of Artificial Intelligence, Data Science, and Machine Learning, vol. 5, no. 4, pp. 175–187, 2024. https://ijaidsml.org/index.php/ijaidsml/article/download/368/338
N. Khalid, A. Qayyum, M. Bilal, A. Al-Fuqaha, and J. Qadir, “Privacy-preserving artificial intelligence in healthcare: Techniques and applications,” Computers in Biology and Medicine, vol. 158, p. 106848, 2023. https://www.sciencedirect.com/science/article/pii/S001048252300313X
B. J. Wells, H. M. Nguyen, A. McWilliams, M. Pallini, A. Bovi, A. Kuzma, et al., “A practical framework for appropriate implementation and review of artificial intelligence (FAIR-AI) in healthcare,” npj Digital Medicine, vol. 8, no. 1, p. 514, 2025. https://www.nature.com/articles/s41746-025-01900-y.pdf
A. Ubale, “Beyond Telematics: Leveraging Generative AI for Synthetic Accident Reconstruction and Liability Attribution in Autonomous Vehicle Claims,” International Journal of AI, BigData, Computational and Management Studies, vol. 4, no. 4, pp. 119–124, 2023. https://ijaibdcms.org/index.php/ijaibdcms/article/download/356/352
Y. Lu, X. Zhao, and J. Wang, “ClinicalRAG: Enhancing clinical decision support through heterogeneous knowledge retrieval,” in Proceedings of the 1st Workshop on Towards Knowledgeable Language Models (KnowLLM 2024), Aug. 2024, pp. 64–68. https://aclanthology.org/2024.knowllm-1.6.pdf
G. Mallardi, F. Calefato, L. Quaranta, and F. Lanubile, “Integrating AI into healthcare systems: A multivocal literature review,” Smart Health, vol. 39, p. 100631, 2026. https://www.sciencedirect.com/science/article/pii/S2352648325000923
K. S. Chadha, P. R. Vennamaneni, and J. Sardana, “Leveraging Advanced Analytics and AI-Powered Solutions for Transforming Healthcare and Retail E-Commerce: Enhancing Data Security, Personalization, and Compliance,” International Journal of Applied Mathematics, vol. 38, no. 9s, pp. 1310–1334, 2025. https://doi.org/10.12732/ijam.v38i9s.862
D. Van Veen, C. Van Uden, L. Blankemeier, J. B. Delbrouck, A. Aali, C. Bluethgen, et al., “Adapted large language models can outperform medical experts in clinical text summarization,” Nature Medicine, vol. 30, no. 4, pp. 1134–1142, 2024. https://pmc.ncbi.nlm.nih.gov/articles/PMC11479659/
A. J. Holmgren, C. A. Sinsky, L. Rotenstein, and N. C. Apathy, “National comparison of ambulatory physician electronic health record use across specialties,” Journal of General Internal Medicine, vol. 39, no. 14, pp. 2868–2870, 2024. https://link.springer.com/content/pdf/10.1007/s11606-024-08930-4.pdf
S. Rangu, “Analyzing the Impact of AI-Powered Call Center Automation on Operational Efficiency in Healthcare,” JISEM Journal, 2025. https://www.jisem-journal.com/index.php/journal/article/view/8901
J. Sohn, Y. Park, C. Yoon, S. Park, H. Hwang, M. Sung, et al., “Rationale-guided retrieval augmented generation for medical question answering,” in Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1, Apr. 2025, pp. 12739–12753. https://aclanthology.org/2025.naacl-long.635.pdf
C. Wu, P. Qiu, J. Liu, H. Gu, N. Li, Y. Zhang, et al., “Towards evaluating and building versatile large language models for medicine,” npj Digital Medicine, vol. 8, no. 1, p. 58, 2025. https://www.nature.com/articles/s41746-024-01390-4
A. Ramaswamy, A. Tyagi, H. Hugo, J. Jiang, P. Jayaraman, M. Jangda, et al., “Chatgpt Health performance in a structured test of triage recommendations,” Nature Medicine, vol. 32, no. 5, pp. 1671–1675, 2026. https://www.nature.com/articles/s41591-026-04297-7_reference.pdf
K. S. Chadha, “Zero-Trust Data Architecture for Multi-Hospital Research: HIPAA-Compliant Unification of EHRs, Wearable Streams, and Clinical Trial Analytics,” IJCESEN, 2025. https://ijcesen.com/index.php/ijcesen/article/view/3477
S. Liu, A. B. McCoy, and A. Wright, “Improving large language model applications in biomedicine with retrieval-augmented generation: A systematic review, meta-analysis, and clinical development guidelines,” Journal of the American Medical Informatics Association, vol. 32, no. 4, pp. 605–615, 2025. https://academic.oup.com/jamia/article-pdf/32/4/605/61442713/ocaf008.pdf
V. Mehta, A. Komanduri, R. S. Bhadouriya, V. Mehta, M. D. Johnson, P. Shrestha, et al., “Evaluating transparency in AI/ML model characteristics for FDA-reviewed medical devices,” npj Digital Medicine, vol. 8, no. 1, p. 673, 2025. https://www.nature.com/articles/s41746-025-02052-9.pdf
J. G. You, T. Hernandez-Boussard, M. A. Pfeffer, A. Landman, and R. G. Mishuris, “Clinical trials informed framework for real world clinical implementation and deployment of artificial intelligence applications,” npj Digital Medicine, vol. 8, no. 1, p. 107, 2025. https://www.nature.com/articles/s41746-025-01506-4.pdf
N. Kumar, “Edge Computing Patterns for Real-Time Order Flow Optimization,” International Journal of Applied Mathematics, 2025. https://doi.org/10.12732/ijam.v38i12s.1494
T. D. Azad, H. M. Krumholz, and S. Saria, “Principles to guide clinical AI readiness and move from benchmarks to real-world evaluation,” Nature Medicine, pp. 1–3, 2026. https://www.nature.com/articles/s41591-025-04198-1
J. C. Kwong, L. Erdman, A. Khondker, M. Skreta, A. Goldenberg, M. D. McCradden, et al., “The silent trial: The bridge between bench-to-bedside clinical AI applications,” Frontiers in Digital Health, vol. 4, p. 929508, 2022. https://www.frontiersin.org/journals/digital-health/articles/10.3389/fdgth.2022.929508/pdf
G. Xiong, Q. Jin, Z. Lu, and A. Zhang, “Benchmarking retrieval-augmented generation for medicine,” in Findings of the Association for Computational Linguistics: ACL 2024, Aug. 2024, pp. 6233–6251. https://aclanthology.org/2024.findings-acl.372.pdf
H. Smith, “Clinical AI: Opacity, accountability, responsibility and liability,” AI & Society, vol. 36, no. 2, pp. 535–545, 2021. https://link.springer.com/content/pdf/10.1007/s00146-020-01019-6.pdf
R. Hariharan, “Zero Trust Security in Multi-Tenant Cloud Environments,” JISEM Journal, 2025. https://www.jisem-journal.com/index.php/journal/article/view/8899
K. Lekadir, A. F. Frangi, A. R. Porras, B. Glocker, C. Cintas, C. P. Langlotz, et al., “FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare,” BMJ, vol. 388, p. e081554, 2025. https://www.bmj.com/content/bmj/388/bmj-2024-081554.full.pdf
S. Samala, “Architecting Multi-Instance Jira Deployments: Scalability Challenges for Global Enterprises,” International Journal of Engineering Applications, 2025. https://gprjournals.org/journals/index.php/ijea/article/view/353
Most read articles by the same author(s)
- Dr. Aarav Sharma, Dr. Meera Kulkarni, An Integrated NDVI-Driven Predictive Model for Assessing Protein Concentration in Rice Crops and Nitrogen Status in Rice Leaves Through Aerial Imaging and Regression Analysis , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 07 (2026): Volume 03 Issue 07
- Dr. Ali Hosseini, Deep Convolutional Neural Network-Based Adaptive Chatbot Framework for Personalized Educational Support in Autism Spectrum Disorder , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 06 (2026): Volume 03 Issue 06
- Rizky Pratama, Dinda Maharani, Computational Representation and Structural Enhancement of Nature-Derived Collective Monitoring Behaviors , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 04 (2026): Volume 03 Issue 04
- Dr. Elara V. Sorenson, Deep Contextual Understanding: A Parameter-Efficient Large Language Model Approach To Fine-Grained Affective Computing , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 10 (2025): Volume 02 Issue 10
- Michael Andersson, Optimizing Continuous Schema Evolution and Zero-Downtime Microservices in Enterprise Data Architectures , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 01 (2026): Volume 03 Issue 01
- Dr. James William Carter, Dr. Emily Rose Thompson, Class-Imbalance Aware Deep Learning Framework for Accurate Rice Seed Germination Classification and Robust Seedling Identification , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 05 (2026): Volume 03 Issue 05
- Dr. Jakob Schneider, ALGORITHMIC INEQUITY IN JUSTICE: UNPACKING THE SOCIETAL IMPACT OF AI IN JUDICIAL DECISION-MAKING , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 01 (2025): Volume 02 Issue 01
- Serhii Yakhin, Comparative Review of Clean Architecture and Vertical Slice Architecture Approaches for Enterprise .NET Applications , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 12 (2025): Volume 02 Issue 12
- Dr. Alessia Romano, Prof. Marco Bianchi, DEVELOPING AI ASSISTANCE FOR INCLUSIVE COMMUNICATION IN ITALIAN FORMAL WRITING , International Journal of Advanced Artificial Intelligence Research: Vol. 1 No. 01 (2024): Volume 01 Issue 01
- Dr. Ayesha Siddiqui, ENHANCED IDENTIFICATION OF EQUATORIAL PLASMA BUBBLES IN AIRGLOW IMAGERY VIA 2D PRINCIPAL COMPONENT ANALYSIS AND INTERPRETABLE AI , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 02 (2025): Volume 02 Issue 02
Similar Articles
- Dr. Wei Zhang, Dr. Li Chen, An Intelligent Knowledge-Driven Clinical Decision Support Framework for Predictive Comorbidity Risk Assessment and Healthcare Decision-Making , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 08 (2026): Volume 03 Issue 08
- Sri Charan Chowdary Konidina, An Analytical Study of Behavior-Aware Retrieval-Augmented Generation Frameworks in Enterprise Software Ecosystems for Optimizing User Navigation and Decision Support , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 08 (2026): Volume 03 Issue 08
- Dr. Haruto Nakamura, Dr. Yui Takahashi, A Deep Unsupervised Artificial Intelligence Model for Automated Prostate Cancer Prediction Through Latent Pattern Discovery and Clinical Data Analysis , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 08 (2026): Volume 03 Issue 08
- Suprajyotsna Dasari , Automated Testing Techniques for Enterprise Software Systems with GenAI Integration , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 09 (2026): Volume 03 Issue 09
- Dr. Elias T. Vance, Prof. Camille A. Lefevre, ENHANCING TRUST AND CLINICAL ADOPTION: A SYSTEMATIC LITERATURE REVIEW OF EXPLAINABLE ARTIFICIAL INTELLIGENCE (XAI) APPLICATIONS IN HEALTHCARE , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 10 (2025): Volume 02 Issue 10
- Rahul Reddy Hanumanthgari, A Longitudinal Patient Reasoning Layer for Intelligent Sepsis Surveillance in Real-Time Laboratory Networks , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 01 (2025): Volume 02 Issue 01
- Dr. Koffi Kouame, Virtual System Modeling with Computational Intelligence in Modern Program Coordination Frameworks , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 07 (2026): Volume 03 Issue 07
- Kasun D. Perera, Nadeesha R. Fernando, Interpretable AI-Based Architecture for Early Prediction of Solid-State Drive Failures , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 09 (2026): Volume 03 Issue 09
- Dr. Larian D. Venorth, Prof. Elias J. Vance, A Machine Learning Approach to Identifying Maternal Risk Factors for Congenital Heart Disease , International Journal of Advanced Artificial Intelligence Research: Vol. 2 No. 08 (2025): Volume 02 Issue 08
- Sravan Kumar Nidiganti, A Systems-Level Framework for Evaluating Healthcare Ecosystem Quality, Complexity, and Member Outcomes , International Journal of Advanced Artificial Intelligence Research: Vol. 3 No. 07 (2026): Volume 03 Issue 07
1-10 of 101
Next
You may also start an advanced similarity search for this article.