Home / Publications / Leveraging LLMs for Structured Data Extraction from Unstructured Patient Records
Publication

Leveraging LLMs for Structured Data Extraction from Unstructured Patient Records

Mitchell A. Klusty, Elizabeth C. Solie, Caroline N. Leach, W. Vaiden Logan, Lynnet E. Richey, John C. Gensel, David P. Szczykutowicz, Bryan C. McLellan, Emily B. Collier, Samuel E. Armstrong, V. K. Cody Bumgardner

Details

Journal arXiv preprint
Year 2025
Categories cs.AI, cs.CL
Note 9 pages, 2 figures, 2 tables, submitted to AMIA 2026 Informatics Summit

Abstract

Manual chart review remains an extremely time-consuming and resource-intensive component of clinical research, requiring experts to extract often complex information from unstructured electronic health record (EHR) narratives. We present a secure, modular framework for automated structured feature extraction from clinical notes leveraging locally deployed large language models (LLMs) on institutionally approved, HIPAA-compliant compute infrastructure. This system integrates retrieval augmented generation (RAG) and structured response methods of LLMs into a widely deployable and scalable container to provide feature extraction for diverse clinical domains. In evaluation, the framework achieved high accuracy across multiple medical characteristics present in large bodies of patient notes when compared against an expert-annotated dataset and identified several annotation errors missed in manual review.

9 pages, 2 figures, 2 tables, submitted to AMIA 2026 Informatics Summit