Home / Publications / Institutional Platform for Secure Self-Service Large Language Model Exploration
Publication

Institutional Platform for Secure Self-Service Large Language Model Exploration

Bumgardner V K Cody, Klusty Mitchell A, Logan W Vaiden, Armstrong Samuel E, Leach Caroline N, Hickey Caylin, Talbert Jeff

Details

Journal AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science
Year 2025
Categories cs.CR, cs.AI, cs.CL
Note 10 pages 5 figures, 1 table

Abstract

This paper introduces a user-friendly platform developed by the University of Kentucky Center for Applied AI, designed to make customized large language models (LLMs) more accessible. By capitalizing on recent advancements in multi-LoRA inference, the system efficiently accommodates custom adapters for a diverse range of users and projects. The paper outlines the system's architecture and key features, encompassing dataset curation, model training, secure inference, and text-based feature extraction. We illustrate the establishment of a tenant-aware computational network using agent-based methods, securely utilizing islands of isolated resources as a unified system. The platform strives to deliver secure, affordable LLM services, emphasizing process and data isolation, end-to-end encryption, and role-based resource authentication. This contribution aligns with the overarching goal of enabling simplified access to cutting-edge AI models and technology in support of scientific discovery and the development of biomedical informatics.