Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Centralized Provisioning of Large Language Models for a Research Community
DescriptionLocal support for large language models (LLMs) in a research community can address unique technological and procedural challenges that arise in an academic setting. Platforms providing multi-GPU nodes, typically found in a centralized computational resource, such as a university datacenter, can manage the large memory footprint of the open-source LLMs. Customizations employing peripheral frameworks help extend the capabilities of these models. Further, the local implementation addresses the protection of researcher IP and control of restricted data sources. This report describes recent efforts toward provisioning this popular new tool and provides guidance for recreating our approach at Arizona State University.
Event Type
Workshop
TimeSunday, 12 November 20239:50am - 9:58am MST
Location605
Programming Frameworks and System Software
W