Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
OpenGPT-X: Advancements, Challenges, Exploration, and Future Goals
DescriptionIn the era of Natural Language Processing with Large Language Models, the OpenGPT-X project brings forth a platform for researching, producing, and using language models. The project is a German initiative with ten collaborative partners, focusing their efforts to contribute a multilingual Open Source language model. Models trained within the project will also be used for pilot cases by industry partners and commercialized through Gaia-X federation. The memory and compute for training large language models efficiently demands high performance computing systems like JUWELS Booster. This paper outlines the advancements and challenges in the project from the perspective of Jülich Supercomputing Centre and showcases the results of exploration of novel hardware architecture conducted within the scope of the project.
Event Type
Workshop
TimeMonday, 13 November 20232:15pm - 2:18pm MST
Location505
State of the Practice
W