ZurichNLP #14
Tue, 03 Dec
|Zürich
Jonas Hübotter and Imanol Schlag from ETH Zurich on learning at test-time and Swiss sovereign AI.
Time & Location
03 Dec 2024, 18:00 – 20:00
Zürich, OAT ETH Zurich (14th floor), Andreasstrasse 5, 8050 Zürich, Switzerland
About the Event
Imanol Schlag from ETH Zurich on The Swiss AI LLM Effort: Building Transparent and Responsible AI for Switzerland and Beyond:
This talk will present the Swiss AI Large Language Model (LLM) Effort, a collaborative initiative led by ETH Zurich and EPFL. We aim to develop a 70B parameter LLM trained on 10+ trillion high-quality, multilingual tokens, with a focus on transparency, ethical alignment, and support for Swiss national languages. We'll share technical insights into our training approach on the Alps supercomputer, including our strategies for efficient scaling across thousands of GH200 GPUs. Our commitment to open science and legal compliance forms the foundation for disseminating AI technology across Swiss academia and industry. We'll discuss how this effort can drive innovation in various sectors, exemplified by projects like Meditron for healthcare and Ethel for education while providing a strong general-purpose AI foundation for Switzerland.
Jonas Hübotter from ETH Zurich on Efficiently…