Systems for AI - LLMs

CS8803 SAL, Spring 2024 at Georgia Tech

Where: Cherry Emerson 320
When: MW 3:30 pm - 4:45 pm

Course Description

Large Language Models (LLMs) have transformed the machine learning landscape in a very short period of time and arguably become the fastest growing subfield in machine learning. Triggered by the unprecedented popularity of ChatGPT which managed to sign-up over 100 million users in less than two months of its release, LLMs have enabled many breakthroughs in the field of generative AI.

The success of LLMs can be attributed to the systems that underpin them; the massive scale and complexity of these models are made possible by the advancements in the area of systems. In this course, we will focus on the systems that enable LLMs. In particular, we will study the latest advances in system design that make generative AI/LLMs possible and how the breakthroughs in generative AI/LLMs have influenced how we design systems.

Course Staff

Anand Iyer Instructor

anand.iyer@gatech.edu

Office Hours: KACB 3332, by appointments only.

Mingyu Guan Graduate Teaching Assistant

mingyu.guan@gatech.edu

Office Hours: Tue 3:30-4:30pm, CODA S0971T

Acknowledgements

The instructors are indebted to Google Cloud, CloudLab and Georgia Tech PACE-ICE for providing the resources for student projects. The instructors are also extremely grateful to Prof. Mosharaf Chowdhury for his course EECS 598 at the University of Michigan.