Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 8 - LLM Evaluation

Hello, everyone, and welcome to lecture 8 of CME 295.

So today's topic will be LLM evaluation. And I think this class is probably

one of the most important classes of this quarter because the idea is if we don't how

to measure the performance of our LLM, we don't really know what to improve.

And so this class will focus on how we can quantify how the LLM performs