How Do Transformers Work?

Name: How Do Transformers Work?
Uploaded: 2024-10-21T17:09:57Z
Duration: 1 h 15 min 41 s
Channel: Simons Institute for the Theory of Computing
Description: Ankur Moitra explains the mathematical and theoretical foundations of how transformer architectures and attention mechanisms function.

Simons Institute for the Theory of Computing

77K subscribers • 30 videos on Hallway • University channel

YouTube

One of the most-watched uploads on Simons Institute, a conference or university channel Hallway lists. Nobody has recommended it in the communities yet, so it ranks below community picks.
Presented by Ankur Moitra, MIT

Advanced. Deep dive for people who know the field.

8.9K views2 years ago

AI and machine learning Computer science Transformers and LLMs Computation and complexity Math for machine learning

Ankur Moitra explains the mathematical and theoretical foundations of how transformer architectures and attention mechanisms function.

Ankur Moitra (MIT) simons.berkeley.edu/talks/ankur-moitra-mit-2024-09-04 Special Year on Large Language Models and Transformers: Part 1 Boot Camp

Why it's here

A top upload from a listed channel

Simons Institute is on Hallway's list of conference and university channels, and this upload is one of its most-watched talks or lectures. Nobody has recommended it in the communities yet, so it ranks below community picks.