Today, we explore probability distributions.
LLMs are Built on Probability Distributions
The next token prediction conditional on the current and prior tokens is exactly what large language models do.
More of a banquet…
One key bit of data
An App?
Slides
The class plan:
- Defining probability.
- Pivots and tables.
- Visualizing tables.
Your assignment for this time:
- Do the reading.
- The assignment: use Gemini and/or Notebook LM to complete the three excerpts from Jaynes.
For Next Class:
- Reading: Chapter 3 if not already and read through Jaynes on Probability.
- Deliverable: A conversation on probability [Assignment 9].



