LLM’s are models.
They have key roles and these roles play an important role in determining the outputs and the efficiency of use for large language models. There are real resource consequences to being cavalier about these things.
An illustration.
Compare this to this
qwen/qwen3.5-35b-a3b Thought for 3 minutes 59 seconds
qwen/qwen3.5-35b-a3b Thought for 2 minutes 2 seconds
System roles from two perspectives:
Slides
The class plan:
- Models and inputs: the roles.
- The system role and personas.
- Local LLMs and details of implementation; we do not really have access to these in commercial products.
LO: Understand the role of system in providing context for an LLM
Ethics: What are the risks of simulating living persons? Deepfakes, etc. but perhaps less excessive.
Readings: