Glossary
Every term the courses use, defined in one line and then in a paragraph. Written to be read out of order.
Showing 2 of 2 matching “Context window”
How much a model can consider at once.
The total amount of text (input and output together) a model can have in front of it for a single call. A hard limit. When a conversation exceeds it, earlier messages must be dropped or summarised.
See also Token (model), Prompt caching
The unit models read, write, and charge by.
Roughly three quarters of a word. Everything meters in tokens: cost, the context window, and how long a response takes to produce.
See also Context window, Prompt caching