Token (model)
AI in the stackThe unit models read, write, and charge by.
Roughly three quarters of a word. Everything meters in tokens: cost, the context window, and how long a response takes to produce.
See also Context window, Prompt caching
Glossary
The words, without the shrug
Every term the courses use, defined in one line and then in a paragraph. Written to be read out of order.
Showing 1 of 2 matching “Context window”