Glossary

The words, without the shrug

Every term the courses use, defined in one line and then in a paragraph. Written to be read out of order.

Clear

Showing 1 of 1 matching “Prompt caching”

Prompt caching

AI in the stack

Reusing an unchanged prefix across calls.

When the same large preamble is sent on every request, providers often charge a reduced rate for the repeated part. One of the cheapest available reductions in model cost.

See also Token (model), Context window