Non-deterministic
AI in the stackThe same input can produce different output.
True of language models and untrue of most other APIs. Means tests cannot assert on exact strings, and that a bug may not reproduce on demand.
See also Hallucination, Streaming