Property-Based Testing

hypothesis: Property-Based Testing for LLM Outputs

Property-based testing with hypothesis is a natural fit for non-deterministic LLM output: instead of asserting a specific answer, you assert invariants that must hold across all valid outputs regardless of phrasing.