Skip to content

Add structured failure classification#19

Merged
V3RON merged 3 commits intomainfrom
issue-3-failure-classification
May 4, 2026
Merged

Add structured failure classification#19
V3RON merged 3 commits intomainfrom
issue-3-failure-classification

Conversation

@V3RON
Copy link
Copy Markdown
Contributor

@V3RON V3RON commented May 4, 2026

Summary

  • add a structured failureClass to runner results with sensible defaults for existing failure types and origins
  • let suites attach custom classes via assert.classify(...) and testCase.classifyFailure(...) so related assertion failures can be grouped across runs
  • update built-in reporters to surface failure classes, including grouped standard output summaries and reporter metadata in JSON and GitHub Actions output

Testing

  • pnpm vitest run test/runner/execute-runner.test.ts test/runner/execute-suite.reporter.test.ts test/reporters/json-summary.test.ts test/reporters/standard.test.ts
  • pnpm typecheck
  • pnpm build

Closes #3

V3RON added 3 commits May 4, 2026 11:15
…ification

# Conflicts:
#	docs/assertions.md
#	src/assertions/assert.ts
#	src/assertions/types.ts
#	src/runner/execute-runner.ts
#	test/runner/execute-runner.test.ts
@V3RON V3RON merged commit ae5aed5 into main May 4, 2026
4 checks passed
@V3RON V3RON deleted the issue-3-failure-classification branch May 4, 2026 10:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve failure grouping and custom classification

1 participant