Flaky Test Detector

intermediatetestingMin 32K context

Diagnoses and fixes flaky tests by analyzing test code and CI failure history for common sources of nondeterminism such as time and timezone dependence, order dependence, shared mutable state, race conditions, and unmocked network calls. Proposes targeted fixes and quarantine strategies to keep the suite trustworthy.

testingflaky-testscireliabilitydebugging

Use Cases

  • Finding the root cause of an intermittently failing test
  • Removing order dependence and shared state between tests
  • Stabilizing time- and timezone-sensitive assertions
  • Deciding what to quarantine versus fix immediately

Example Prompt

This test passes locally but fails ~15% of the time in CI. Analyze it for sources of flakiness,
identify the most likely root cause, and rewrite it to be deterministic. Note any shared state
or ordering assumptions it relies on.

```
[paste test code and a couple of failure logs]
```

Recommended Models

claude-opus-4-8gpt-5-6-soldeepseek-v4gemini-3-5-pro

Compatible Tools

claude-codecursorgithub-copilotkiroany

Modalities

Input: code, text
→
Output: code, text

Related Skills

unit-test-generationdebugging-assistantci-cd-pipeline

Author

OpenModels Community

@openmodelsrun