Skills

Builds regression suites for prompts and agent instructions so teams can detect quality, safety, format, and tool-selection regressions before deploying changes.

Defines repeatable quality evaluation for LLM outputs using representative datasets, scoring rubrics, model-graded checks, human review sampling, and regression thresholds.

Tests AI agent tool use with realistic fixtures, malformed inputs, permission boundaries, deterministic assertions, and recovery checks for failed or partially completed actions.

Проверяет интерфейсы продуктов на соответствие практическим требованиям доступности, включая семантическую структуру, управление с клавиатуры, поведение фокуса, цветовой контраст, экранные дикторы и формы.

Diagnoses failing browser and end-to-end tests by correlating assertions, traces, screenshots, network activity, timing, and application state into reproducible fixes.

Создаёт воспроизводимые оценки AI-агентов, измеряющие успешность задач, корректность использования инструментов, обоснованность, задержку, стоимость и безопасное восстановление в реалистичных сквозных сценариях.

Produces structured test plans for features and releases. Defines scope and objectives, derives test cases from requirements and acceptance criteria, covers functional, edge, negative, performance, and accessibility cases, sets entry/exit criteria, and maps risk to test priority. Outputs a clear plan with a traceability matrix linking tests to requirements.

Designs and implements visual regression testing for web UIs. Recommends a tooling approach (Playwright snapshots, Storybook + a diffing service, or a dedicated platform), writes screenshot tests with stable selectors and masked dynamic regions, sets sensible diff thresholds, and integrates the suite into CI with baseline management to reduce flaky failures.

Translates requirements and user stories into behavior-driven development scenarios in Gherkin. Writes clear Given/When/Then steps, covers happy paths, edge cases, and negative cases, uses scenario outlines with examples for data-driven tests, and keeps steps declarative and reusable. Optionally scaffolds step definitions for Cucumber or Behave.

Writes end-to-end UI tests with Playwright or Cypress that mirror real user journeys. Covers resilient selectors (roles/test-ids), network stubbing, auth setup, fixtures, waiting strategies that avoid flakiness, visual and accessibility assertions, and CI integration. Produces maintainable specs and a page-object structure.

Diagnoses and fixes flaky tests by analyzing test code and CI failure history for common sources of nondeterminism such as time and timezone dependence, order dependence, shared mutable state, race conditions, and unmocked network calls. Proposes targeted fixes and quarantine strategies to keep the suite trustworthy.

Sets up and interprets mutation testing to measure real test-suite effectiveness beyond line coverage. Configures tools like Stryker, PIT, or mutmut, explains surviving mutants, recommends targeted tests to kill them, and tunes performance for CI. Helps teams find tests that assert nothing and coverage that lies.

Generates consumer-driven contract tests between services so that API providers and consumers stay compatible as they evolve independently. Produces Pact-style contracts, provider verification stubs, and CI wiring, and flags breaking changes before they reach production.

Generates property-based tests that assert invariants across randomly generated inputs using frameworks like Hypothesis, fast-check, or jqwik. Identifies properties (round-trip, idempotence, invariants, oracle comparison), defines generators and shrinking, and sets up stateful testing for complex APIs. Surfaces edge cases that example-based tests miss.

Generates mock API servers and stubbed responses from OpenAPI specs, sample payloads, or natural-language descriptions. Produces realistic fixture data, configurable latency and error scenarios, and ready-to-run mock servers using tools like Prism, MSW, WireMock, or json-server so frontend and integration tests can proceed without the real backend.

Generates comprehensive load testing scripts and configurations for APIs. Supports k6, Locust, Artillery, and JMeter formats. Creates realistic traffic patterns, ramp-up scenarios, and threshold definitions. Includes analysis templates for identifying bottlenecks and capacity planning.

Generates realistic test data, fixtures, and seed files for databases and APIs. Creates data that respects constraints (foreign keys, unique fields, valid formats) and covers edge cases. Supports JSON, SQL, CSV, and factory patterns.

Generates comprehensive unit tests for existing code, covering happy paths, edge cases, error conditions, and boundary values. Follows testing best practices including the test pyramid, DAMP over DRY, and the Arrange-Act-Assert pattern. Adapts to the project's existing test framework and conventions.

Reviews web interfaces for WCAG 2.1 AA compliance. Identifies accessibility barriers including missing ARIA attributes, keyboard navigation issues, color contrast problems, and screen reader incompatibilities. Provides remediation code with proper semantic HTML.