Hand-Picked Software Testing Tools & Resources

A GitHub Copilot skill that automates exploratory web testing and discovery using Playwright MCP.

Use these guidelines for writing good Gherkin scenarios. Feed it as context to AI specs, agents, and skills.

A dynamic, contamination-free benchmarking platform for evaluating Large Language Models (LLMs) on hard reasoning, math, and coding tasks.

An AI-powered web UI automation and end-to-end testing library.

Test how well LLM agents use your MCP tools, compare different models, and track quality over time.

Playwright for AI Agents. Test what your agent DOES, not what it SAYS. YAML-first behavioral testing. Catch PII leaks, tool abuse, step explosions. 3200+ tests.

A property-based testing tool for API schemas like OpenAPI, Swagger, and GraphQL.

AI-powered tool for evaluating LLM-generated test cases across multiple models with human and LLM-as-judge scoring

A collection of Apache JMeter plugins including a Dynamic Load Thread Group and Auto Correlation engine.

A custom Playwright reporter that exports test execution metrics to StatsD, Prometheus, and Grafana.

Local-first API testing tool to inspect, test and mock APIs

pytest plugin for semantic LLM output testing — validate meaning, not just shape