NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #1896 most downloaded on PyPI
Adaptive API testing for OpenAPI, GraphQL, and gRPC
Latest stable
4.33.1
Last release 16 days ago
04 Nov 2026
Ships fairly regularly
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
7 years old
507 releases · first in 2019
Drag across the ruler to compare, or tap a release to open it.
--experimental-coverage-unspecified-methods CLI option that accepts a comma-separated list of HTTP methods to use when generating test cases with meth
--experimental-coverage-unspecified-methods CLI option that accepts a comma-separated list of HTTP methods to use when generating test cases with methods not specified in the API during the coverage phase.Incorrect quantifiers merging for patterns involving single-element sets of characters like [+].
[+].Your coding agent can read these notes before it upgrades. Set up the MCP server →
This release introduces a new phase management system for CLI that simplifies test execution control and separates unit testing into different stages.
This release introduces a new phase management system for CLI that simplifies test execution control and separates unit testing into different stages.
Phase configuration changes:
examples (formerly explicit): Runs examples specified in the API schemafuzzing (formerly generate): Testing with randomly generated test casescoverage: Deterministic testing of schema constraints and boundary valuesreuse and shrink remain enabled by default. Disable via --generation-database=none and --no-shrink.target phase available via --generation-maximize=<METRIC>NOTE: Pytest integration does not currently have a way to disable the coverage phase. Python API support is planned for future releases.
coverage and examples into independent testing phases.--hypothesis-phases with --phases.unsupported_method failure if the API returned HTTP 200 on the OPTIONS request.--experimental-no-failfast option has been stabilized as --continue-on-failure.
This option ensures all test cases within a scenario are executed, even if failures occur.1 errors instead of 1 error in CLI output.--hypothesis-no-phases.--exitfirst. Use --max-failures=1 instead.--report unified reporting system with multiple format support.
--report unified reporting system with multiple format support.--report-dir for centralized report storage.--generation-optimize to --generation-maximize--generation-mode to -m/--mode--generation-max-examples to -n/--max-examples--junit-xml to --report=junit--cassette-* options to --report=vcr/har with format-specific paths optionsshrink in --hypothesis-phases with a separate --no-shrink optionUNRESOLVABLE sentinel instead of an empty string when Open API runtime expressions can't be evaluated (e.g., when $response.body#/id is not found)validate_response method in state machines now accepts the same keyword arguments as call.
If you've overridden this method, update its signature to include **kwargs.verify=False properly when specified via get_call_kwargs on a state machine. #2713--cassette-format (replaced by --report).Add LoadingStarted & LoadingFinished to the public API.
LoadingStarted & LoadingFinished to the public API.type.PYTHONIOENCODING environment variable that is not utf8.ensure_resource_availability check.Improved visibility into Open API link extraction success/failure status #823
--include-* and --exclude-* CLI options.Here is how it looks:
This is an alpha release - expect breaking changes and missing features. If you're using Schemathesis in production, stick with 3.x for now. The docum…
I'm releasing Schemathesis 4.0.0a1 - the biggest change in the project's history. I've rewritten major parts of the core engine, Python API, and pytest integration from scratch to enable features that were impossible to implement before. While this means removing some functionality temporarily, it was necessary to clean up four years of accumulated hacks and create a more solid foundation.
This is an alpha release - expect breaking changes and missing features. If you're using Schemathesis in production, stick with 3.x for now. The documentation is outdated, and I'll update it as the new architecture stabilizes.
I'd really appreciate your feedback at this GitHub Discussion - it will help shape the path to stable 4.0. A detailed migration guide and complete changelog will follow.
--phases CLI option to control unit & stateful testing.schemathesis.from_uri → schemathesis.openapi.from_urlschemathesis.from_pytest_fixture → schemathesis.pytest.from_fixtureResponse class instead of requests.Response.schemathesis.sanitization.configure instead of Config instance.--data-generation-methods → --generation-mode--targets → --generation-optimize--hypothesis-derandomize → --generation-deterministic--hypothesis-database → --generation-database--hypothesis-seed → --generation-seed--contrib-unique-data → --generation-unique-inputs--hypothesis-max-examples → --generation-max-examples--sanitize-output → --output-sanitize--hypothesis-suppress-health-check → --suppress-health-checkaiohttp integration.
Old-style stateful runner (new one is now default).
Schemathesis.io integration & --report option (local HTML reports coming later).
FastAPI fixups.
Python code samples (only cURL now).
Python 3.8 support.
Support for pytest<7.0.
CLI Options: --endpoint, --method, --tag, --operation-id, --skip-deprecated-operations,
--show-trace, --debug-output-file, --hypothesis-deadline, --hypothesis-report-multiple-bugs,
--hypothesis-verbosity, --store-network-log, --pre-run, --dry-run, --contrib-openapi-formats-uuid,
--validate-schema.
Most loader configuration moved to schema.configure method.
add_case hook.
schemathesis.contrib.unique_data.
Single argument AuthProvider.get.
schemathesis.runner.prepare (use schemathesis.engine.from_schema).
schemathesis replay command.
Stateful testing summary (coming later).
SCHEMA_ANALYSIS experimental feature.
Missing reference resolution scope when serializing multipart payloads. #2776
multipart payloads. #2776Do not mutate pattern keywords in response schema validation. #2749
pattern keywords in response schema validation. #2749minItems & maxItems during the coverage phase.default value as valid input during the coverage phase.BaseSchema and HookContext as a part of the public Python API. #2777multipart/form-data fields not added to the final test case payload.type: string enums during the coverage phase.Internal error in the coverage phase due to incorrect example value extraction.
### :wrench: Documentation - Fix documentation build.
--experimental-coverage-unexpected-methods CLI option that accepts a comma separated list of HTTP methods to use when generating test cases with metho
--experimental-coverage-unexpected-methods CLI option that accepts a comma separated list of HTTP methods to use when generating test cases with methods not specified in the API during the coverage phase.[+].Deduplicate failures from negative_data_rejection by response status code. It makes Schemathesis display more different failures for this check.
negative_data_rejection by response status code.
It makes Schemathesis display more different failures for this check.unsupported_method failure if the API returned HTTP 200 on the OPTIONS request.Warning for operations that return only 4xx responses during unit tests to help identify potential base URL or data generation issues.
negative_data_rejection check.Internal error in the coverage phase when a parameter is mixing keywords for different types.
verify=False when specified via get_call_kwargs on a state machine. #2713Handling of complex regex patterns with multiple quantifiers to respect length constraints during test generation.
type.Rebuild Docker stable with the v3 branch.
stable with the v3 branch.Add HTTP 428 status to the allowed status list of the negative_data_rejection check. #2669
negative_data_rejection check. #2669Experimental unsupported_method check.
unsupported_method check.Authorization header in the experimental missing_required_header check.TypeError on extracting explicit examples.
TypeError on extracting explicit examples.Code sample containing incorrect HTTP method for the Unspecified HTTP method case in the coverage phase.
Unspecified HTTP method case in the coverage phase.TypeError on some x-www-form-urlencoded payloads during the coverage phase.Update the upper bound on pytest-subtests to <0.15.0.
pytest-subtests to <0.15.0.use_after_free as they don't indicate the presence of the previously deleted resource.pytest-subtests to <0.15.0.use_after_free as they don't
indicate the presence of the previously deleted resource.False positive in the ensure_resource_availability check.
ensure_resource_availability check.--experimental-no-failfast CLI option to make Schemathesis continue testing an API operation after a failure is found.
--experimental-no-failfast CLI option to make Schemathesis continue testing an API operation after a failure is found.Ignored request-related configuration inside the ignored_auth check. #2613
ignored_auth check. #2613UnicodeEncodeError when sending a request during the coverage phase.
UnicodeEncodeError when sending a request during the coverage phase.UnicodeEncodeError when sending a request during the coverage phase.
UnicodeEncodeError when sending a request during the coverage phase.Generating duplicate query parameters during the coverage phase.
data_generation_method reported during the coverage phase in some cases.Support arrays for headers & path parameters during the coverage phase.
ignored_auth stricter by always checking for the 401 status exactly instead of any non-200.meta.parameter in more cases during the coverage phase.Compatibility with Hypothesis > 6.115.6. #2565
Generate more negative combinations during the coverage phase.
Generate more negative combinations during the coverage phase.
Internal error on generating missed required path parameters during the coverage phase.
Generating test cases with missing required parameters during the coverage phase.
negative_data_rejection config to include fewer 4XX status codes (400, 401, 403, 404, 422).Support negative cases for items and patternProperties during the coverage phase.
items and patternProperties during the coverage phase.minLength & maxLength are taken into account when generating negative cases with pattern during the coverage phase.additional_checks & excluded_checks to Case.call_and_validate.ignored_auth if auth is provided via --set-query or --set-cookie.ignored_auth is not working under pytest.Performance regression caused by adjusted pretty-printing logic in Hypothesis. #2507
Hypothesis. #2507Support for pytest-subtests up to 0.14.
pytest-subtests up to 0.14.--experimental=positive_data_acceptancenegative_data_rejection check.False positive for ignored_auth when used in the stateful test runner. #2482
ignored_auth when used in the stateful test runner. #2482$ref in a path is incorrectly validated as invalid. #2484seed in cassettes if --hypothesis-derandomize is present.Meta information about generated data in the coverage phase.
Merge minLength & maxLength into pattern to avoid extremely slow generation in most popular cases.
minLength & maxLength into pattern to avoid extremely slow generation in most popular cases.{ and } for path parameters.Use requestBody examples as a source of valid input during the coverage phase.
requestBody examples as a source of valid input during the coverage phase.ignored_auth false positives on custom auth and explicit --auth CLI option. #2462pattern during the coverage phase.requestBody examples as the source of valid inputs during the
coverage phase.ignored_auth false positives on custom auth and explicit --auth
CLI option. #2462pattern during the
coverage phase.Reimplementation of test case deduplication in CLI. It effectively un-deprecates the --contrib-unique-data CLI option.
--contrib-unique-data CLI option.ignored_auth to check for incorrect auth.properties combinations for the coverage phase.default field as a source of valid inputs during the coverage phase.ctx as the first argument for all checks.
This is a step towards checks that cover multiple responses at once.ctx as the first argument.timeout in certain situations when loading the schema from the network.with_security_parameters in runner in some cases.Extend explicit examples discovery mechanism by checking response examples.
--dry-run is provided. #1423The example field was missed in the coverage phase.
example field was missed in the coverage phase.example field in the coverage phase.Use more explicit examples in the coverage phase.
generation_config in explicit example tests when it is explicitly passed to the test runner.Restructure the st run --help output.
st run --help output.-D CLI option is respected in the coverage phase.Unsatisfiable if it they previously had successfully generated test cases.New phase field to VCR cassettes to indicate the testing phase of each recorded test case.
phase field to VCR cassettes to indicate the testing phase of each recorded test case.Case.data_generation_method in test cases generated during the coverage phase.EXPERIMENTAL: New "coverage" phase in the test runner. It aims to explicitly cover common test scenarios like missing required properties, incorrect t
--experimental=coverage-phaseAdjust the distribution of negative test cases in stateful tests so they are less likely to occur for starting transitions.
Not using the proper session in the ignored_auth check. #2409
ignored_auth check. #2409ignored_auth.Error in response_header_conformance if the header definition is behind $ref. #2407
response_header_conformance if the header definition is behind $ref. #2407The ensure_resource_availability check. It verifies that a freshly created resource is available in related API operations.
ensure_resource_availability check. It verifies that a freshly created resource is available in related API operations.ignored_auth check. It verifies that the API operation requires the specified authentication.--generation-graphql-allow-null CLI option that controls whether null should be used for optional arguments in GraphQL queries. Enabled by default. #1994TestCase used by pytest & unittest integration.base_url is missing for a schema loaded from a file.Incorrect default deadline for stateful tests in CLI.
allOf subschemas in testing explicit examples. #2375Internal error in stateful testing.
Ignoring nested examples. #2358
--method, --endpoint, --tag, --operation-id, --skip-deprecated-operations CLI options in favor of the new --include-* and --exclude-* options. See mor…
Finally, flexible filters for API operations are released!
name.operation_id & tag filters in some cases.Hypothesis<6.108. #2357--method, --endpoint, --tag, --operation-id, --skip-deprecated-operations CLI options in favor of the new --include-* and --exclude-* options.
See more details in the CLI documentation.method, endpoint, tag, operation_id and skip_deprecated_operations arguments in schemathesis.from_* loaders and the parametrize function in favor of the new include and exclude methods on schema instances.Circular import in schemathesis.runner.events.
schemathesis.runner.events.Filtering by operation_id in conditional auth implementation.
operation_id in conditional auth implementation.--experimental=stateful-test-runner or --experimental=schema-analysis enabled. #2353Hello there! This release extends the recently released stateful testing and fixes a few bugs in there.
Hello there! This release extends the recently released stateful testing and fixes a few bugs in there.
--hypothesis-seed in new-style stateful tests.--set-* CLI options in new-style stateful tests.--max-response-time in new-style stateful tests.--request-* CLI options in new-style stateful tests.--generation-* CLI options in new-style stateful tests.--max-failures in new-style stateful tests.--dry-run in new-style stateful tests.all variant for the --hypothesis-suppress-health-check CLI option.6.108.0.data_generation_method value for HTTP interactions in VCR cassettes.--experimental=stateful-only. #2326--request-proxy for API probing.seed field in cassettes for new-style stateful tests.--exitfirst.Generating negative test cases for path and query parameters. #2312
negative_data_rejectionOne column per quarter.