NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI
PyPI, #1896 most downloaded on PyPI
Adaptive API testing for OpenAPI, GraphQL, and gRPC
Latest stable
4.33.1
Last release 18 days ago
04 Nov 2026
Ships fairly regularly
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
7 years old
507 releases · first in 2019
Drag across the ruler to compare, or tap a release to open it.
Raw ModuleNotFoundError from schemathesis.grpc.from_path and the pytest plugin without the grpc extra.
ModuleNotFoundError from schemathesis.grpc.from_path and the pytest plugin without the grpc extra.--include-name.expected-statuses rejecting gRPC status names such as UNAVAILABLE.response.json() failing on gRPC responses in custom checks.case.as_curl_command() and case.as_transport_kwargs() on gRPC cases.--auth-wfc and --report wfc silently misbehaving with gRPC schemas.oneof branches, non-finite floats and length boundaries.gt: 5, lt: 5.oneof refers to itself.UNAVAILABLE response times inflated by a server reachability check.st replayst replay resending recorded ids for inferred links that pick an item from a list response.st replay resending recorded GraphQL ids instead of taking them again from earlier responses.st replay resending recorded gRPC values instead of taking them again from earlier responses.st replay sending masked gRPC metadata instead of credentials from -H or config.$defs under a nested $id.DELETE.st fuzz and stateful testing counting requests unanswered after an API outage as errored.$refs.$ref chain repeats the same pointer in different files.$ref points to another $ref.$ref Example Objects inside a schema's examples map.filter_too_much health check when ids reused from responses contain /.RecursionError during generation for self-referencing arrays with prefixItems or contains.positive_data_acceptance for dependentRequired objects behind $ref in coverage. #5898--tls-verify points to a missing CA bundle.Cookie headers the cookie parser rejects.Your coding agent can read these notes before it upgrades. Set up the MCP server →
Coverage phase for GraphQL schemas.
response_schema_conformance checks GraphQL data for missing, unrequested and mistyped fields.nodeType (attribute, element, text, cdata).style: cookie.response_schema_conformance checks JSON Lines and JSON Text Sequence responses against Open API 3.2 itemSchema.0.10.0, from WFC 0.13.0.examples.null values described as "Value null value".null query parameters sent as null in cases targeting a sibling.not schemas described by the inner schema's scenario.generation.codec.exclude-header-characters.pattern when combined with minLength / maxLength.pattern with optional or repeated parts combined with length bounds.x-example drawn twice as often in fuzzing.examples used as the example itself.negative_data_rejection failures.dataValue or serializedValue sent as the example itself.$ref ignored in bodies and responses, or crashing in external files.$ref chains ignored, or sent as the $ref object itself.xml settings ignored for schemas reached through $ref chains or declared beside a $ref.xml.name is not a valid XML name.@oneOf input objects in positive GraphQL tests.--generation-unique-inputs.[POST ] test id with schemathesis.pytest.from_fixture.$id reported as unresolvable.$ref relative to the enclosing $id../ or ../ references to a relative $id.$ref in path items, parameters, request bodies or responses.openapi version, such as an unquoted 3.1 in YAML.paths.$dynamicRef.$id.$id schema references its own $defs.prefixItems or array-form items.$ref ignored in data generation and response validation.content or media type that is not an object.ignored_auth when an auth header's name case differs from the security scheme.content instead of schema never validated by response_headers_conformance.response_schema_conformance for Open API 3.2 discriminators with defaultMapping.response_schema_conformance for discriminator values pinned by the branch's enum or const.st fuzz and pytest state machines.proxy skipped by dynamic auth token requests, WFC login and loading schemas from URLs.--max-time continuing after a request times out at the time limit.st fuzz hiding errors raised as the time limit is reached.Network Error when --max-time runs out while a response body is still arriving.Connection failed and unsupported API capabilities when a response body outlasts --request-timeout.Connection failed when a schema response body outlasts the timeout.st fuzz hiding the error of the request that crashed the server.st fuzz crashing with dictionary changed size during iteration when auth is enforced.st fuzz ignoring --generation-unique-inputs.--generation-unique-inputs spinning without requests until --max-time once inputs run out.object_level_authorization failure.st replay not finding a case ID after a later run records the same failure.--generation-unique-inputs.allure extra.warnings settings ignored for rate_limited, missing_test_data and other response warnings.🐛 Fixed Compatibility with pytest 9.2.
Lower memory use for patterns like ^.{0,102400}$ .
^.{0,102400}$.content.$ref-heavy schemas.^(?=.*\d)[a-z\d]*$.maxLength.2**63 to numeric fields without an upper bound.{username}.*_name query filters with an unrelated name field.POST returns.*_name query filters with a field naming another resource.projectName. #5641DeleteNote or UpdateNote treated as separate resources.CreateNotePayload.Boolean or payloads.deleteBookCover linked to the wrong resource.discriminator.mapping values point to the same schema. #5631$ref alias components or $ref siblings.[\w-/].fill-missing.user[id] or a@b.--max-time--max-time missing the Time limit reached skip reason.positive_data_acceptance in coverage for multipart bodies with custom encoding.contentType strategies.$ref items.--report pytest and cURL output.Case.auth_identity : name of the WFC auth entry a case was sent with.
Case.auth_identity: name of the WFC auth entry a case was sent with.image/* media types.multipart/form-data binary parts declared via $ref.$ref body schema with nested references.$ref with str values.tag and operation_id filters in auth apply_to/skip_for.x-bundled location in errors for invalid response schemas behind $ref.negative_data_rejection for invalid path parameters on Open API 2.0.example unused for $ref request bodies with nested references.st fuzz showing "No issues found" when warnings.fail-on fails the run.st run requests hanging indefinitely when --request-timeout is not set.True or None sent in binary bodies and multipart file parts.$ref with nested references.encoding.multipart/form-data file arrays with encoding.contentType.st fuzz for unknown checks in the configuration file.examples of Example Objects.st fuzz --mode=negative running no scenarios when startup exceeds --max-time .
st fuzz --mode=negative running no scenarios when startup exceeds --max-time.multipart/form-data bodies that are arrays or scalars.application/x-www-form-urlencoded bodies declared with media-type parameters.negative_data_rejection for request bodies declared with media-type parameters.positive_data_acceptance for bodies declared with media-type parameters.*/* is declared before application/xml.Case.call dropping a json= or data= body on WSGI apps or over null/binary bodies.$ref responses or links.Authorization" cases with the configured credentials under --generation-unique-inputs or when a hook reads case.meta.application/x-www-form-urlencoded bodies.Content-Type negative cases as rejected valid data when a hook edits headers.Crash on WSGI apps for application/x-www-form-urlencoded bodies that are arrays or scalars.
application/x-www-form-urlencoded bodies that are arrays or scalars.operation-ordering = "none".st fuzz network errors, and st fuzz curl reproductions.examples.set_from_requests not applied to WSGI apps.pytest failing with Unknown config option: timeout for tests under /app in Docker images.st fuzz error output.$ref'd parameter examples.AttributeError crash with exclude(deprecated=True) on GraphQL schemas; skip @deprecated fields.
st fuzzst fuzz follows links from list responses.st fuzz --mode=negative crash on operations with nothing to negate.st fuzz stops on a fatal error like an unreachable schema.st fuzz running past Inconsistent data generation errors caused by changing server state.location-headers is not in inference.algorithms.².allOf branches with patternProperties beside additionalProperties.default case equal to example when examples is also declared.RecursionError during generation for arrays whose items or contains refer back to an enclosing schema.Failed Health Check for request bodies with several $-anchored pattern strings. #5491Failed Health Check for strings whose pattern is stricter than their format. #5491prefix and namespace.$ref.multipart/mixed request Content-Type headers.negative_data_rejection for path and query parameters whose sent text is valid.negative_data_rejection when configured auth refilled a negated auth header.response_headers_conformance for OpenAPI 3.1 type lists and 1_0-style numbers.response_headers_conformance for object-typed response headers.ignored_auth when the invalid-auth probe dropped the case's other headers.ValueError crash in use_after_free and ensure_resource_availability for non-ASCII digit Age headers.--rate-limit=auto--rate-limit=auto.429 responses outside stateful testing with --rate-limit=auto.LookupError crash in VCR reports and garbled HAR bodies for non-UTF-8 response charsets.Identity: line in JUnit and Allure failure reports.FrozenInstanceError crash in GraphQL testing with graphql-core 3.3.AttributeError crash with exclude(deprecated=True) on GraphQL schemas; skip @deprecated fields.User-Agent missing from case.headers in before_call hooks in coverage and examples phases.~20% faster stateful testing on APIs with many links.
RecursionError in negative testing of self-referencing additionalProperties schemas.RecursionError in negative testing of self-referencing additionalProperties schemas.Captured resource ids fill fields of array items and $ref objects in request bodies. #5417
$ref objects in request bodies. #5417allOf/oneOf/anyOf.#regex: extractor for $response.body#/pointer link expressions.allOf/oneOf/anyOf branch.ST101, ...) in run output and HTML, NDJSON, JSON and JUnit reports.st explain <code> describes a failure, how to fix it and how to turn it off.--report pytest writes failures as standalone pytest tests. #2999before_init_operation hooks run once per operation, not on every lookup.Deleted resource still available instead of Use after free.--request-timeout is unset.negative_data_rejection, not not_a_server_error.pattern.pattern has anchors or lookarounds.{order_seq})._pk parameters and body fields (e.g. {order_pk}).Shipment.warehouseId).204 and 205 responses, which have no body.enum rejects (e.g. a deleted status).readOnly request body fields (e.g. behind $ref or allOf).Location links overwriting each other when several targets share a status code.Location links extracting wrong path parameters with base paths, queries or regex characters.readOnly fields.requestBody values. #5416-.minLength and a \p{L} or (?!...) pattern.uniqueItems.--max-time once generation used up the operation's time.encoding.contentType sent verbatim as the part Content-Type. #5380pattern quantifiers too large to generate (e.g. [a-z]{100000}).allOf references itself.enum values contain /.--max-time when auth overwrites a declared header.additionalProperties and object keywords for properties with encoding.contentType.application/x-www-form-urlencoded examples whose schema sets exclusiveMinimum or exclusiveMaximum without a bound.codec, allow-x00 or exclude-header-characters settings.generation.codec is None.RecursionError on objects whose additionalProperties references the object itself.readOnly request body fields sent when declared via $ref, allOf or an untyped parent.writeOnly fields behind $ref or allOf reported missing from responses; present ones accepted.uuid and duration formats in OpenAPI 2.0 and 3.0 response schemas.positive_data_acceptance for header values ending with whitespace.ensure_resource_availability failures after a POST that created the resource at its own URL.object_level_authorization sending a single-object GET as another user, which may create data.missing_required_header failure messages.negative_data_rejectiontext/plain bodies.call_and_validate receives its own body via json=. #5344409 as conflicts, not as a schema validation mismatch. #5429--option=URL.Base URL lines.Missing test data warning kept for operations that a later phase reached successfully.Missing test data warning for operations answering with a documented redirect.cookies lists for requests and responses in HAR reports.mimeType and redirectURL in HAR reports.--max-examples and other explicit options when a hook loads a Hypothesis profile.APIOperation.as_strategy after the same operation generated under other settings.openapi.from_url and graphql.from_url ignoring TLS, auth and header settings from the config.schema.find_operation_by_path on paths with doubled or missing trailing slashes.st fuzz occasionally dropping results and reporting "Empty test suite" on slow machines.st replay reporting "operation not found in schema" for every GraphQL failure.3xx status, reporting the target's status instead.Location headers differing from a schema path by a trailing or doubled slash.allow_header_conformance failures show the received Allow header value.
allow_header_conformance failures show the received Allow header value.st fuzz1 scenarios and 1 errors.ctx.add_report().--max-time budget counted as errored but not reported.errored count in the summary including stateful steps never sent, e.g. after --max-time.found 1 unique failures in the summary.st run stops before testing, such as on schema loading errors.Identity line in failure output.--request-timeout=1e+09.--url when it is already set, without naming the address.[auth] auto-signup = false, which is not valid TOML on one line.--report-dir option and the full path that failed.<unknown entrypoint> command under python -m pytest or python -m schemathesis./12 before /4.object_level_authorizationpeers are configured.st replay sending every step as one user, so failures replayed as fixed.negative_data_rejection in the stateful phase"5" sent to numeric path or query parameters.null values of nullable parameters.pytest-xdist not reproducing operations run on other workers.Case built with an object or array cookie value.negative_data_rejection failures after hooks write "5" to numeric parameters.--phases not disabling the stateful phase when links are inferred for GraphQL schemas.UnicodeEncodeError for cookie values with non-Latin-1 characters.--max-time.UnsupportedResult crash for property names matched by several patternProperties.Tip to check the base URL when the API refuses connections.
ctx.add_report() for CLI extensions to list their reports in the terminal and HTML report.auth.auto-signup config option to disable automatic sign-up.--request-timeout or max_response_time is 1000 seconds or more.object_level_authorization check: one WFC peer reading an object another peer created.Unrecognized field rejection.--report html and [reports.html] write an offline HTML report with failures and reproduction commands.JUnit instead of JUNIT.phases.coverage.generation.max-examples; the coverage phase has no case cap.st fuzzwarnings.fail-on for unmatched filters.--wait-for-schema on connection errors when it is already set.Inconsistent data generation when the server stops responding.fail-on.fail-on missing-auth warning withdrawn after a later successful response.fail-on missing-test-data warning withdrawn during stateful testing.{items: [{track}]}.shipping.address.warehouse_id.{bookingid, booking}.allOf: [$ref]./books/v1.POST /books to GET /books/{title} via request body title.recipient.clientId.id to string path parameters when a string uuid exists.--mode negative for steps with nothing to negate.405 Method Not Allowed.POST/PUT requests to the body.items.0.name.items[0].name or sending them as dotted body keys.$ref objects nested in the request body.long maximum written as 2**63.allOf request bodies after the server rejects unknown fields.type.$ref target constraints when sibling keywords are looser in Open API 3.1.example, examples and default is invalid.type when required precedes properties.not, e.g. not: false.enum or const schemas changing after they were generated.integer values.pattern when a group holds a possessive quantifier, e.g. (a*+).negative_data_rejection1_0, 5 or non-ASCII digits.User-Agent the schema declares as a header.st run ignoring checks and generation under [phases.<phase>] for examples, coverage and stateful phases.[[operations]] overriding [[project.operations]] for the same operation.[[operations]] continue-on-failure = false not overriding a project-level true.[servers.variables] ignored for the schema-wide servers URL.[parameters] overrides and configured headers dropping each other when both are set.oneOf validation text in config errors for wrong-typed request-retries and operation filters.[parameters] overrides in fill-missing cases.Failure() in repr and pytest assertion messages.as_strategy(headers=...) modifying the passed headers dictionary.@schemathesis.deserializer("application/*") never matching.SCHEMATHESIS_HOOKS running several times per call.filter_case hook depends on a global map_case.--auth-wfc discarding peers, refresh_interval and user set under [auth.wfc].--auth-wfc-user silently ignored when no Web Fuzzing Commons auth file is configured.$ref reaches it through a cycle.info or a non-string info.title.basic case omits credentials.st replay failing to load the schema for crashes recorded with --tls-verify=false.Negative cases negating annotation keywords like title or deprecated instead of constraints.
429 as rate-limited, not as a schema validation mismatch.$response.body.0.id.negative_data_rejection in the coverage phaseallowEmptyValue parameters.items.minimum/maximum on string parameters."1" under type: boolean."true".0 sent to boolean header and cookie parameters.{} over WSGI.negative_data_rejection for unknown query parameters beside allowEmptyValue string values like 0.Bearer tokens for valid test cases.Unrecognized field "x" rejections from Spring APIs.title or deprecated instead of constraints.id and project_id.st replay marking cases as fixed when the crash file has masked values like password. #5141password in reproduction commands.request-timeout from the config file ignored by st run and st fuzz.format: float precision pushes out of range.Sign up and log in automatically when the schema declares sign-up and login operations.
GET returns, like version, into update bodies.fromAirportId-style fields to fromAirport objects.max-stream-events config option to stop reading Server-Sent Events streams after that many events. #3633positive_data_acceptance accepts 3xx responses by default.ignored_auth on redirects to a login page and on invalid path parameters.negative_data_rejection on valid bodies after a before_call hook edits another part. #5105negative_data_rejection when a body.* parameter override restores the mutated field.@schema.parametrize() tests imported under names pytest would not collect.items for tuples.schema.max-redirects = 0.st run applying Hypothesis's CI profile over explicit options when CI is set. #4391{partition_id}.operationRef definition" for inferred links to templated paths.ignored_auth crash in Case.validate_response on schemas without an absolute base URL.pattern definitions during test case generation.schema against the whole stream, as an array of events. #3633--header sets only some required headers.id required by WFC Report 0.8.0.--generation-deterministic producing different test cases per run, and st fuzz ignoring --generation-database.operationRef (e.g. %7Bid%7D) resolving to the wrong operation.ResourceWarning about unclosed streams after ASGI lifespan shutdown. #5085docker run -p once, not per operation.{id}:cancel.additionalProperties hint when the server rejects a body for its NUL characters.unsupported_method for methods a templated path declares on the same URL.st run when the baseline file cannot be written.Show a single Coverage block in st run output under --max-time .
st runCoverage block in st run output under --max-time.Network Error details in stateful runs that also report a failure.[auto, 1-64] range when --workers gets an out-of-range value.filter_case hooks as hook errors during fuzzing.filter_case hooks that start rejecting mid-run during fuzzing as hook errors.SystemExit raised in hooks as an error instead of skipped operations or success.default values of numeric schemas.default of a non-string parameter sent as the default positive value in coverage.\S patterns, e.g. non-breaking spaces.&&, ~~ and [ inside character classes in pattern.true / false / null and JSON.text/plain object and array bodies as JSON instead of Python text.$ref branches.$ref pointers in response_schema_conformance failure schemas.negative_data_rejectionnull sent to nullable query parameters.null in query parameters alongside unsent extra parameters.detail.anyOf / oneOf accepts any string.allowEmptyValue parameters.False negative_data_rejection failures for nested values sent as repeated scalar query parameters.
negative_data_rejection failures for nested values sent as repeated scalar query parameters.negative_data_rejection failures for boolean spellings such as 0, yes, or True.negative_data_rejection failures for omitted optional query parameters beside other serialized values.Crash in the coverage phase for large arrays of binary strings.
{identifier}.\p{L}.FutureWarning printed to stderr for some schema pattern values.curl commands.anyOf negative coverage cases when a referenced schema contains invalid keywords.$ref with sibling keywords.$anchor in Open API 3.1.$ref points at a whole external file.contains reported as Hypothesis Unsatisfiable.ValueError for non-JSON values such as datetime.date in schemas passed to from_dict.negative_data_rejection failures for empty query values of parameters with allowEmptyValue: true.negative_data_rejection failures for query values that become valid or disappear during serialization.itemSchema definitions in response validation.phases.stateful.max-steps = 50 silently capping scenarios at 6 steps.$ref document.429) responses counted as rejected data in the low_valid_rate warning.409 responses as conflicts, not rejected data, in the low_valid_rate warning. #4932Dependency inference unwraps result / data envelopes that carry metadata such as status or time .
result / data envelopes that carry metadata such as status or time.PUT /items/{name} as the creator when nothing POSTs to /items.ImportError on from schemathesis.checks import content_type_conformance (and other built-in checks) before a schema is loaded.schemathesis.check return type: decorated functions and classes keep their own type.base_url passed to Case.call ignored for WSGI applications.anyOf and oneOf.minItems.$ref schemas.minItems.prefixItems, if, or unevaluatedProperties.multipleOf schemas with large bounds.querystring parameters as percent-encoded raw queries.servers definitions as clean loading errors.content as a clean error.$schema URL.negative_data_rejectionminimum or other bounds.unsupported_method failures when a rate limiter answers an undeclared method with 429 Too Many Requests.checks.enabled = false not disabling custom checks.WFC Report output via --report wfc or --report-wfc-path .
--report wfc or --report-wfc-path.code.st replay options -H/--header, --auth, --auth-wfc and --auth-wfc-user for replayed requests.format: binary values include small valid PNG, JPEG, GIF, WebP, PDF and ZIP files.image.png.use_after_free and ensure_resource_availability failures note responses served from a cache.st run and st fuzz fail with exit code 2 when nothing is tested.st run and st fuzz exit 2 on schema, configuration and internal errors.st run, st fuzz and st replay exit 130 when interrupted with Ctrl+C.st replay step chains show each linked value as recorded -> replayed.st replay removes fixed crash files with masked credentials once config or CLI supplies them.generation.maximize or explicit hypothesis.target() calls.ignored_auth stops probing an operation once it rejects missing and invalid credentials.missing_deserializer warning names the response media types that go unvalidated.st run and st fuzzst fuzz --help omitting that fuzzing stops at the first failure without --continue-on-failure.st fuzz omitting schema errors of individual operations.st fuzz workers continuing after the first failure and reporting Stop reason: Completed.Stop reason: Time limit reached for runs stopped by a failure shortly before the deadline.continue-on-failure in the config file ignored.bool: True instead of boolean: true.st replay[auth.openapi] credentials, resending masked values instead.User-Agent and test case ID headers, or dropping -H headers.from_fixture tests missing from pytest Allure and JUnit results.epic label with the API title in CLI Allure results.exit_code of 0 in --report json for runs aborted by a fatal error.stop_reason of interrupted and empty errors in --report json for runs aborted by an error.before_load_schema and after_load_schema.filter_case and map_case in the pytest coverage phase.after_validate.apply_to and skip_for filters on hooks registered by name, e.g. hook("before_call").Unsatisfiable.application/x-www-form-urlencoded, multipart/form-data and formData request bodies.* wildcards never filling request body fields.$ref./projects/{code}.allOf.*/*.$ref applied in Open API 3.0 and Swagger 2.0 schemas.Header(None).$ref siblings dropped when the target defines the same keyword.contains keywords in Open API 3.0 schemas.format: binary strings ignoring minLength and maxLength.minLength: "x".--generation-unique-inputs treating inputs that differ only in sensitive parameter values as duplicates.--mode negative.enum, multipleOf or not in positive test cases.$ref.negative_data_rejection in coverage phase for parameters with unanchored pattern and maxLength.application/json while carrying raw text.True/False/None in label, matrix and object-style parameters.type lists and implicit object or array schemas.encoding styles ignored in application/x-www-form-urlencoded bodies.content parameters.Content-Type header that names another body media type.matrix/label/simple path parameters.Content-Type header that names another media type.boundary when Content-Type: multipart/form-data is set explicitly./ or ~ printed unescaped.1 more branches for a single branch.prefixItems element that admits no value.$ref branches of a oneOf.ignored_auth when unauthenticated requests redirect to a sign-in page.ignored_auth when an API-key cookie is passed via the Cookie header.ignored_auth when credentials are passed in an Authorization header the schema does not declare.negative_data_rejection for numeric array path parameters sent as a single number.negative_data_rejection for multipart bodies with --generation-unique-inputs.negative_data_rejection for string parameters declared as anyOf/oneOf with a false branch.validation_mismatch, missing_test_data and missing_auth warnings from undeclared-method requests.validation_mismatch and missing_test_data warnings from negative test cases.negative_data_rejection for repeated string query parameters whose every value is valid.negative_data_rejection for request bodies referencing a schema of a newer draft, such as one recursing through $dynamicRef.workers values; reject values below 1.bytes value.on:, passed to from_dict.Connection: close.curl reproduction commands for request data with C1 control or Unicode line-separator characters.curl reproduction commands sending wrong bytes in fish, or \$ for $ in bash.Case objects hashing differently when header names differ only in case.curl reproduction commands for non-ASCII request data.enum or const positions, such as recursive request bodies.maxItems, such as OGC CQL2 filters.Fuzz dictionary bindings for GraphQL arguments via <Type>.<field>.<argument> keys.
<Type>.<field>.<argument> keys.low_valid_rate warning for operations that accept few of the requests sent to them.Server Unavailable error.missing_test_data warns for GraphQL operations whose responses never carry data.st replay retries passing crashes up to three times and reports intermittent ones as FLAKY.extract_from = "cookie" takes a named cookie from a Set-Cookie login response.schemathesis.errors.FailureGroup for catching failures raised by validate_response.pytest 8.4.validate() and is_valid() on request parameters for checking values against the schema.negative_data_rejection for regex, uri-reference and similar string formats in fuzzing.response_schema_conformance for HEAD responses that declare a body.examples maps inside a parameter or body schema.extensions.examples keyword.$ref (//host/schema.json) failing to resolve for schemas loaded from a file.format: binary JSON bodies.null as a GraphQL schema violation, severity high.missing_test_data names the operation that appears to supply the data an unlinked operation needs, or reports that none does.Crash on schemas where properties is not an object.
properties is not an object.examples values that violate that schema in the examples phase.[[operations]].allOf members with wrongly typed examples or required.itemSchema and a sibling schema.allOf/anyOf branches.Examples phase fills missing values with schema default values; required parameter defaults count as examples.
default values; required parameter defaults count as examples.--report ndjson output containing only the Initialize event. #4807example/examples declared on array items in the examples phase.allOf, oneOf, and anyOf at any depth in the examples phase.ignored_auth crash on generated cookie values the stdlib parser rejects. #4804anyOf branches for examples when a schema declares both oneOf and anyOf.example and x-example values in a stable order across runs.x-example and x-examples in OpenAPI 3 parameters in the examples phase.enum rejects, which made those branches ungeneratable.Refine generation from Luracast Restler 4xx errors.
st starts about 2.5x faster.${VAR} in config values; $${ escapes it, any other $ stays literal. #4785QUERY in phases.coverage.unexpected-methods. #4787type.missing_required_header for 404 responses on generated path parameters.Schema Error aborting operations whose 4xx responses carry a malformed Content-Type.Recognize +yaml media types (e.g. application/apply-patch+yaml ) and YAML content types with parameters.
+yaml media types (e.g. application/apply-patch+yaml) and YAML content types with parameters.maximum/minimum that lies outside the range of format: int32/int64.enum and const values containing / by sending them percent-encoded.negative_data_rejection failure message.text/* media types without a dedicated serializer as plain text.email, hostname and uri values with a dotted domain, which strict checkers require. #4782allOf sharing a node with additionalProperties.ensure_resource_availability when a verb other than DELETE removed the resource.negative_data_rejection when another location's negation only adds undeclared parameters.ensure_resource_availability for a POST to a resource URI that does not create it.example values that omit required fields, and skip those the schema still rejects.!!binary.format: duration under Swagger 2.0 and Open API 3.0.format and a wider pattern both apply, instead of skipping the body.$ref base reused across nesting levels.Decline unbuildable negated bodies instead of raising UnsupportedSchema during negative generation. #4753
UnsupportedSchema during negative generation. #4753examples mismatch its schema.example, examples, and default values are invalid.items with a valid value when a conflicting sibling type would otherwise silence it.oneOf branch's own properties even when it can never win exclusivity over a sibling branch.null as an incorrect type for nullable OpenAPI 3.0 properties.Dependency inference links body fields to the collection listing their accepted values.
2.0) under Open API 3.1 and 3.2.filter_failure hook to drop check failures by a custom condition. #1792missing_test_data warning tips reflect whether links reach the operation and whether stateful testing ran.format, pattern, and a length bound together. #4593format and a length bound.format value can reach are ruled out without drawing.format: date-time values are built to fit a length bound instead of drawn until one fits.format: email and format: uri values are built to fit a length bound too.format and a length bound could not both be met. #4592missing_auth warning for operations that returned 2xx responses later in the run.KeyError from an evicted cache entry on free-threaded Python.dictionary changed size during iteration when several workers reuse values from responses.@Range bounds ignored in Spring error responses.format: int32/int64 range.--exclude-method and other exclusions ignored for unexpected HTTP methods in the coverage phase. #3142positive_data_acceptance and negative_data_rejection for 429 responses.🐛 Fixed Compatibility with pytest 9.2.
--origin option that takes scheme, host and port, and appends the schema's own base path.
--origin option that takes scheme, host and port, and appends the schema's own base path.UnicodeDecodeError on non-ASCII response headers.Host than the schema fetch.abort(404) and 405 raised as internal errors.true / false / null.text/plain body booleans and nulls sent as Python literals instead of true / false / null.enum collapsing the URL segment.allOf of two disjoint contains.allOf branch forbids a required property with false.Content-Type header value its own schema rejects.responses node crashing operation counting.requestBody, content, media type, or security nodes aborting the run.components, path item parameters, or non-object reference targets aborting the run.servers URL templates aborting the run at startup instead of reporting a schema error.x-codegen-contextRoot beside the path templates crashing.$ref and a sibling keyword point at the same target.negative_data_rejection for an empty array or string the schema admits.negative_data_rejection for read-only properties a server ignores instead of rejecting.negative_data_rejection for operations whose security lists alternative requirements.negative_data_rejection and missing_required_header for 415 responses to requests without Content-Type.positive_data_acceptance when type lists null but enum omits it.positive_data_acceptance for nullable / x-nullable fields whose enum omits null.positive_data_acceptance for allOf mixing items with a sibling branch's prefixItems.--report json missing from the list of written reports in the run summary.UnicodeEncodeError when the output encoding cannot represent status glyphs, such as CP1252 on Windows.allow-extra-parameters = false ignored for request bodies in the fuzzing phase.-aUSER:PASS, -HAuthorization: ...) leaking into report command lines..schemathesis directory.--checks, including --checks all.st replay reporting sanitized crash files as fixed and deleting them.base_url_mismatch, unsupported_regex, unresolvable_reference in [warnings], and report invalid warning names clearly.pattern dropped from a request parameter or body.Negative coverage case that omits a request body the operation declares required.
_entities and _service stay out unless filters select them.base_url_mismatch warning when every response is 404 and --url omits the schema's base path.unresolvable_reference warning listing the parameters and responses skipped over a missing schema component.--max-time stops st run after the given number of seconds.--auth-wfc and --auth-wfc-user for Web Fuzzing Commons auth files.--report json writes the run's verdict as one JSON document.state in the ASGI lifespan scope.starlette-testclient and starlette dependencies.anyio 4.15.HEAD operations failing with an internal AttributeError.TypeError.ValueError.session passed to case.call() ignored.ALLOWED_HOSTS rejection reported without an explanation.Content-Type.multipart/mixed request bodies sent as an empty payload.authTemplate not merged into each entry when loading auth files.user is configured, as documented.token nor expectCookies rejected, ignoring the returned cookies.not over patternProperties.patterns must match at once.pattern that names a capture group.allowEmptyValue: false. #4574true / false / null.null sent instead of omitted.contentMediaType: application/octet-stream form fields not sent as file uploads.application/*+json sent without a concrete Content-Type.allOf requiring a property no branch combination admits.allOf branches naming integer and number as unsatisfiable.anyOf/oneOf violations for branches with $ref siblings.items violations for arrays declaring prefixItems.prefixItems when building array cases for OpenAPI 3.1 operations.properties does not declare from generated array items.propertyNames rejects.multipleOf value outside the float bound minimum and maximum pin.maxContains.responses that is not an object reported as a generic parsing failure.servers URL templates crashing instead of reporting a schema error.$ref values that name no readable file crashing instead of reporting an unresolvable reference.$ref in an optional parameter or required body rejecting the operation.$ref in a response schema rejecting the operation.openapi versions with a suffix, such as 3.1.0-custom, rejected.responses, such as x-note: null, rejected.ignored_auth for APIs that reject unauthenticated requests with 403.negative_data_rejection for example header and cookie values.negative_data_rejection for GraphQL when captured identifiers replaced the violating argument.negative_data_rejection for GraphQL arguments that declare a default value.negative_data_rejection for non-numeric query and path parameters whose serialized value is valid. #4600unsupported_method when a secured operation answers 401 or 403 before routing.unsupported_method for 404 responses on paths whose parameters are pinned.ignored_auth bypasses in APIs that accept any well-formed bearer or basic credentials.security accepts unauthenticated access via {}.{} is not allowed.negative_data_rejection message omitting parameter names when several parameters are mutated. #4600positive_data_acceptance extra-properties hint shown when the server rejects a declared field.st fuzz startup outlasts --max-time.NDJSON report spells phase names and skip reasons as machine tokens ( stateful , not_applicable ).
stateful, not_applicable).--header, --auth, --proxy and the schema URL stored unsanitized in the recorded command.Reports section of the CLI summary.pattern-matching string as a multipleOf violation for union types.oneOf branches admit when one keeps keywords beside $ref.$ref when generating values.patternProperties entries matching a declared property name.Support for validating httpx2 responses in Case.validate_response .
httpx2 responses in Case.validate_response.base_url error fires.warnings.fail-on in the --warnings help text.false for const: 0 (and vice versa) when intersecting allowed values.anyOf/oneOf/allOf or the keywords beside them.allOf branch requires and another forbids.anyOf/oneOf with keywords beside them.const that the rest of its schema rejects.oneOf value a second branch admits under the operation's draft.enum/const members the operation's draft rejects.example/default values the operation's draft rejects.anyOf/oneOf branch values against the parent in the wrong draft.multipleOf beside a numeric bound past 28 significant digits.multipleOf steps no float can carry, landing back on the excluded bound.exclusiveMinimum/exclusiveMaximum overriding a tighter minimum/maximum instead of combining.7.0.minimum/maximum repeats a large float exclusiveMinimum/exclusiveMaximum.integer when number is allowed too.multipleOf past 2^53.inf as a violation of a bound at the largest float.multipleOf.additionalProperties for required names absent from properties.maxProperties when covering a property the template omits.minProperties violation for untyped schemas.if, then, else, or not from nested templates.pattern whose minLength exceeds the generation buffer.minLength exceeds maxLength.maxLength.pattern whose minLength exceeds maxLength.minItems/minProperties past the generation buffer beside a combinator.minItems/minProperties floor past a smaller ceiling.maxProperties past the generation buffer.minItems without items, and building arrays past the generation buffer.minProperties past the generation buffer.minProperties in the hundreds and then emitting nothing.example/default values with non-alphanumeric characters.readOnly field.$ref targets differ.positive_data_acceptance for values with a sibling anyOf/oneOf in the coverage phase.negative_data_rejection for format: float bounds a single-precision server cannot distinguish.negative_data_rejection for numeric bounds past 2^53 in the coverage phase.negative_data_rejection for bodies whose schema declares a format anywhere.minItems/minProperties past the generation buffer as a schema error instead of a health check.anyOf/oneOf/$ref schemas losing their null branch to the default string type.anyOf/oneOf serialized as their property names.Report filter expressions that match no API operations, with the closest match as a suggestion.
allow_header_conformance check comparing the Allow header against the methods declared in the schema.pattern under a length bound.pattern whose repeated group cannot fit an exact length bound.pattern like ^[a-z]$ allows when maxLength is set.pattern with possessive quantifiers like 0++0 when a length bound is set.pattern naming characters outside generation.codec.\p{L}.(?<name>...).anyOf branches when one names an ungeneratable pattern.pattern the API enforces when Python cannot read it.format when generating string values for Open API 3.1.hostname and idn-hostname values that validators accept.pattern and format in a conjunction.contentEncoding and contentMediaType under Draft 7.type.oneOf / anyOf branches whose discriminator property is nullable.true/false/null for booleans and nulls nested in array query parameters.maxProperties when a captured resource value is injected.$id in place, without fetching it.$id is a bare fragment like #/definitions/text.pattern the validator cannot compile as an invalid regular expression.patternProperties regexes and patterns containing a quote.true.$response. in Open API links.on, off, yes and no in YAML documents as strings, per YAML 1.2.pattern with optional parts and maxLength.allOf, oneOf, or anyOf.\d and \w as ASCII.null for nullable schemas an allOf sibling restricts to objects.allOf schemas with no equivalent flat form.required from allOf branches that sit beside an unresolved $ref.allOf, like additionalProperties: false.allOf sibling forbids.positive_data_acceptance for values a sibling not excludes.anyOf / oneOf in bodies, like items or additionalProperties.maxLength violation for a pattern whose repeated group spans two lengths.$ref. #4499unsupported_method when a templated path returns 404 instead of 405. #4503operation-id.phases.fuzzing.generation.modes.positive_data_acceptance for not clauses in schemas using references.positive_data_acceptance for credential-granting operations answering 400 or 422.negative_data_rejection for empty array path parameters.--checks selects only specific checks.--suppress-health-check with a subset of checks re-enabling the rest in stateful tests.RuntimeError: generator ignored GeneratorExit when an interrupt arrives while the event stream closes.pattern across operations.pattern strings with maxLength above 8192.pattern.maxItems above 15.pattern strings whose quantifier sits inside a group.pattern no value can violate.pattern strings with a high minLength.hypothesis-jsonschema dependency.Faster strategy construction for string, integer, and anyOf schemas.
string, integer, and anyOf schemas.string, integer, and anyOf schemas built from the jsonschema-rs canonical form.positive_data_acceptance hint counting properties declared under allOf/anyOf/oneOf as undocumented.
positive_data_acceptance hint counting properties declared under allOf/anyOf/oneOf as undocumented.$ref. #4350config.*.update() ignoring invalid values and resetting flags it was not given.Fuzz dictionaries not applied to body fields nested under oneOf/anyOf/allOf or if/then/else. #4347
oneOf/anyOf/allOf or if/then/else. #4347enum, const, and bare type schemas moved to jsonschema-rs.Dynamic token authentication support for OAuth2 and OpenID Connect security schemes.
auth.dynamic.openapi.<scheme>.retry-on, @schemathesis.auth(retry_on=[401])).401/403 responses from a dynamic authentication token endpoint as rejected credentials.dictionary changed size during iteration with multiple workers under free-threaded Python.$schema dialect.positive_data_acceptance for required array query parameters generated as empty.negative_data_rejection for body schemas with additionalProperties: false. #4332prefixItems in OpenAPI 3.1 schemas.Cannot sample from a length-zero sequence for array items with an empty enum.positive_data_acceptance for array items with enum entries violating the item schema.$refs silently skipped when dependency ordering applies.missing_deserializer warning for media types whose own schema is unstructured.Configuration Error heading.missing_deserializer warning by media type, one line per operation.Reuse literal values from the application's Python source during generation. Disable via analysis.constants.enabled.
analysis.constants.enabled.[auth.wfc].429 retries honoring the Retry-After header with --rate-limit=auto. #1722checks.response_schema_conformance.validate-formats to disable format validation in response checks. #2481positive_data_acceptance for arrays with contains/minContains/maxContains in the coverage phase.positive_data_acceptance for objects with dependentRequired/dependentSchemas in the coverage phase.negative_data_rejection for objects combining additionalProperties with matching patternProperties.positive_data_acceptance for path integers at the schema minimum. #4312format: int32/int64. #593multipleOf with minimum and maximum in the coverage phase.negative_data_rejection for const and propertyNames under Open API 3.0 in the coverage phase.int64 minimum accepted during schema validation.False positive use_after_free when PUT re-creates a resource after DELETE . #4286
use_after_free when PUT re-creates a resource after DELETE. #4286jsonschema-rs upgraded to 0.47.0 with better validator build performance.use_after_free when PUT re-creates a resource after DELETE. #4286jsonschema-rs upgraded to 0.47.0 with better validator build performance.Intermittent internal traceback for arrays requiring items that can never be generated. #4282
Response schema conformance failures name the matched response status code. #4272
negative_data_rejection for boolean query parameters mutated to coercible objects. #4254False positive negative_data_rejection when a before_call hook overwrites an invalid parameter with a valid value. #4277
negative_data_rejection when a before_call hook overwrites an invalid parameter with a valid value. #4277Class-based checks that run per response and once after the whole run. #1147, #1689
st replay. #3006junit-xml dependency; generate JUnit reports with the standard library.tenacity dependency in favor of the standard library.httpx dependency.False positive negative_data_rejection for boolean query/path parameters in the coverage phase. #4254
Encode spaces in path parameters as %20 instead of +. #4252
%20 instead of +. #4252False positive response schema validation for nullable enums (type: [..., "null"] with enum). #4249
type: [..., "null"] with enum). #4249False positive positive_data_acceptance for array parameters with a percent-encoded ,/| separator. #4246
positive_data_acceptance for array parameters with a percent-encoded ,/| separator. #4246Infer stateful links for path parameters named after their collection (e.g. /sessions/{session}).
/sessions/{session}).False positive negative_data_rejection for array path parameters serializing to a valid comma-joined value. #4240
negative_data_rejection for array path parameters serializing to a valid comma-joined value. #4240False positive negative_data_rejection with a globally-registered @schemathesis.auth handler setting a cookie. #4236
negative_data_rejection with a globally-registered @schemathesis.auth handler setting a cookie. #4236False positive negative_data_rejection when using @schemathesis.auth with a cookie security scheme. #4236
Response cookies leaking between generated test cases, causing false authentication failures.
Missing boundary negative in the coverage phase for boolean exclusiveMinimum / exclusiveMaximum.
exclusiveMinimum / exclusiveMaximum.UnicodeEncodeError when failure or error output contains lone Unicode surrogate characters. #4229Chain GraphQL operations on non-id identifiers (fullPath, slug, ...) in stateful and fuzzing phases.
id identifiers (fullPath, slug, ...) in stateful and fuzzing phases.maxLength / maxItems.maxLength / maxItems values.hypothesis-graphql to 0.13.0 that brings up to 180x performance improvements for deeply nested GraphQL schemas.harfile to 0.5.0 for slightly better performance.const / enum fields with invalid data.additionalProperties: false from Pydantic extra_forbidden errors and the exception_detail validation envelope.Skip coverage generation for header and cookie parameters whose pattern requires a non-alphanumeric character.
pattern requires a non-alphanumeric character.Fuzzing phase marked as failed without any reported failure. #4209patterns with maxLength.max_response_time failures.Re-raise original server exceptions in WSGI apps for distinct error deduplication. #1289
pattern requires /, {, or }.Skip coverage boundary-length variants that are structurally impossible for the declared pattern.
pattern.tls-verify and tls-cert to dynamic auth token requests. #4199Override server variable defaults via [servers.variables] in config. #4166
[servers.variables] in config. #4166payload_content_type. #4167properties declared next to a non-object type.$ref instead of generating null/{}.servers[] declared at path-item and operation scopes. #4166minLength negatives for string schemas whose pattern requires more characters than minLength - 1.minLength/maxLength negatives for string schemas whose format (e.g. email, uuid) makes the bounded length unsatisfiable.enum / const keywords when entries violate the declared type by emitting each entry as a negative case.Content-Type: application/json on JSON-serialized nested multipart/form-data parts.AAA) as the string-type negative for non-string parameters so ?q= no longer collapses to absent on the wire.AttributeError.maxLength negatives for string schemas whose format makes the exact length unsatisfiable when maxLength exceeds 100.negative_data_rejection for integer enum entries under type: integer / type: number.Stateful tests damp reuse of extracted values from unreliable API links.
.schemathesis/; probing replays them to skip rediscovery.[dictionaries.<name>] and [generation.dictionaries]. #2121[parameters] with body.<jsonpath> keys.$ref paths containing URI-reserved characters (e.g. paths/{id}/op.yaml). #4152$ref strings without a / separator.--report-allure-path (or reports.allure.path) cannot be used as a filesystem path.RecursionError in coverage phase on multi-branch allOf schemas that canonicalish cannot simplify.collectionFormat.minItems: 1 arrays when items is unsatisfiable.maxLength thresholds between 32 KB and 1 MB.allOf when a sibling property uses a bundled $ref.maxItems negatives for uniqueItems: true arrays whose items.enum domain is exhausted.enum to that domain via items.enum.items is declared without type: array.maxLength negatives even when the schema's pattern is intrinsically unsatisfiable.pattern negatives for header and cookie parameters.Optional[Enum] query parameters (anyOf with $ref and sibling enum).repr.positive_data_acceptance for body schemas with additionalProperties: false inherited via allOf.positive_data_acceptance for maxItems: 0 arrays whose items schema is satisfiable.positive_data_acceptance for not clauses whose violations breach other outer constraints.positive_data_acceptance when a discriminator branch references a polymorphic schema.positive_data_acceptance when sibling oneOf/anyOf constraints reference bundled $ref schemas.Render negative_data_rejection mutation descriptions cleanly: no trailing at, readable original values.
negative_data_rejection mutation descriptions cleanly: no trailing at, readable original values.prefixItems. #4099negative_data_rejection when a before_call hook reassigns request parameters. #4101minItems so per-item violations fire instead of length violations.formData Swagger 2.0 parameters as form payloads when consumes only declares non-form media types.additionalProperties: false through deep allOf chains.sqlite-libs in docker images.discriminator branch when the type tag literal differs from the schema name.Serialize nested-object query parameters using recursive bracket notation.
oneOf: [array, string] parameters by forcing non-empty strings.Content-Type to the body media type when it is declared as an explicit header parameter.pattern/minLength/maxLength (e.g. Kubernetes CRDs).$ref schemas carrying sibling validation keywords.additionalProperties: {schema} on objects without explicit type: object.type: array parameters so item-level keywords reach coverage.*/* from Swagger 2.0 consumes so coverage requests carry a concrete Content-Type.negative_data_rejection.--wait-for-schema. #4058negative_data_rejection on query-level additionalProperties mutations. #3730$ref in positive_data_acceptance hint to avoid false "additional properties" suggestions.allOf with readOnly required properties.uniqueItems.One column per quarter.