nextest-metadata

Added

• A new build_platform field on RustNonTestBinarySummary records whether Cargo built the binary for the host or for the target. Future versions of nextest will use this to correctly configure environment variables depending on the build platform.
• BuildPlatform now implements Hash, PartialOrd, and Ord. The order is Target before Host, though this isn't semantically meaningful.
• MismatchReason::is_substantive_skip returns true if a skip reflects a real filtering decision, rather than a run-mode artifact such as a non-benchmark test excluded from a benchmark run.

Changed

• Documentation-only change: base_output_directories is now documented as being resolved against both of the following:

  • When joined with target_directory it is the Cargo artifact directory, where final artifacts like binaries and dynamic libraries are uplifted to.
  • When joined with build_directory plus deps, it is the legacy deps directory.

  This supersedes the note in 0.14.0 that described them as relative to the build directory alone.

• MSRV updated to Rust 1.86.

Added

• A new GLOBAL_TEST_GROUP constant ("@global"), representing the implicit global test group that all tests belong to unless assigned to a custom group.

Added

• A new build_directory field on RustBuildMetaSummary. When Cargo's build.build-dir is configured, the build directory (for intermediate artifacts) differs from the target directory. This is None when parsing metadata from older nextest versions, in which case consumers should treat it as equal to target_directory.
• A new build_script_info field on RustBuildMetaSummary, keyed by package ID. This is None when parsing metadata from older nextest versions.
  • The values of this map are BuildScriptInfoSummary structs, which currently contain an envs field consisting of environment variables set by cargo::rustc-env directives.

Changed

• base_output_directories, build_script_out_dirs, and linked_paths are now documented as relative to the build directory rather than the target directory.

Added

• MismatchReason::ALL_VARIANTS iterates over all known variants of MismatchReason.

Added

• NextestExitCode::RERUN_TESTS_OUTSTANDING indicates that all tests passed during a rerun, but there are still outstanding tests that were known to have failed earlier.
• For test filtering, MismatchReason::RerunAlreadyPassed, indicating that the test run already passed.
• With the proptest1 feature, impl Arbitrary for TestCaseName.

Added

• New proptest1 feature enables proptest Arbitrary implementations for RustBinaryId and MismatchReason.

Changed

• A new TestCaseName newtype wraps test case identifiers, providing type safety and utility methods:

  • components() splits the name on :: to yield module path components.
  • module_path_and_name() extracts the module path prefix and trailing name.

• RustTestCaseSummary now includes a kind field of type Option<RustTestKind>, distinguishing between tests (#[test]) and benchmarks (#[bench]). This field is None when parsing output from older nextest versions.

Added

• New exit code constant NextestExitCode::OK = 0 for successful execution.

Added

RustTestBinaryKind::EXAMPLE is the string "example".

Changed

MSRV updated to Rust 1.78.

Internal dependency updates.

Changed

• Renamed references from "default-set" to "default-filter" to match cargo-nextest changes.

Removed

• NextestExitCode::INVALID_FILTER_EXPRESSION has been renamed to INVALID_FILTERSET.

Changed

• NextestExitCode::INVALID_FILTER_EXPRESSION has been renamed to NextestExitCode::INVALID_FILTERSET. The old name is kept around as a deprecated alias -- it will be removed in the next major version.

Added

• New exit code NO_TESTS_RUN = 4, indicating no tests to run.
• Support for a new mismatch reason for tests and binaries: that they are not in the default set.

Added

• RustBuildMetaSummary now has a new platforms field, which contains information about host and target platforms. This field is provided by cargo-nextest 0.9.71 and above.

Changed

• MSRV updated to Rust 1.73.
• RustBuildMetaSummary::target_platforms is now deprecated -- use RustBuildMetaSummary::platforms if available.

Added

• RustBuildMetaSummary has a new field called build_script_out_dirs. This is a map of workspace package IDs to their corresponding build script OUT_DIRs.

Misc

• The .crate files uploaded to crates.io now contain the LICENSE-APACHE and LICENSE-MIT license files. Thanks @musicinmybrain for your first contribution!

Added

• New method RustBinaryId::from_parts to construct a RustBinaryId from its constituent parts.
• Stabilized and documented the binary ID format.

Added

• New exit code SETUP_SCRIPT_FAILED: A setup script failed to execute.

Changed

• MSRV updated to Rust 1.70.

Added

• New exit codes:
  • REQUIRED_VERSION_NOT_MET: The current version of nextest did not meet repository or tool requirements.
  • RECOMMENDED_VERSION_NOT_MET: The current version of nextest is older than the minimum recommended version. (This is an advisory code, only generated by cargo nextest show-config version).

Changed

• target-spec updated to version 3. This version includes support for custom platforms.

Fixed

• ListCommand was previously broken: it now uses --message-format correctly. Thanks Donny/강동윤 for your first contribution!

Changed

• MSRV updated to Rust 1.66.

Added

• A new wrapper for test binary IDs, RustBinaryId. This wrapper has a custom Ord implementation to ensure that binary IDs are sorted in a reasonable way for cargo nextest list output.

Changed

• Existing uses of test binary IDs have been changed from String to RustBinaryId.
• MSRV updated to Rust 1.64.

Added

• A new exit code, DOUBLE_SPAWN_ERROR, indicates that an error was encountered while attempting to double-spawn a test process.

Changed

• MSRV updated to Rust 1.62.

(This version was not published due to a code issue.)

Added

• RustBuildMetaSummary has a new target-platforms field, which records information about a list of cross-compilation target platforms. This is to prepare for future support for multiple --target arguments (#537).

  This field is optional, which means that the minimum supported nextest version hasn't been bumped with this release.

Added

• RustBuildMetaSummary has a new target-platform field which records the target platform. (This field is optional, which means that the minimum supported nextest version hasn't been bumped with this release.)

(This change was included in 0.4.4, which should have been a breaking change.)

Changed

• RustTestSuiteSummary::testcases renamed to test_cases.

Added

• RustTestSuiteSummary has a new field status, which is a newtype over strings:
  • "listed": the test binary was executed with --list to gather the list of tests in it.
  • "skipped": the test binary was not executed because it didn't match any expression filters.

Added

• New documented exit code WRITE_OUTPUT_ERROR.

Added

• New documented exit codes related to self-updates:
  • UPDATE_ERROR
  • UPDATE_AVAILABLE
  • UPDATE_DOWNGRADE_NOT_PERFORMED
  • UPDATE_CANCELED
  • SELF_UPDATE_UNAVAILABLE

Added

• New documented exit code TEST_LIST_CREATION_FAILED.

Added

• Support for archiving test binaries:
  • Non-test binaries and dynamic libraries are now recorded to RustBuildMetaSummary.

Changed

• Minimum supported nextest version bumped to 0.9.15.
• MSRV bumped to 1.59.

Added

• New exit code: INVALID_FILTER_EXPRESSION.

Added

• TestListSummary and BinaryListSummary have a new member called rust_build_meta key. This key currently contains the target directory, the base output directories, and paths to search for dynamic libraries in relative to the target directory.

Changed

• MSRV bumped to Rust 1.56.

Add documentation about nextest-metadata's "minimum supported cargo-nextest version".

Thanks to Guiguiprim for their contributions to this release!

This release is compatible with cargo-nextest 0.9.10 and later.

Added

• Lists now contain the build-platform variable, introduced in cargo-nextest 0.9.10.
• Support for listing binaries without querying them for the tests they contain.

Changed

• Fields common to test and binary lists have been factored out into a separate struct, RustTestBinarySummary. The struct is marked with #[serde(flatten)] so the JSON representation stays the same.

• Initial version, with support for listing tests.