An integration testing framework that discovers tests, runs them with managed fixtures, and validates output against baselines.
Releases
Section titled “Releases”- Unreleased
- v1.7.0
This release adds suite-level capability requirements, letting test suites declare required operators and skip gracefully when those capabilities are unavailable in the target build.
- v1.6.0
This release adds fixture assertion hooks that enable post-test validation of side effects while fixtures remain active. Assertion results are tracked separately in the run summary.
- v1.5.1
This release improves error handling by showing clean messages for unavailable fixtures and avoids unnecessary fixture initialization for fully skipped test suites.
- v1.5.0
This release adds fine-grained controls for running skipped tests, including a new --run-skipped-reason flag with substring and glob matching semantics.
- v1.4.0
This release introduces a standalone fixture mode for starting fixtures without running tests, adds a built-in docker-compose fixture with structured options, and provides shared container runtime helpers for writing custom fixtures.
- v1.3.2
This release improves the readability of configuration override log messages by using relative paths and human-friendly formatting.
- v1.3.1
This release adds support for nested dataclass hierarchies in fixture options, enabling multi-level structured configurations in test frontmatter.
- v1.3.0
This release adds structured configuration options for fixtures, letting tests pass typed parameters through YAML frontmatter using frozen dataclasses.
- v1.2.2
This release fixes a serialization bug where Python fixture tests with
skipconfigurations intest.yamlfailed with a JSON serialization error. - v1.2.1
This patch release improves the
-m/--matchflag with automatic substring matching and centralizes skip handling in the engine for more consistent test reporting. - v1.2.0
This release adds support for selecting tests by name using glob patterns via the new
-m/--matchCLI option. - v1.1.1
This release improves the CLI help text with usage examples and a link to the documentation.
- v1.1.0
This release adds stdin file support for piping data directly to tests, and improves satellite project display in project listings.
- v1.0.2
This release improves the debugging experience by making the
--debugflag automatically enable verbose output, so you see all test results when diagnosing failures. - v1.0.1
This release fixes an issue with diff tests failing when using multi-word Tenzir commands.
- v1.0.0
This release introduces automatic binary detection with a clear precedence order: environment variables take priority, followed by PATH lookup, with
uvxas fallback. Environment variables now support multi-part commands for full control over binary invocation. The--tenzir-binaryand `--tenzi... - v0.15.0
This release adds the
--verboseflag for controlling test output verbosity. By default, only failures are shown, reducing noise in large test suites while still providing all details when needed. - v0.14.0
This release introduces inline test inputs for better test organization in deeply nested hierarchies. Tests can now place input data directly alongside test files, and you can create local
inputs/directories at any level with automatic shadowing semantics. - v0.13.1
This release fixes path handling in the diff runner to strip root path prefixes from output, making paths relative and consistent with other test runners.
- v0.13.0
This release adds
--package-dirssupport and improves startup diagnostics. - v0.12.0
Minor release with improved NO_COLOR handling.
- v0.11.0
Expose tenzir-test as a reusable Python library.