An integration testing framework that discovers tests, runs them with managed fixtures, and validates output against baselines.
Releases
Section titled “Releases”- v1.7.5
This release establishes the correct v1.7.5 version tag. A double-bump bug in the release automation caused the v1.7.4 git tag to point to a commit where pyproject.toml already read 1.7.5, so 1.7.4 was never published to PyPI and the git tag was misaligned with the actual package version. The aut...
- v1.7.4
This release fixes how skipped tests interact with baseline files. Existing baselines now stay untouched when you skip tests, which prevents unrelated baseline churn and avoids false failures when you toggle skip conditions.
- v1.7.3
This release improves parallel suite scheduling reliability and adds correctness guards via suite.min_jobs in test.yaml.
- v1.7.2
This release fixes enum serialization errors when Python fixture tests use configuration values like mode: sequential in test.yaml.
- v1.7.1
This release adds parallel suite execution and fixes several bugs, including clean Ctrl+C handling, consistent default fixture options, and reliable shell runner defaults for .sh test files.
- v1.7.0
This release adds suite-level capability requirements, letting test suites declare required operators and skip gracefully when those capabilities are unavailable in the target build.
- v1.6.0
This release adds fixture assertion hooks that enable post-test validation of side effects while fixtures remain active. Assertion results are tracked separately in the run summary.
- v1.5.1
This release improves error handling by showing clean messages for unavailable fixtures and avoids unnecessary fixture initialization for fully skipped test suites.
- v1.5.0
This release adds fine-grained controls for running skipped tests, including a new --run-skipped-reason flag with substring and glob matching semantics.
- v1.4.0
This release introduces a standalone fixture mode for starting fixtures without running tests, adds a built-in docker-compose fixture with structured options, and provides shared container runtime helpers for writing custom fixtures.
- v1.3.2
This release improves the readability of configuration override log messages by using relative paths and human-friendly formatting.
- v1.3.1
This release adds support for nested dataclass hierarchies in fixture options, enabling multi-level structured configurations in test frontmatter.
- v1.3.0
This release adds structured configuration options for fixtures, letting tests pass typed parameters through YAML frontmatter using frozen dataclasses.
- v1.2.2
This release fixes a serialization bug where Python fixture tests with
skipconfigurations intest.yamlfailed with a JSON serialization error. - v1.2.1
This patch release improves the
-m/--matchflag with automatic substring matching and centralizes skip handling in the engine for more consistent test reporting. - v1.2.0
This release adds support for selecting tests by name using glob patterns via the new
-m/--matchCLI option. - v1.1.1
This release improves the CLI help text with usage examples and a link to the documentation.
- v1.1.0
This release adds stdin file support for piping data directly to tests, and improves satellite project display in project listings.
- v1.0.2
This release improves the debugging experience by making the
--debugflag automatically enable verbose output, so you see all test results when diagnosing failures. - v1.0.1
This release fixes an issue with diff tests failing when using multi-word Tenzir commands.
- v1.0.0
This release introduces automatic binary detection with a clear precedence order: environment variables take priority, followed by PATH lookup, with
uvxas fallback. Environment variables now support multi-part commands for full control over binary invocation. The--tenzir-binaryand `--tenzi... - v0.15.0
This release adds the
--verboseflag for controlling test output verbosity. By default, only failures are shown, reducing noise in large test suites while still providing all details when needed. - v0.14.0
This release introduces inline test inputs for better test organization in deeply nested hierarchies. Tests can now place input data directly alongside test files, and you can create local
inputs/directories at any level with automatic shadowing semantics. - v0.13.1
This release fixes path handling in the diff runner to strip root path prefixes from output, making paths relative and consistent with other test runners.
- v0.13.0
This release adds
--package-dirssupport and improves startup diagnostics. - v0.12.0
Minor release with improved NO_COLOR handling.
- v0.11.0
Expose tenzir-test as a reusable Python library.