benchmark_harness_plus
A statistically rigorous benchmarking harness with median-based comparisons, CV% reliability metrics, and outlier-resistant measurements.
What this package is like to depend on
Last release 7 months ago
09 Jan 2026
Too new to tell
only 1 release windows
Nearly every release is documented
notes for 6 of 6 stable releases
Nothing withdrawn
no release was ever pulled
7 months old
6 releases · first in 2026
6 releases in the last 12 months
see the full history below
Release timeline
6 releases · Jan 2026 to Jan 2026Releases
latest 6-
3.0.109 Jan 2026 -
3.0.009 Jan 2026Release notes
Open source →- Breaking: Added
Percentagetype for type-safe percentage values - Breaking:
cv()now returnsPercentageinstead ofdouble - Breaking:
BenchmarkResult.cvnow returnsPercentage - Breaking:
BenchmarkResult.improvementVs()now returnsPercentage - Breaking:
BenchmarkComparison.improvementPercentrenamed toimprovementand returnsPercentage - Breaking:
reliabilityFromCV()now takesPercentageinstead ofdouble
- Breaking: Added
-
2.0.009 Jan 2026Release notes
Open source →- Bump SDK constraint to ^3.5.0
- Update extra_pedantic to ^5.0.0
- Add GitHub Actions CI
-
1.2.007 Jan 2026Release notes
Open source →- Removed GC triggering between variants (can cause more noise than it reduces)
-
1.1.007 Jan 2026Release notes
Open source →- Added "fastest" column to table output showing the minimum (best) sample time
- Added "Fastest" line to detailed result output
- Added new example demonstrating when minimum vs median should be used
- Restructured examples into separate files for easier reference
-
1.0.006 Jan 2026Release notes
Open source →- Initial release
- Statistical functions: mean, median, stdDev, cv, min, max
- BenchmarkConfig with quick, standard, and thorough presets
- BenchmarkResult with computed statistics and reliability assessment
- BenchmarkComparison for comparing variants
- Benchmark harness with warmup and randomized ordering
- Result formatting: table, detailed, and CSV export
- Comprehensive documentation and examples