API Reference
Command
Test-BenchmarkGate
Tests normalized benchmark summaries against a JSON baseline.
Remarks
Tests normalized benchmark summaries against a JSON baseline.
Examples
Verify a benchmark summary against a baseline
Test-BenchmarkGate -SummaryPath .\Build\Benchmarks\summary.json -BaselinePath .\Build\Benchmarks\baseline.json -Metric MedianMs
Common Parameters
This command supports the common parameters: -Debug, -ErrorAction, -ErrorVariable, -InformationAction, -InformationVariable, -OutVariable, -OutBuffer, -PipelineVariable, -Verbose, -WarningAction, and -WarningVariable.
For more information, see about_CommonParameters.
Syntax
Test-BenchmarkGate [-AbsoluteToleranceMs <Double>] [-AllowNew] -BaselinePath <String> [-GroupBy <String[]>] [-Metric <String>] [-MetricDirection <Auto|LowerIsBetter|HigherIsBetter>] [-RelativeTolerance <Double>] -SummaryPath <String> [-Update] [<CommonParameters>]#Parameter set:
All Parameter SetsParameters
- AbsoluteToleranceMs Double
- Absolute tolerance in milliseconds.
- AllowNew SwitchParameter
- Allows new metrics missing from baseline.
- BaselinePath String
- Baseline JSON path.
- GroupBy String[]
- Fields used to construct stable metric keys.
- Metric String
- Metric name to evaluate.
- MetricDirection BenchmarkMetricDirection
- Metric direction for regression checks.
- Possible values:
Auto,LowerIsBetter,HigherIsBetter - RelativeTolerance Double
- Relative tolerance.
- SummaryPath String
- Summary JSON path.
- Update SwitchParameter
- Updates the baseline instead of verifying it.
Outputs
PowerForge.BenchmarkGateResult