Command
Test-BenchmarkGate
Tests normalized benchmark summaries against a JSON baseline.
Syntax
Test-BenchmarkGate
[-AbsoluteToleranceMs <Double>]
[-AllowNew]
-BaselinePath <String>
[-GroupBy <String[]>]
[-Metric <String>]
[-MetricDirection <Auto| LowerIsBetter| HigherIsBetter>]
[-RelativeTolerance <Double>]
-SummaryPath <String>
[-Update]
[<CommonParameters>]#Parameter set:
All Parameter SetsExamples
Verify a benchmark summary against a baseline
Test-BenchmarkGate -SummaryPath .\Build\Benchmarks\summary.json -BaselinePath .\Build\Benchmarks\baseline.json -Metric MedianMsParameters
- -AbsoluteToleranceMs Double
- Absolute tolerance in milliseconds.
- -AllowNew SwitchParameter
- Allows new metrics missing from baseline.
- -BaselinePath String
- Baseline JSON path.
- -GroupBy String[]
- Fields used to construct stable metric keys.
- -Metric String
- Metric name to evaluate.
- -MetricDirection BenchmarkMetricDirection
- Metric direction for regression checks.
- Possible values:
Auto,LowerIsBetter,HigherIsBetter - -RelativeTolerance Double
- Relative tolerance.
- -SummaryPath String
- Summary JSON path.
- -Update SwitchParameter
- Updates the baseline instead of verifying it.
Common Parameters
This command supports the common parameters: -Debug, -ErrorAction, -ErrorVariable, -InformationAction, -InformationVariable, -OutVariable, -OutBuffer, -PipelineVariable, -Verbose, -WarningAction, and -WarningVariable.
For more information, see about_CommonParameters.