[Perf] Windows/x64: 1 Regression on 6/9/2023 10:45:21 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	aaffd8bf6e0743b204b273e8a1e48dd628ba5d0f
Compare	15d7761208c88c4bcd2c5052cbccc25f26b5a8a4
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Memory.Span<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SequenceCompareTo - Duration of single invocation	24.94 ns	26.97 ns	1.08	0.21	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Char>*'

Details

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Char>.SequenceCompareTo(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.967056371494223 > 26.193587341381264.
IsChangePoint: Marked as a change because one of 4/18/2023 3:11:52 AM, 6/9/2023 5:38:58 AM, 6/12/2023 11:18:39 PM falls between 6/4/2023 12:53:30 AM and 6/12/2023 11:18:39 PM.
IsRegressionStdDev: Marked as regression because -10.666566044390997 (T) = (0 -27.27329575420734) / Math.Sqrt((0.5326830040991603 / (30)) + (0.09924823383752245 / (12))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (12) - 2, .025) and -0.06734446050741615 = (25.552477914432234 - 27.27329575420734) / 25.552477914432234 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[EgorBo]

Could be dotnet/runtime#85562