Benchstat compares benchmark repetitions. Profile rows describe cluster processes, not the benchmark client. CPU values are total sampled CPU time (including warmup and idle; capture durations can differ); allocation values are sampled bytes allocated over the process lifetime (including startup and warmup), scaled in powers of 1024. Profile changes are not statistical tests. Serve this directory over HTTP to view flamegraphs (browsers restrict local file fetches).
name old time/op new time/op delta CheckoutService 27.3ms ± 6% 28.5ms ±15% ~ (p=0.690 n=5+5) name old queries/s new queries/s delta CheckoutService 36.7 ± 6% 35.5 ±14% ~ (p=0.690 n=5+5) name old response-alloc/op new response-alloc/op delta CheckoutService 149kB ± 0% 136kB ± 0% -9.03% (p=0.008 n=5+5)
name old time/op new time/op delta LabelNames 1.23s ± 1% 1.23s ± 1% ~ (p=0.841 n=5+5) name old queries/s new queries/s delta LabelNames 0.81 ± 1% 0.81 ± 1% ~ (p=0.841 n=5+5) name old response-alloc/op new response-alloc/op delta LabelNames 12.6kB ± 0% 12.4kB ± 0% -1.49% (p=0.008 n=5+5)
name old time/op new time/op delta MergeDot 6.81s ± 4% 6.96s ± 1% ~ (p=0.095 n=5+5) name old queries/s new queries/s delta MergeDot 0.15 ± 4% 0.14 ± 1% ~ (p=0.063 n=5+5) name old response-alloc/op new response-alloc/op delta MergeDot 861kB ± 0% 861kB ± 0% ~ (p=1.000 n=5+5)
name old time/op new time/op delta MergeFlamegraph 6.86s ± 2% 6.84s ± 0% ~ (p=0.151 n=5+5) name old queries/s new queries/s delta MergeFlamegraph 0.15 ± 2% 0.15 ± 0% ~ (p=0.151 n=5+5) name old response-alloc/op new response-alloc/op delta MergeFlamegraph 203kB ± 0% 190kB ± 0% -6.45% (p=0.008 n=5+5)
name old time/op new time/op delta MergePprof 6.90s ± 2% 6.88s ± 3% ~ (p=0.841 n=5+5) name old queries/s new queries/s delta MergePprof 0.14 ± 2% 0.15 ± 3% ~ (p=0.810 n=5+5) name old response-alloc/op new response-alloc/op delta MergePprof 550kB ± 0% 498kB ± 1% -9.39% (p=0.008 n=5+5)
name old time/op new time/op delta MergeTree 6.88s ± 2% 6.82s ± 2% ~ (p=0.548 n=5+5) name old queries/s new queries/s delta MergeTree 0.15 ± 2% 0.15 ± 2% ~ (p=0.548 n=5+5) name old response-alloc/op new response-alloc/op delta MergeTree 179kB ± 0% 179kB ± 0% ~ (p=1.000 n=5+5)
name old time/op new time/op delta MergedFlamegraph 14.5s ± 2% 14.1s ± 5% ~ (p=0.222 n=5+5) name old queries/s new queries/s delta MergedFlamegraph 0.07 ± 2% 0.07 ± 5% ~ (p=0.222 n=5+5) name old response-alloc/op new response-alloc/op delta MergedFlamegraph 216kB ± 0% 203kB ± 0% -6.19% (p=0.008 n=5+5)
name old time/op new time/op delta Series/all-by-workload-labels 1.51s ± 1% 1.51s ± 1% ~ (p=0.421 n=5+5) Series/all-by-profile-type-service 97.7ms ± 1% 97.2ms ± 2% ~ (p=0.548 n=5+5) Series/single-service-by-workload-labels 1.24s ± 1% 1.24s ± 1% ~ (p=0.841 n=5+5) name old queries/s new queries/s delta Series/all-by-workload-labels 0.66 ± 1% 0.66 ± 1% ~ (p=0.421 n=5+5) Series/all-by-profile-type-service 10.2 ± 1% 10.3 ± 2% ~ (p=0.532 n=5+5) Series/single-service-by-workload-labels 0.80 ± 1% 0.80 ± 1% ~ (p=0.889 n=5+5) name old response-alloc/op new response-alloc/op delta Series/all-by-workload-labels 8.57MB ± 0% 8.46MB ± 0% -1.26% (p=0.008 n=5+5) Series/all-by-profile-type-service 2.00MB ± 0% 1.96MB ± 0% -2.07% (p=0.008 n=5+5) Series/single-service-by-workload-labels 322kB ± 0% 318kB ± 0% -1.26% (p=0.008 n=5+5)
name old time/op new time/op delta SeriesByService 13.8s ± 3% 13.8s ± 4% ~ (p=1.000 n=5+5) name old queries/s new queries/s delta SeriesByService 0.07 ± 3% 0.07 ± 4% ~ (p=1.000 n=5+5) name old response-alloc/op new response-alloc/op delta SeriesByService 533kB ± 0% 521kB ± 0% -2.28% (p=0.008 n=5+5)
name old time/op new time/op delta SeriesTotal 14.1s ± 1% 14.1s ± 4% ~ (p=0.690 n=5+5) name old queries/s new queries/s delta SeriesTotal 0.07 ± 1% 0.07 ± 4% ~ (p=0.690 n=5+5) name old response-alloc/op new response-alloc/op delta SeriesTotal 80.0B ± 0% 79.0B ± 0% -1.25% (p=0.008 n=5+5)
name old time/op new time/op delta ServiceLabelValues 1.24s ± 1% 1.24s ± 1% ~ (p=0.841 n=5+5) name old queries/s new queries/s delta ServiceLabelValues 0.81 ± 1% 0.80 ± 1% ~ (p=0.841 n=5+5) name old response-alloc/op new response-alloc/op delta ServiceLabelValues 230kB ± 0% 226kB ± 0% -1.47% (p=0.008 n=5+5)