I have the following audit benchmark result in one of my PC, please if someone from team explain us how to interpret the result.
I have 3 questions to start with please.
- What is difference between single and rayon? Why the benchmark run both?
- What is the threshold to conclude the prove is too slow?
- Can we calculate the max plot size based on the result below? How?
PS H:\> .\subspace-farmer3g_9Nov benchmark prove D:\1
Benchmarking prove/plot/single
Benchmarking prove/plot/single: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 40.9s.
Benchmarking prove/plot/single: Collecting 10 samples in estimated 40.889 s (10 iterations)
Benchmarking prove/plot/single: Analyzing
prove/plot/single time: [3.2969 s 3.6483 s 3.9463 s]
change: [-18.980% -9.4513% -2.0186%] (p = 0.03 < 0.05)
Performance has improved.
Benchmarking prove/plot/rayon
Benchmarking prove/plot/rayon: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 5.2s.
Benchmarking prove/plot/rayon: Collecting 10 samples in estimated 5.1903 s (10 iterations)
Benchmarking prove/plot/rayon: Analyzing
prove/plot/rayon time: [485.30 ms 519.64 ms 552.07 ms]
change: [-18.094% -11.037% -4.7907%] (p = 0.00 < 0.05)
Performance has improved.