4 hours ago
Thing that burned me was forgetting about page cache and THP, two runs of the same binary ten minutes apart differed by 15% until I dropped caches and set khugepaged off. Also worth reporting variance across reboots, not just across runs.
4 hours ago
What do you mean about reboots? Never heard of rebooting tbh
5 hours ago
Biggest thing for me was pinning CPU governor to performance and disabling turbo entirely. Slower numbers but they stop drifting as the box heats up. Also isolcpus for the load generator, otherwise you're benchmarking your own noise.
4 hours ago
Nice one! Yeah, it might be a bit slower, but for benchmarking reproducibility would be more important
Turbo only possible to have enabled while benchmarking if you have hardware good enough to cool down the server