The Ghost in the Machine: Don’t Let It Haunt Your Software Performance Measurement

The Ghost in the Machine: Don’t Let It Haunt Your Software Performance Measurement

This paper describes pitfalls, issues, and methodology for measuring software performance, and urges the reader to measure the right performance the right way.

This paper describes pitfalls, issues, and methodology for measuring software performance. Ideally, measurement should be performed and reported in such a way that others will be able to reproduce the results in order to confirm their validity. We aim to motivate scientists to apply the necessary rigor to the design and execution of their software performance measurements to achieve reliable results. Repeatability of experiments, comparability of reported results, and verifiability of claims that are based on such results can be achieved only when measurements and reporting procedures can be trusted. In short, this paper urges the reader to measure the right performance and to measure the performance right.

The attached zip file includes:

• Intro Page.pdf
• Terms and Conditions.pdf
• GhostInMachineSoftware.pdf