有关于基准测试的好的学术参考吗?
我正在寻找有关如何对项目进行基准测试的良好学术参考资料。基准测试似乎有很多知识,但我还没有看到很多参考资料来解释什么是好的基准测试、什么是坏的基准测试以及如何编写基准测试。
谢谢。
I am looking for good academic references on how to benchmark programs. There seems to be a lot of lore in benchmarking, but I haven't seen many references that explain what a good benchmark is, what a bad one is, and how to write one.
Thanks.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
从学术上来说,相关的文章是 OOPSLA 2007 的《Statistically strict Java Performancevaluation》(可以从 Google Scholar 找到);虽然重点关注 Java,但它包含有关基准测试的一般课程,并且有关 Java 的内容可以很好地推广到在某些虚拟机上运行并仅使用垃圾收集的大多数语言。最后,他们总结了分析结果所需的统计知识。
此外,这里有一个来自 Google 的框架:
http://code.google.com/p/caliper/< /a>
在这里,他们的 Wiki 讨论了良好基准的一些标准:
http://code.google.com/p/caliper/wiki/JavaMicrobenchmarkReviewCriteria
Academically speaking, a relevant article is "Statistically rigorous Java performance evaluation" from OOPSLA 2007 (which you can find from Google Scholar); while focused on Java, it contains general lessons on benchmarking, and the content about Java generalizes nicely to most languages running on some virtual machine and simply using garbage collection. Finally, they summarize the statistics knowledge needed for analyzing the results.
Additionally, here is a framework from Google:
http://code.google.com/p/caliper/
And here their Wiki discusses some criteria for a good benchmark:
http://code.google.com/p/caliper/wiki/JavaMicrobenchmarkReviewCriteria