I'not getting a lot of answers on this ;-) so I'll attempt to explain what my ideas are.
Eventually, I went for iozone as a benchmarking tool, mainly because of the overwhelming amount of information it provides.
IMHO, if one tries to find statistically significant data, one run of a benchmark is not enough, so I wrote a little shell script to run iozone 10 times and write the output to 10 logfiles.
Then, I wrote another script (this one in Python) to add up all the values for each cell in the matrices. The highest and lowest value for each cell are discarded in order to prevent anomalies distorting reality ;-)
For each cell, I take the average value of the eight remaining values. I copied the resulting matrix into OpenOffice.org Calc.
I did this procedure for a 'baseline' (in my case: a ext3 filesystem mounted with default options) and then repeated it for my tests.
Per test, I copied the matrix of the result into the spreadsheet where I had the baseline stored. In Calc, I did my comparison and plotted the results in diagrams.
发布评论
评论（1）
我对此没有得到很多答案;-)所以我将尝试解释我的想法。
最终，我选择 iozone 作为基准测试工具，主要是因为它提供了大量的信息。
恕我直言，如果试图找到具有统计意义的数据，运行一次基准测试是不够的，所以我编写了一个小 shell 脚本来运行 iozone 10 次并将输出写入 10 个日志文件。
然后，我编写了另一个脚本（Python 中的脚本）来将矩阵中每个单元格的所有值相加。 每个单元格的最高和最低值被丢弃，以防止异常扭曲现实；-)
对于每个单元格，我取八个剩余值的平均值。 我将生成的矩阵复制到 OpenOffice.org Calc 中。
我为“基线”执行了此过程（在我的例子中：使用默认选项安装的 ext3 文件系统），然后在测试中重复此过程。
每次测试，我将结果矩阵复制到存储基线的电子表格中。 在 Calc 中，我进行了比较并将结果绘制在图表中。
效果很好。
I'not getting a lot of answers on this ;-) so I'll attempt to explain what my ideas are.
Eventually, I went for iozone as a benchmarking tool, mainly because of the overwhelming amount of information it provides.
IMHO, if one tries to find statistically significant data, one run of a benchmark is not enough, so I wrote a little shell script to run iozone 10 times and write the output to 10 logfiles.
Then, I wrote another script (this one in Python) to add up all the values for each cell in the matrices. The highest and lowest value for each cell are discarded in order to prevent anomalies distorting reality ;-)
For each cell, I take the average value of the eight remaining values. I copied the resulting matrix into OpenOffice.org Calc.
I did this procedure for a 'baseline' (in my case: a ext3 filesystem mounted with default options) and then repeated it for my tests.
Per test, I copied the matrix of the result into the spreadsheet where I had the baseline stored. In Calc, I did my comparison and plotted the results in diagrams.
Works pretty well.