Paul Jones, who is obsessed (is that the right word?) with keeping benchamrks on recent versions of several popular PHP frameworks, has posted another look at a slight change in his testing method - a move away from the Apache ab tool and towards seige (a product of JoeDog Software).

It turns out that the siege tool from JoeDog Software is more accurate in reporting static HTML and PHP responsiveness. This is confirmed through Paul Reinheimer as well, who reported the expected responsiveness on other systems.

The over-reporting from ab means that all my previous reporting on benchmarks is skewed too low when comparing framework responsiveness to PHP’s maximum responsiveness. As such, I have re-run all the previously published benchmarks using siege instead of ab.

Included in this new post are the "more correct" numbers as produced by siege. His baselines turned out a bit more rational and the statistics of the frameworks seemed to jump a bit because of it, but the percentages in comparing between the frameworks is still about the same.