In a new post to his blog Padraic Brady takes a humorous look at benchmarking PHP frameworks in a response to some of the other recent posts from developers on the Symfony and Solar frameworks.
Some recent attention in the PHP framework community has been focused on the recent publication of Symfony 2 Preview benchmarks showing that Symfony 2 outperforms Zend Framework by a factor of 3.5. It also outperforms every other benchmarked framework. [...] My fellow Zend Frameworkers, we cannot allow this to stand. [...] I have created the benchmark of benchmarks. Well, to be honest, I only really edited another benchmark. But still, it will prove Zend Framework is faster than everything else out there.
His benchmarks are a little different from the rest with both the usual comparisons between the framework request numbers and a bit of explanation on how the Zend Framework came out on top - he cheated. What it really boiled down to was how the code that was tested was written. His code was optimized in a few different ways (All-in vs the Optimized/More-Optimized/What-The-Fuck-Optimized) and he includes custom benchmarks to show how they differ. What it really boils down to from his perspective is simply put:
Benchmarks. Useless. Final words? Know your framework! All this benchmarking nonsense does little good unless it's plastered with disclaimers.