Tobi and me have been working on a new suite of benchmarks for pike. The main reasons to use that instead of Tools.Shoot is to make it easier to compare different pike versions. It currently contains (modified) versions of all benchmarks from Tools.Shoot. They have been changed to better test what they were intended to test.
Other things:
* reduce the variance of test results and also diaplay their standard deviation to make comparisons possible * encourage people (also non pike developers) to add/send their benchmarks * make it easier to store benchmark runs and add tools to compare them
In the long term it would be nice to integrate this and run it from xenofarm to automatically track performance during development.
The repository name is 'pike-benchmark' and it is hosted on the same server as the pike git. everyone who has access to the pike git, can also access the 'pike-benchmark'. Feels free to add tests.
Arne