I have some tools for clusterized benchmarks that rely on the Shoot.pmod "raw" output format - but that's probably untouched?
No, sorry, the raw output and API is totally different.
Specifically:
Pike v7.9 release 11 running Hilfe v3.5 (Incremental Pike Frontend)
Tools.Shoot.run_sub( Tools.Shoot["MatrixMult"](), 3, 0.0 );
Compiler Warning: 1: Returning a void expression. Converted to zero. {"readable":"2.22 GF/s","n_over_time":2218219278,"n":6800000000,"loops":33,"time":3.065522} (1) Result: 0
So... The individual tests output JSON, and starting them is done differently.
Additionally, the actual 'n' and other fields are drastically different for most tests, they now tend to reflect the number of whatever the test is doing, and not the number of top-level loops.
As an example, the matrix multiply returns the number of flops.