[FEA] Set up regression benchmark

[lowener]

Automatic runs of benchmarks should be set up to spot regressions more quickly.
Nightly or Weekly