Performance Try Bots

Summary

Telemetry now supports sending a job directly to the performance try bots.

There are python scripts for automating the process of building, and testing commits against tip of tree and comparing performance. The performance try bots have been built on top of the bisect bot architecture. The bot works by syncing to the specified revision, applying your patch, building Chrome, and running the performance test. It then reverts your patch, builds again, and runs the performance test a second time. Results are output on the waterfall, as well as uploaded to cloud storage.

Supported Platforms

You can list the supported trybots by passing the --browser=list argument to tools/perf/run_benchmark. Here is the current output:

$ tools/perf/run_benchmark --browser=list

Available browsers:

...

trybot-android-gn

trybot-android-nexus10

trybot-android-nexus4

trybot-android-nexus7

trybot-linux

trybot-mac

trybot-mac-10-9

trybot-win

trybot-win-8

trybot-win-xp

Starting a perf try job

From your src/ directory, run tools/perf/run_benchmark, passing in --browser=trybot-you-want. This will take all your command-line arguments, and pass them into the command that runs on the perf trybot. Examples: