openrunners

Changelog

Each measured run, each correction and each site change, newest first. Vendors can ask for a re-run or send a correction: see evaluations.

As data: changelog.json.

  1. site

    Added the evaluations page (how a vendor is measured, and how to ask for a re-run or a correction) and this changelog. Added a Markdown copy of each page, a sitemap with last-modified dates, a schema.org Dataset description of the benchmark data, and a Last measured date on every measured table.

    Evaluations · Changelog JSON

  2. run

    Measured Ubicloud standard runners (premium routing off) at 2, 4 and 8 vCPU on the same two jobs, starting 15:23 UTC, about ten hours after the GitHub and Sengi rounds. 32 runs including two GitHub warmup runs. Published in the measured ranking with the raw runs.

    Raw runs · Measured ranking

  3. run

    Measured GitHub-hosted (2 vCPU), Sengi Basic and Sengi Premium (2, 4 and 8 vCPU) on two jobs, a server test shard and a typecheck, starting 05:38 UTC. Five scored runs each. 72 runs including two GitHub warmup runs, which are left out of the medians. Published in the measured ranking with the raw runs.

    Raw runs · Measured ranking

  4. site

    Published the open-source runner catalog, the open-source project sweep with a listing request form, and the cheapest hosted runner answer. Dropped the GitHub self-hosted fee column. As of 10 November 2026, GitHub had postponed that charge.

    Catalog · Projects · Best runner

  5. site

    Published the benchmark at list prices, the quick start and the waitlist.

    Benchmark · Quick start