rustc-perf improvements

[nikomatsakis]

Metadata
Point of contact	@davidtwco
Team(s)	compiler, infra
Goal document	2025h1/perf-improvements

Summary

Add support to rustc-perf for distributed benchmarking across multiple platforms and configuration.

Tasks and status

• Discussion and moral support (infra )
• Improve rustc-perf implementation work (@Jamesbarford, @Kobzol)
• Standard reviews (infra )
• Deploy to production (infra )
• Draft performance regression policy (@davidtwco)
• Policy decision (compiler )
• Inside Rust blog post announcing improvements (@davidtwco)

[nikomatsakis]

This issue is intended for status updates only.

For general questions or comments, please contact the owner(s) directly.

[davidtwco]

An initial update on what we've been up to and some background:

• This goal is submitted on behalf of the Rust team at Arm, but primarily worked on by @Jamesbarford. Anyone interested can always contact me for updates and I'll keep this issue up-to-date.
• We've scheduled a regular call with @Kobzol to discuss the constraints and requirements of any changes to rust-perf (see the t-infra calendar) and have drafted a document describing a proposed high-level architecture for the service following our changes.
  • This has been shared in the #project-goals/2025h1/rustc-perf-improvements Zulip channel to collect feedback.
  • Once we've reached an agreement on the high-level architecture, we'll prepare a more detailed plan with details like proposed changes to the database schema, before proceeding with the implementation.

[davidtwco]

A small update, @Jamesbarford aligned with @Kobzol on a high-level architecture and will begin fleshing out the details and making some small patches to rustc-perf to gain familiarity with the codebase.

[davidtwco]

• @Jamesbarford has been working with @Kobzol to implement a database-backed job queueing mechanism, which will better scale to support multiple collectors and ends up being the key part of rustc-perf needing adapted to support multiple collectors.
• @Jamesbarford has also upstreamed tests for the existing queue ordering (tests - ordering of the queue rustc-perf#2072).

[davidtwco]

• @Jamesbarford has added the ability to write tests against the database to rustc-perf (Infra - wire up database for test rustc-perf#2119)
• @Jamesbarford has started to submit parts of Feat - implement queue rustc-perf#2081 in smaller chunks, with review feedback addressed, starting with feat - database schema & enqueue/dequeue logic rustc-perf#2134 (originally feat - database schema & enqueue/dequeue logic rustc-perf#2096)
• @Jamesbarford has prepared a HackMD describing the design considerations involved in making rustc-perf support multiple collectors.