Operation tool

[0SlowPoke0]

Closes #

[github-actions]

Performance Benchmark Results

🔧 Graph Compilation

compile_demo_art_iai::compile_group::compile_to_proto with_setup_0:load_from_name(isometric-fountain)
Instructions: 22,907,584 (master) → 27,729,061 (HEAD) : $$\color{red}+21.05\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     287,862|    356,302         +23.78%
D1mw                      79,275|    118,802         +49.86%
DLmr                      28,573|     37,418         +30.96%
DLmw                      42,143|     53,573         +27.12%
Dr                     5,686,132|  6,727,491         +18.31%
Dw                     3,956,663|  4,755,692         +20.19%
EstimatedCycles       36,392,455| 44,078,388         +21.12%
I1mr                      56,757|     52,482          -7.53%
ILmr                         834|        869          +4.20%
Ir                    22,907,584| 27,729,061         +21.05%
L1hits                32,126,485| 38,684,658         +20.41%
LLhits                   352,344|    435,726         +23.66%
RamHits                   71,550|     91,860         +28.39%
TotalRW               32,550,379| 39,212,244         +20.47%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_1:load_from_name(painted-dreams)
Instructions: 12,179,519 (master) → 14,893,523 (HEAD) : $$\color{red}+22.28\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     146,503|    184,309         +25.81%
D1mw                      41,629|     62,400         +49.90%
DLmr                         696|      1,596        +129.31%
DLmw                      14,051|     17,321         +23.27%
Dr                     3,009,783|  3,583,555         +19.06%
Dw                     2,094,122|  2,534,288         +21.02%
EstimatedCycles       18,610,874| 22,689,340         +21.91%
I1mr                      27,983|     25,357          -9.38%
ILmr                         686|        740          +7.87%
Ir                    12,179,519| 14,893,523         +22.28%
L1hits                17,067,309| 20,739,300         +21.51%
LLhits                   200,682|    252,409         +25.78%
RamHits                   15,433|     19,657         +27.37%
TotalRW               17,283,424| 21,011,366         +21.57%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_2:load_from_name(procedural-string-lights)
Instructions: 2,596,571 (master) → 3,131,908 (HEAD) : $$\color{red}+20.62\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                      30,961|     37,800         +22.09%
D1mw                       7,836|     11,812         +50.74%
DLmr                          15|         20         +33.33%
DLmw                       2,807|      3,236         +15.28%
Dr                       634,925|    750,369         +18.18%
Dw                       441,847|    529,689         +19.88%
EstimatedCycles        3,956,117|  4,751,282         +20.10%
I1mr                       5,729|      5,427          -5.27%
ILmr                         667|        716          +7.35%
Ir                     2,596,571|  3,131,908         +20.62%
L1hits                 3,628,817|  4,356,927         +20.06%
LLhits                    41,037|     51,067         +24.44%
RamHits                    3,489|      3,972         +13.84%
TotalRW                3,673,343|  4,411,966         +20.11%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_3:load_from_name(parametric-dunescape)
Instructions: 12,307,737 (master) → 14,969,129 (HEAD) : $$\color{red}+21.62\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     160,656|    196,357         +22.22%
D1mw                      44,776|     68,240         +52.40%
DLmr                          81|        135         +66.67%
DLmw                      14,782|     14,568          -1.45%
Dr                     3,012,170|  3,600,805         +19.54%
Dw                     2,119,905|  2,572,477         +21.35%
EstimatedCycles       18,819,222| 22,749,783         +20.89%
I1mr                      22,068|     20,546          -6.90%
ILmr                         784|        857          +9.31%
Ir                    12,307,737| 14,969,129         +21.62%
L1hits                17,212,312| 20,857,268         +21.18%
LLhits                   211,853|    269,583         +27.25%
RamHits                   15,647|     15,560          -0.56%
TotalRW               17,439,812| 21,142,411         +21.23%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_4:load_from_name(red-dress)
Instructions: 27,609,611 (master) → 33,720,412 (HEAD) : $$\color{red}+22.13\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     348,406|    435,341         +24.95%
D1mw                      93,021|    140,648         +51.20%
DLmr                      42,555|     53,068         +24.70%
DLmw                      61,169|     60,860          -0.51%
Dr                     6,824,583|  8,122,107         +19.01%
Dw                     4,753,281|  5,754,614         +21.07%
EstimatedCycles       44,341,537| 53,575,675         +20.83%
I1mr                      63,016|     57,669          -8.49%
ILmr                         819|        869          +6.11%
Ir                    27,609,611| 33,720,412         +22.13%
L1hits                38,683,032| 46,963,475         +21.41%
LLhits                   399,900|    518,861         +29.75%
RamHits                  104,543|    114,797          +9.81%
TotalRW               39,187,475| 47,597,133         +21.46%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_5:load_from_name(valley-of-spires)
Instructions: 17,589,534 (master) → 21,406,461 (HEAD) : $$\color{red}+21.70\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     215,401|    269,670         +25.19%
D1mw                      55,203|     84,954         +53.89%
DLmr                      13,857|     19,697         +42.14%
DLmw                      29,597|     33,857         +14.39%
Dr                     4,369,475|  5,185,217         +18.67%
Dw                     3,034,984|  3,662,353         +20.67%
EstimatedCycles       27,573,659| 33,460,981         +21.35%
I1mr                      42,670|     39,331          -7.83%
ILmr                         765|        817          +6.80%
Ir                    17,589,534| 21,406,461         +21.70%
L1hits                24,680,719| 29,860,076         +20.99%
LLhits                   269,055|    339,584         +26.21%
RamHits                   44,219|     54,371         +22.96%
TotalRW               24,993,993| 30,254,031         +21.05%

---

🔄 Executor Update

update_executor_iai::update_group::update_executor with_setup_0:setup_update_executor(isometric-fountain)
Instructions: 41,147,967 (master) → 42,002,329 (HEAD) : $$\color{red}+2.08\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     452,565|    475,985          +5.17%
D1mw                      98,213|    106,992          +8.94%
DLmr                       7,865|     18,855        +139.73%
DLmw                      28,371|     23,999         -15.41%
Dr                    10,446,976| 10,659,442          +2.03%
Dw                     7,063,216|  7,218,261          +2.20%
EstimatedCycles       62,096,001| 63,643,058          +2.49%
I1mr                      35,165|     34,522          -1.83%
ILmr                         233|        247          +6.01%
Ir                    41,147,967| 42,002,329          +2.08%
L1hits                58,072,216| 59,262,533          +2.05%
LLhits                   549,474|    574,398          +4.54%
RamHits                   36,469|     43,101         +18.19%
TotalRW               58,658,159| 59,880,032          +2.08%

update_executor_iai::update_group::update_executor with_setup_1:setup_update_executor(painted-dreams)
Instructions: 22,785,118 (master) → 23,081,259 (HEAD) : $$\color{red}+1.30\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     238,273|    243,370          +2.14%
D1mw                      52,554|     55,514          +5.63%
DLmr                       1,025|        421         -58.93%
DLmw                      11,327|      8,504         -24.92%
Dr                     5,746,746|  5,820,261          +1.28%
Dw                     3,907,483|  3,957,989          +1.29%
EstimatedCycles       34,066,303| 34,394,985          +0.96%
I1mr                      21,727|     16,660         -23.32%
ILmr                         206|        185         -10.19%
Ir                    22,785,118| 23,081,259          +1.30%
L1hits                32,126,793| 32,543,965          +1.30%
LLhits                   299,996|    306,434          +2.15%
RamHits                   12,558|      9,110         -27.46%
TotalRW               32,439,347| 32,859,509          +1.30%

update_executor_iai::update_group::update_executor with_setup_2:setup_update_executor(procedural-string-lights)
Instructions: 4,733,916 (master) → 4,860,194 (HEAD) : $$\color{red}+2.67\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                      45,251|     48,348          +6.84%
D1mw                      11,401|     12,703         +11.42%
DLmr                           2|          0        -100.00%
DLmw                         586|        756         +29.01%
Dr                     1,191,141|  1,221,448          +2.54%
Dw                       810,207|    831,823          +2.67%
EstimatedCycles        7,006,536|  7,210,203          +2.91%
I1mr                       5,241|      6,166         +17.65%
ILmr                         202|        173         -14.36%
Ir                     4,733,916|  4,860,194          +2.67%
L1hits                 6,673,371|  6,846,248          +2.59%
LLhits                    61,103|     66,288          +8.49%
RamHits                      790|        929         +17.59%
TotalRW                6,735,264|  6,913,465          +2.65%

update_executor_iai::update_group::update_executor with_setup_3:setup_update_executor(parametric-dunescape)
Instructions: 18,948,091 (master) → 18,963,367 (HEAD) : $$\color{red}+0.08\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     186,718|    186,465          -0.14%
D1mw                      46,548|     47,509          +2.06%
DLmr                         146|         30         -79.45%
DLmw                       6,687|      4,515         -32.48%
Dr                     4,732,774|  4,760,514          +0.59%
Dw                     3,247,856|  3,278,373          +0.94%
EstimatedCycles       28,130,851| 28,128,568          -0.01%
I1mr                      14,639|     12,122         -17.19%
ILmr                         184|        186          +1.09%
Ir                    18,948,091| 18,963,367          +0.08%
L1hits                26,680,816| 26,756,158          +0.28%
LLhits                   240,888|    241,365          +0.20%
RamHits                    7,017|      4,731         -32.58%
TotalRW               26,928,721| 27,002,254          +0.27%

update_executor_iai::update_group::update_executor with_setup_4:setup_update_executor(red-dress)
Instructions: 51,136,009 (master) → 51,950,392 (HEAD) : $$\color{red}+1.59\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     546,574|    574,627          +5.13%
D1mw                     124,915|    134,697          +7.83%
DLmr                      17,934|     34,022         +89.71%
DLmw                      46,857|     45,674          -2.52%
Dr                    13,106,293| 13,319,126          +1.62%
Dw                     8,980,047|  9,128,318          +1.65%
EstimatedCycles       78,018,295| 79,789,646          +2.27%
I1mr                      39,495|     37,586          -4.83%
ILmr                         276|        443         +60.51%
Ir                    51,136,009| 51,950,392          +1.59%
L1hits                72,511,365| 73,650,926          +1.57%
LLhits                   645,917|    666,771          +3.23%
RamHits                   65,067|     80,139         +23.16%
TotalRW               73,222,349| 74,397,836          +1.61%

update_executor_iai::update_group::update_executor with_setup_5:setup_update_executor(valley-of-spires)
Instructions: 32,769,161 (master) → 33,388,786 (HEAD) : $$\color{red}+1.89\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     360,528|    377,074          +4.59%
D1mw                      78,421|     87,017         +10.96%
DLmr                       3,831|      9,269        +141.95%
DLmw                      20,398|     19,063          -6.54%
Dr                     8,333,086|  8,465,414          +1.59%
Dw                     5,652,630|  5,742,936          +1.60%
EstimatedCycles       49,353,531| 50,412,902          +2.15%
I1mr                      27,362|     25,853          -5.51%
ILmr                         218|        201          -7.80%
Ir                    32,769,161| 33,388,786          +1.89%
L1hits                46,288,566| 47,107,192          +1.77%
LLhits                   441,864|    461,411          +4.42%
RamHits                   24,447|     28,533         +16.71%
TotalRW               46,754,877| 47,597,136          +1.80%

---

🚀 Render: Cold Execution

run_once_iai::run_once_group::run_once with_setup_0:setup_run_once(isometric-fountain)
Instructions: 20,721,867 (master) → 20,639,885 (HEAD) : $$\color{lime}-0.40\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     235,911|    235,651          -0.11%
D1mw                      50,205|     50,552          +0.69%
DLmr                       8,543|      3,418         -59.99%
DLmw                      15,421|     13,436         -12.87%
Dr                     5,278,452|  5,251,683          -0.51%
Dw                     3,528,769|  3,521,630          -0.20%
EstimatedCycles       31,994,418| 31,654,470          -1.06%
I1mr                     114,674|    111,980          -2.35%
ILmr                       4,775|      4,764          -0.23%
Ir                    20,721,867| 20,639,885          -0.40%
L1hits                29,128,298| 29,015,015          -0.39%
LLhits                   372,051|    376,565          +1.21%
RamHits                   28,739|     21,618         -24.78%
TotalRW               29,529,088| 29,413,198          -0.39%

run_once_iai::run_once_group::run_once with_setup_1:setup_run_once(painted-dreams)
Instructions: 76,717,903 (master) → 76,768,272 (HEAD) : $$\color{red}+0.07\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     386,063|    385,072          -0.26%
D1mw                     179,899|    181,394          +0.83%
DLmr                       5,104|      4,681          -8.29%
DLmw                      47,292|     53,790         +13.74%
Dr                    18,111,060| 18,175,610          +0.36%
Dw                    12,129,142| 12,200,199          +0.59%
EstimatedCycles      111,622,129|111,989,211          +0.33%
I1mr                     154,274|    154,189          -0.06%
ILmr                       7,040|      6,946          -1.34%
Ir                    76,717,903| 76,768,272          +0.07%
L1hits               106,237,869|106,423,426          +0.17%
LLhits                   660,800|    655,238          -0.84%
RamHits                   59,436|     65,417         +10.06%
TotalRW              106,958,105|107,144,081          +0.17%

run_once_iai::run_once_group::run_once with_setup_2:setup_run_once(procedural-string-lights)
Instructions: 9,743,636 (master) → 9,662,633 (HEAD) : $$\color{lime}-0.83\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                      44,214|     41,868          -5.31%
D1mw                      16,405|     17,205          +4.88%
DLmr                         235|        234          -0.43%
DLmw                       3,476|      3,993         +14.87%
Dr                     2,231,872|  2,228,020          -0.17%
Dw                     1,545,248|  1,556,435          +0.72%
EstimatedCycles       14,135,396| 14,057,212          -0.55%
I1mr                      34,511|     32,063          -7.09%
ILmr                       4,093|      3,959          -3.27%
Ir                     9,743,636|  9,662,633          -0.83%
L1hits                13,425,626| 13,355,952          -0.52%
LLhits                    87,326|     82,950          -5.01%
RamHits                    7,804|      8,186          +4.89%
TotalRW               13,520,756| 13,447,088          -0.54%

run_once_iai::run_once_group::run_once with_setup_3:setup_run_once(parametric-dunescape)
Instructions: 26,335,477 (master) → 26,370,488 (HEAD) : $$\color{red}+0.13\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     121,243|    118,912          -1.92%
D1mw                      50,789|     52,262          +2.90%
DLmr                       1,607|        532         -66.89%
DLmw                      10,408|      8,605         -17.32%
Dr                     5,862,367|  5,882,655          +0.35%
Dw                     3,492,502|  3,516,988          +0.70%
EstimatedCycles       37,085,758| 37,078,329          -0.02%
I1mr                      61,981|     62,688          +1.14%
ILmr                       3,297|      3,288          -0.27%
Ir                    26,335,477| 26,370,488          +0.13%
L1hits                35,456,333| 35,536,269          +0.23%
LLhits                   218,701|    221,437          +1.25%
RamHits                   15,312|     12,425         -18.85%
TotalRW               35,690,346| 35,770,131          +0.22%

run_once_iai::run_once_group::run_once with_setup_4:setup_run_once(red-dress)
Instructions: 1,884,670,026 (master) → 1,884,278,040 (HEAD) : $$\color{lime}-0.02\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                   1,516,091|  1,517,989          +0.13%
D1mw                     689,649|    691,534          +0.27%
DLmr                     320,325|    314,122          -1.94%
DLmw                     456,729|    425,061          -6.93%
Dr                   437,482,680|436,984,756          -0.11%
Dw                   279,310,107|278,763,205          -0.20%
EstimatedCycles      2,636,699,601|2,633,716,095          -0.11%
I1mr                     737,287|    631,208         -14.39%
ILmr                       5,102|      5,056          -0.90%
Ir                   1,884,670,026|1,884,278,040          -0.02%
L1hits               2,598,519,786|2,597,185,270          -0.05%
LLhits                 2,160,871|  2,096,492          -2.98%
RamHits                  782,156|    744,239          -4.85%
TotalRW              2,601,462,813|2,600,026,001          -0.06%

run_once_iai::run_once_group::run_once with_setup_5:setup_run_once(valley-of-spires)
Instructions: 19,135,242 (master) → 19,036,623 (HEAD) : $$\color{lime}-0.52\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     191,288|    190,372          -0.48%
D1mw                      44,027|     42,589          -3.27%
DLmr                       5,553|        618         -88.87%
DLmw                      12,199|      9,891         -18.92%
Dr                     4,661,175|  4,633,879          -0.59%
Dw                     3,085,438|  3,078,642          -0.22%
EstimatedCycles       28,816,749| 28,446,638          -1.28%
I1mr                      92,476|     89,915          -2.77%
ILmr                       3,039|      3,024          -0.49%
Ir                    19,135,242| 19,036,623          -0.52%
L1hits                26,554,064| 26,426,268          -0.48%
LLhits                   307,000|    309,343          +0.76%
RamHits                   20,791|     13,533         -34.91%
TotalRW               26,881,855| 26,749,144          -0.49%

---

⚡ Render: Cached Execution

run_cached_iai::run_cached_group::run_cached with_setup_0:setup_run_cached(isometric-fountain)
Instructions: 20,829,356 (master) → 20,767,739 (HEAD) : $$\color{lime}-0.30\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     253,382|    252,565          -0.32%
D1mw                      45,262|     45,451          +0.42%
DLmr                       2,129|      2,766         +29.92%
DLmw                         585|        614          +4.96%
Dr                     5,377,169|  5,346,109          -0.58%
Dw                     3,558,767|  3,553,678          -0.14%
EstimatedCycles       31,503,734| 31,409,112          -0.30%
I1mr                     114,464|    111,003          -3.02%
ILmr                         153|        137         -10.46%
Ir                    20,829,356| 20,767,739          -0.30%
L1hits                29,352,184| 29,258,507          -0.32%
LLhits                   410,241|    405,502          -1.16%
RamHits                    2,867|      3,517         +22.67%
TotalRW               29,765,292| 29,667,526          -0.33%

run_cached_iai::run_cached_group::run_cached with_setup_1:setup_run_cached(painted-dreams)
Instructions: 26,369,805 (master) → 26,356,614 (HEAD) : $$\color{lime}-0.05\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     219,907|    214,839          -2.30%
D1mw                      54,528|     54,059          -0.86%
DLmr                         898|      3,660        +307.57%
DLmw                         501|      1,570        +213.37%
Dr                     6,502,626|  6,485,686          -0.26%
Dw                     4,440,336|  4,432,249          -0.18%
EstimatedCycles       38,741,355| 38,778,683          +0.10%
I1mr                      71,057|     66,898          -5.85%
ILmr                         155|        135         -12.90%
Ir                    26,369,805| 26,356,614          -0.05%
L1hits                36,967,275| 36,938,753          -0.08%
LLhits                   343,938|    330,431          -3.93%
RamHits                    1,554|      5,365        +245.24%
TotalRW               37,312,767| 37,274,549          -0.10%

run_cached_iai::run_cached_group::run_cached with_setup_2:setup_run_cached(procedural-string-lights)
Instructions: 9,179,311 (master) → 9,223,570 (HEAD) : $$\color{red}+0.48\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                      47,193|     48,939          +3.70%
D1mw                      15,069|     15,630          +3.72%
DLmr                           9|          5         -44.44%
DLmw                         124|        118          -4.84%
Dr                     2,159,198|  2,187,590          +1.31%
Dw                     1,512,974|  1,544,787          +2.10%
EstimatedCycles       13,237,025| 13,339,123          +0.77%
I1mr                      31,971|     29,380          -8.10%
ILmr                         154|        123         -20.13%
Ir                     9,179,311|  9,223,570          +0.48%
L1hits                12,757,250| 12,861,998          +0.82%
LLhits                    93,946|     93,703          -0.26%
RamHits                      287|        246         -14.29%
TotalRW               12,851,483| 12,955,947          +0.81%

run_cached_iai::run_cached_group::run_cached with_setup_3:setup_run_cached(parametric-dunescape)
Instructions: 16,245,834 (master) → 16,116,732 (HEAD) : $$\color{lime}-0.79\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     105,945|    102,960          -2.82%
D1mw                      37,733|     36,196          -4.07%
DLmr                          43|         11         -74.42%
DLmw                       1,124|        517         -54.00%
Dr                     3,711,520|  3,640,106          -1.92%
Dw                     2,474,247|  2,412,763          -2.48%
EstimatedCycles       23,146,349| 22,848,717          -1.29%
I1mr                      25,394|     25,853          +1.81%
ILmr                         115|        108          -6.09%
Ir                    16,245,834| 16,116,732          -0.79%
L1hits                22,262,529| 22,004,592          -1.16%
LLhits                   167,790|    164,373          -2.04%
RamHits                    1,282|        636         -50.39%
TotalRW               22,431,601| 22,169,601          -1.17%

run_cached_iai::run_cached_group::run_cached with_setup_4:setup_run_cached(red-dress)
Instructions: 280,256,063 (master) → 279,821,187 (HEAD) : $$\color{lime}-0.16\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                   1,426,150|  1,413,504          -0.89%
D1mw                     460,866|    456,876          -0.87%
DLmr                     494,054|    469,914          -4.89%
DLmw                     230,939|    203,583         -11.85%
Dr                    68,177,268| 67,874,386          -0.44%
Dw                    48,999,472| 48,644,415          -0.72%
EstimatedCycles      429,454,047|426,414,552          -0.71%
I1mr                     651,335|    567,266         -12.91%
ILmr                       3,935|      3,969          +0.86%
Ir                   280,256,063|279,821,187          -0.16%
L1hits               394,894,452|393,902,342          -0.25%
LLhits                 1,809,423|  1,760,180          -2.72%
RamHits                  728,928|    677,466          -7.06%
TotalRW              397,432,803|396,339,988          -0.27%

run_cached_iai::run_cached_group::run_cached with_setup_5:setup_run_cached(valley-of-spires)
Instructions: 19,393,660 (master) → 19,313,105 (HEAD) : $$\color{lime}-0.42\%$$

Detailed metrics

Baselines:                master|       HEAD
D1mr                     207,672|    207,176          -0.24%
D1mw                      39,851|     40,125          +0.69%
DLmr                         233|        138         -40.77%
DLmw                       1,032|        940          -8.91%
Dr                     4,778,903|  4,762,300          -0.35%
Dw                     3,129,338|  3,136,122          +0.22%
EstimatedCycles       28,715,251| 28,606,475          -0.38%
I1mr                      95,247|     92,421          -2.97%
ILmr                         144|        124         -13.89%
Ir                    19,393,660| 19,313,105          -0.42%
L1hits                26,959,131| 26,871,805          -0.32%
LLhits                   341,361|    338,520          -0.83%
RamHits                    1,409|      1,202         -14.69%
TotalRW               27,301,901| 27,211,527          -0.33%

[Firestar99]

profiling CI is fixed once #3101 is merged