API Status built into the UX (How busy is GPT?)

[obie]

Sometimes we error out simply due to the API being overloaded. It would be good to have some sort of constant visual indicator in the UX so that the user can set their expectations accordingly. Maybe green-yellow-red light somewhere in the header.