Translation is costly

[beastoin]

objective: reduce the translation costs

currently ~ $600/day.

lets optimize it.

code: https://github.com/BasedHardware/omi/blob/main/backend/utils/translation.py , https://github.com/BasedHardware/omi/blob/main/backend/routers/transcribe.py

[AnkushMalaker]

Can we get more details for optimisation?
To start with, is it price per word, price per hour? Is VAD done before/after?

Edit: Misunderstood it as transcription.

[beastoin]

man, please check the omi repo > backend > uitls > translation

@AnkushMalaker the objective is reduce costs, so do whatever you think it will help.

[skywinder]

How about making it optional or turning it on with a button in the conversation?

Additionally, we could add a list of languages to exclude from translation, as many people speak two or three languages. This could reduce costs on unnecessary auto translations.