Any way to speed up gpt-oss 20b? #9904
Unanswered
yeolsongarak
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have been using the brand new gpt-oss 20b for translating from English to Spanish. Normally, it's quite heavy on resourced but when I use it with Subtitle Edit (via ollama), it doesn't seem to be using most of my GPU (average 30-50% usage, I got an RTX 3060 12 GB, 32 GB RAM).
I tried tweaking the advanced settings (server calls) without much change (from 4000 to 12000).
Beta Was this translation helpful? Give feedback.
All reactions