vLLM + TIS needs logprobs_mode = processed_logprobs?

[rawsh]

https://github.com/vllm-project/vllm/blob/4fdd6f5cbf877de7c4de33086fe41bb0ac1d3cf3/docs/usage/v1_guide.md?plain=1#L162

there appears to be a mismatch, trainer logprobs are after temperature scaling while vllm logprobs are before by default.

In 0.10+ there is logprobs_mode kwarg that can be set to processed_logprobs. (note: this is only an issue when temperature != 1)

[rawsh]

Hmm actually it looks like this config option is not respected at all 😞 Looks like it will be in v0.10.2rc2 (?)
vllm-project/vllm#22387