Skip to content

Conversation

jfolz
Copy link

@jfolz jfolz commented Jun 4, 2025

OpenAI's Python library allows adding extra arguments to the request body via the extra_body kwarg. This is useful to, e.g., control thinking modes for Qwen. This PR adds the extra_body field to CreateChatCompletionRequest to accomplish the same.

@64bit
Copy link
Owner

64bit commented Jun 7, 2025

This can be achieved with byot feature:

pub struct CustomCreateChatCompletionRequest {
    #[serde(flatten)]
    pub request: CreateChatCompletionRequest,
    #[serde(flatten)]
    pub extra_body: Option<Map<String, Value>>,
}

@64bit 64bit added out of scope Requests which are not related to OpenAI API and removed out of scope Requests which are not related to OpenAI API labels Jun 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants