chore: fix deepseek_model.py stream mode #3326
Conversation
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the ✨ Finishing touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Wendong-Fan
added
Waiting for Update
|
updated cc @Wendong-Fan |
| # Handle reasoning content streaming (for DeepSeek reasoner) | ||
| if ( | ||
| hasattr(delta, 'reasoning_content') | ||
| and delta.reasoning_content | ||
| ): | ||
| content_accumulator.add_reasoning_content( | ||
| delta.reasoning_content | ||
| ) | ||
| # Yield partial response with reasoning content | ||
| partial_response = ( | ||
| self._create_streaming_response_with_accumulator( | ||
| content_accumulator, | ||
| "", # No regular content yet | ||
| step_token_usage, | ||
| getattr(chunk, 'id', ''), | ||
| tool_call_records.copy(), | ||
| reasoning_delta=delta.reasoning_content, | ||
| ) | ||
| ) | ||
| yield partial_response |
There was a problem hiding this comment.
why this part of code added to ChatAgent? it's not a good design to add model specific logic in ChatAgent
There was a problem hiding this comment.
this logic applies to all reasoning models，The comment about deepseek was not deleted before, has been deleted now.
2 participants
Description
Describe your changes in detail (optional if the linked issue already contains a detailed description of the changes).
Checklist
Go over all the following points, and put an
xin all the boxes that apply.Fixes #issue-numberin the PR description (required)pyproject.tomlanduv lockIf you are unsure about any of these, don't hesitate to ask. We are here to help!