Skip to content

Commit db5e99c

Browse files
committed
[bugfix] fix embed infer (#5410)
1 parent 98a93ab commit db5e99c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

swift/llm/infer/infer_engine/sglang_engine.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -198,7 +198,7 @@ async def infer_async(self,
198198
else:
199199
return await self._infer_full_async(**kwargs)
200200

201-
async def _infer_embedding_async(self, template: Template, inputs: Dict[str, Any]) -> EmbeddingResponse:
201+
async def _infer_embedding_async(self, template: Template, inputs: Dict[str, Any], **kwargs) -> EmbeddingResponse:
202202
from sglang.srt.managers.io_struct import EmbeddingReqInput
203203
obj = EmbeddingReqInput(
204204
input_ids=inputs['input_ids'], image_data=inputs.get('images'), audio_data=inputs.get('audios'))

0 commit comments

Comments
 (0)