Skip to content

feat(litellm): Added Support for responses API in litellm instrumentor #2209

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Oct 6, 2025
Merged

feat(litellm): Added Support for responses API in litellm instrumentor #2209

merged 2 commits into from
Oct 6, 2025

Conversation

satyadevai
Copy link
Collaborator

@satyadevai satyadevai commented Sep 17, 2025 •
edited
Loading

Closes #1752

This PR adds support for the new responses API in the litellm instrumentation.

  • Introduced _responses_wrapper to handle calls to litellm’s responses API.
  • Modified instrumentation to capture attributes from response messages
  • Updated span attributes to include details from response usage (token counts, message metadata).
image image image image image

@satyadevai satyadevai requested a review from a team as a code owner September 17, 2025 18:14
@satyadevai satyadevai marked this pull request as draft September 17, 2025 18:16
@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Sep 17, 2025
cursor[bot]

This comment was marked as outdated.

Sign in to view

@satyadevai satyadevai changed the title feat(litellm): Added Support for responses API feat(litellm): Added Support for responses API in litellm instrumentoor Sep 18, 2025
@satyadevai satyadevai changed the title feat(litellm): Added Support for responses API in litellm instrumentoor feat(litellm): Added Support for responses API in litellm instrumentor Sep 18, 2025
@satyadevai satyadevai marked this pull request as ready for review September 18, 2025 16:27
@dosubot dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. and removed size:L This PR changes 100-499 lines, ignoring generated files. labels Sep 18, 2025
cursor[bot]

This comment was marked as outdated.

Sign in to view

@dosubot dosubot bot added size:XXL This PR changes 1000+ lines, ignoring generated files. and removed size:XL This PR changes 500-999 lines, ignoring generated files. labels Sep 22, 2025
@caroger caroger self-assigned this Oct 2, 2025
@caroger caroger self-requested a review October 2, 2025 16:55
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Oct 6, 2025
@caroger caroger merged commit 1abc662 into Arize-ai:main Oct 6, 2025
13 checks passed
@github-actions github-actions bot mentioned this pull request Oct 6, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cursor cursor[bot] cursor[bot] left review comments

@caroger caroger caroger approved these changes

Assignees

@caroger caroger

Labels
lgtm This PR has been approved by a maintainer size:XXL This PR changes 1000+ lines, ignoring generated files.
Projects
Instrumentation
Status: Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[LiteLLM] Responses
2 participants
@satyadevai @caroger