forked from vllm-project/vllm
-
Notifications
You must be signed in to change notification settings - Fork 134
Add bucket and padding for Ovis #1940
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
Jianhong-Zhang
wants to merge
15
commits into
HabanaAI:habana_main
Choose a base branch
from
Jianhong-Zhang:ovis-padding
base: habana_main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Fix the error for cpu fallback
Change ovis min/max prompt bucket
8201c51
to
2fabbb1
Compare
Merged
yeonsily
added a commit
that referenced
this pull request
Oct 1, 2025
From #1940 --------- Co-authored-by: Christopher Manteuffel <[email protected]> Co-authored-by: Jianhong-Zhang <[email protected]>
This pr is depending on HabanaAI#1873
19db319
to
b35706d
Compare
b35706d
to
35d6536
Compare
SupreetSinghPalne
pushed a commit
that referenced
this pull request
Oct 9, 2025
From #1940 --------- Co-authored-by: Christopher Manteuffel <[email protected]> Co-authored-by: Jianhong-Zhang <[email protected]>
SupreetSinghPalne
pushed a commit
that referenced
this pull request
Oct 16, 2025
From #1940 --------- Co-authored-by: Christopher Manteuffel <[email protected]> Co-authored-by: Jianhong-Zhang <[email protected]>
SupreetSinghPalne
pushed a commit
that referenced
this pull request
Oct 16, 2025
From #1940 --------- Co-authored-by: Christopher Manteuffel <[email protected]> Co-authored-by: Jianhong-Zhang <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pr is depending on #1873