-
Notifications
You must be signed in to change notification settings - Fork 515
[Blog] OpenSearch v3 Neural Sparse Models #3918
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: yIwEN0713 <[email protected]>
Thank you for submitting a blog post! The blog post review process is: Submit a PR -> (Optional) Peer review -> Doc review -> Editorial review -> Marketing review -> Published. |
Hi @yIwEN0713, It looks like you're adding a new blog post but don't have an issue mentioned. Please link this PR to an open issue using one of these keywords in the PR description:
If an issue hasn't been created yet, please create one and then link it to this PR. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
pls take a ref at this PR to add your author information. And fix the render problem
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Show resolved
Hide resolved
|
||
## Behind the improvements: Technology highlights | ||
|
||
### $L_0$-based sparsification |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
|
||
Similar to the tests described in our previous blog post, we evaluated the search relevance of the models on BEIR benchmark. The search relevance results are shown in the table below. All v3‑series models outperform their v2 and v1 counterparts, with v3‑gte achieving the highest relevance scores across all tests and setting a new record for OpenSearch neural sparse retrieval models. Notably, v3-gte sets a new state-of-the-art among publicly available sparse models. | ||
|
||
--- |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This table also doesn't get rendered correctly
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Show resolved
Hide resolved
Signed-off-by: yIwEN0713 <[email protected]>
@natebower - Including you for technical review on this blog. |
@pajuric It looks like this one may already be under tech review (also, I'm not able to provide tech reviews). |
Signed-off-by: yIwEN0713 <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. @pajuric I think we're good to move forward to the next review phase
@natebower - Thanks for letting me know. We'll leave this one for Fanit when she returned early next week. |
Signed-off-by: Fanit Kolchina <[email protected]>
Hey @yIwEN0713, doc review complete - nice job! Moving on to editorial review. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Editorial review
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
...ng-search-with-opensearch-v3-neural-sparse-models-and-mulitilingual-retrieval-model.markdown
Outdated
Show resolved
Hide resolved
Signed-off-by: Nathan Bower <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @yIwEN0713! LGTM
@pajuric This should be ready to publish.
|
||
date: 2025-08-25 | ||
meta_keywords: search relevance, neural sparse search, OpenSearch semantic search | ||
meta_description: Enhancing OpenSearch neural sparse models with GTE and LLM teachers. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated meta:
meta_keywords: Neural sparse search, semantic search, OpenSearch sparse retrievers, search relevance, vector search, neural sparse models, GTE architecture, search relevance benchmarks, multilingual sparse retrieval, OpenSearch forum
meta_description: Discover OpenSearch v3's advanced neural sparse models and new multilingual retrieval capabilities, offering improved search relevance while maintaining efficient, inference-free performance
category: | ||
- technical-posts | ||
|
||
date: 2025-08-25 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Publish date: 2025-09-25
Description
Blog about OpenSearch v3 Neural Sparse Models.
Issues Resolved
Resolve #3912
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the BSD-3-Clause License.