[Cosmos] Hybrid Search query pipeline#38275
Merged
simorenoh merged 39 commits intoAzure:mainfrom Nov 19, 2024
Merged
Conversation
Collaborator
|
API change check API changes are not detected in this pull request. |
annatisch
reviewed
Nov 14, 2024
Co-authored-by: Anna Tisch <antisch@microsoft.com>
FabianMeiswinkel
requested changes
Nov 15, 2024
xinlian12
approved these changes
Nov 18, 2024
Member
|
LGTM Thanks |
l0lawrence
pushed a commit
to l0lawrence/azure-sdk-for-python
that referenced
this pull request
Feb 19, 2025
* Create hybrid_search_aggregator.py * others * Update execution_dispatcher.py * Update execution_dispatcher.py * sync changes, need to look at vector + FTS/ skip + take * async pipeline * account for skip/take and simplify logics * small hack for now * fixing top/limit logic * return only payload * fix hack * pylint * simplifying further * small changes * adds readme, buffer limit, simplifies * simplify async, CI green * Update hybrid_search_aggregator.py * Update sdk/cosmos/azure-cosmos/README.md Co-authored-by: Anna Tisch <antisch@microsoft.com> * update variable name * add sync and async tests * Update README.md * simplifications, test fixes * add wrong query tests * pylint/cspell * Update CHANGELOG.md * small changes * test updates * Update hybrid_search_data.py * cspell, samples * change tops * address comments * Update hybrid_search_aggregator.py * update pipeline description * Update CHANGELOG.md * Update CHANGELOG.md --------- Co-authored-by: Anna Tisch <antisch@microsoft.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds support for performing full text search queries through the introduction of the hybrid search query pipeline. This consists of the newly added
hybrid_search_aggregator, which performs the necessary query steps to obtain the needed results.With these changes, the SDK can now interpret queries utilizing key functions like
FullTextContains(),FullTextContainsAll(),FullTextContainsAny(),Order By Rank <FullTextFunction>(), andOrder By Rank RRF().The design doc for the implementation can be found here: Hybrid Search Doc.
The new README in this PR also has additional information.
Still missing in this PR at the moment: