Hello everyone, Im currently working on a hybrid search implementation and one of the requirements is pagination. After looking into the documentation seems likes there’s no way to do it yet. Is there any workaround or suggestion you can make to solve this problem?
Skip to main content
8 days later
Hi @Francisco_Gonzalez_Jara! Thank you for posting, and sorry for the delay in responding.
I am assuming you are following along with the hybrid search tutorial here. May I ask what limit value you are planning on using within your $vectorSearch stage? We have seen <30ms latency for rather large limits (500+) for pure vector search, even against reasonably large datasets (100k-1M vectors) so I suspect that pagination might not strictly necessary. I want to get a better understanding for your anticipated query pattern first before I provide any suggestions.
Hi @Henry_Weller thanks for replying. Within the vector search stage we are planning to use a limit around and 100 to 150 . Sadly pagination is a strong requirement that I have for the hybrid search responses even if the latency is not a problem. Currently, we are trying to find workarounds like paginate the full response after get all the documents at the same time.
15 days later
Hi Francisco,
You could look at how to use pagination on the $search stage.
yeah I reviewed the documentation, but if im not wrong that would only apply for the fulltext search part of the pipe. Or am I wrong?
New & Unread Topics
| Topic | Replies | Views | Activity |
|---|---|---|---|
| Vector Search in advanced data | 1 | 621 | Apr 2024 |
| Llama index mongodb filters support for multiple values for a key | 3 | 950 | Aug 2024 |
| Unable to configure metadata fields within mongodb vector store’s vector index when connecting to a AWS Bedrock knowledge base | 0 | 422 | Jun 2024 |
| Help with query for large ammounts of data. | 0 | 42 | Sep 2024 |
| Is someone else is also having the Issue Connecting to MongoDB Atlas Cluste while performing retrieval in rag | 2 | 26 | Jan 22 |