How to create one vector search index for multiple collections

ADEEB_Alkahat · 2024-11-18T12:10:58.863Z

I am making an AI assistant (RAG) that answer questions from mongodb atlas database.
the database has many collections but the problem is that i can only create vector search index on one collection but i want to make one for all the database
i searched for a solution and i saw that the only solution is to combine all the database into one collection but i don’t want to replicate the database

Vasu_Navadiya · 2024-11-20T12:42:10.422Z

I am also facing same issue. Is their any other option ? please reply on this.

Henry_Weller · 2024-11-22T18:26:53.028Z

Hi @ADEEB_Alkahat! Thank you for the question.

We are planning on adding support for building search and vector search indexes against views of collections, which may eventually include views built from multiple collections via $lookup.

In the meantime, can you provide more details about the data model? It might be that the best approach is to ensure multiple vector search indexes are built, each against their own collection, with metadata separation occurring via the index naming scheme as shown below:

collection1: vs_index_1,
collection2: v2_index2,
...

Provided you have less than a few hundred indexes you are trying to build, the load on the database produced by the changestream opened by each search index should be manageable.

Alayet_Manel · 2025-01-28T08:29:03.168Z

hey , i am facing the same issue ! is there an update ?
I have 2 collections : cohortes
sante_quebec and each has 2 embeddings so how can i make one / multiple vector searches to retreive my data thanks