Aggregation Pipeline Returning Empty Array

Abdulrahman_almuhajir · 2024-09-25T19:58:07.903Z

Hello everyone,

I am encountering an issue where an aggregation query is returning an empty array, even though I expect it to return matching documents from my collection. Here’s the relevant portion of my code:

if (useShuffle) {
  cards = await Card.aggregate([
    {
      $match: { collectionId: collectionId },
    },
  ]);
}

When running the code, I receive an empty array, even though there are documents with this collectionId in the database.

I have verified that the value of collectionId is correct and matches the documents in the collection. However, the aggregation still returns an empty array. When I use a regular find query, it works fine:

const cards = await Card.find({ collectionId: collectionId });

What could be causing this issue? Any insights would be greatly appreciated!

Thank you in advance.

steevej · 2024-09-25T21:29:54.686Z

This is quite abnormal.

If

Abdulrahman_almuhajir:

const cards = await Card.find({ collectionId: collectionId });

works, then

Abdulrahman_almuhajir:

cards = await Card.aggregate([
    {
      $match: { collectionId: collectionId },
    },
  ]);

should work.

May be useShuffle is false and the aggregation is not even called.

The call to aggregate() returns a cursor. Do you call toArray() or something similar to get the documents from the cursor?

Abdulrahman_almuhajir · 2024-09-27T10:16:05.986Z

I have also tried using:

cards = await Card.find({ collectionId });

in the useShuffle condition, and it returned the expected data. So, the issue doesn’t seem to be with the condition itself.

steevej:

The call to aggregate() returns a cursor. Do you call toArray() or something similar to get the documents from the cursor?

I tested the query with another field, like userId, and it returned data correctly.

steevej · 2024-09-27T12:30:08.832Z

Your tests then eliminate issues with code logic. Good.

Abdulrahman_almuhajir:

I tested the query with another field, like userId, and it returned data correctly.

This last observation points to the direction of type mismatched between the stored value and the runtime type of the variable collectionId. For example, if the collectionId field is stored as a number, then the runtime type of the variable collectionId must also be a number. A frequent error, is that we get the variable value from a HTML form and the values are strings unless converted.

So what I suspect is that you do not obtain the value of collectionId using the same mean in the find vs the aggregate case. So it works with find because the runtime type of collectionId is correct while it is not correct for aggregate. For example, it could be the case that for find you do:

const collectionId = 6174 ;

and for aggregate you do:

const collectionId = document.querySelector( "#CollectionIdHtmlField").value ;

Something like

const collectionId = parseInt( document.querySelector( "#CollectionIdHtmlField").value ) ;

might be sufficient to make it work.

NeNaD · 2024-09-27T18:28:39.367Z

Hi @Abdulrahman_almuhajir,

Since your code is JavaScript, I assume you are using Mongoose as a client.

I assume that collectionId is a reference to a document in another collection (ObjectId).

When you perform a find() query, Mongoose will automatically convert your string to ObjectId.

However, when you perform aggregate() query, you need to cast your string yourself, in order for the query to work.

So, I suggest that you try the following:

const { ObjectId } = require('mongoose').Types;

...

cards = await Card.aggregate([
  {
    $match: { collectionId: ObjectId(collectionId) },
  },
]);

steevej · 2024-10-01T14:08:42.008Z

@Abdulrahman_almuhajir, could you please confirm if you are using Mongoose or not?

I moved your thread to Working with Data since your issue is not Atlas specific. I also add the tag mongoose-odm because NeNaD’s reply makes a lot of sense and it is a potential source of type mismatch.

Please try the suggestion

NeNaD:

collectionId: ObjectId(collectionId)

and if it works please mark NeNaD’s post as the solution.

steevej · 2024-10-08T10:46:56.052Z

@Abdulrahman_almuhajir, please do not let your thread die.

A week passed since the last reply.

system · 2024-10-13T10:47:26.209Z

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.