MongoDB Atlas search with Array of Numbers

Sagar942150 · 2020-10-12T12:29:40.251Z

How can I perform search operations on type Array of numbers?

MaBeuLux88_xxx · 2020-10-12T15:09:43.636Z

Hi @Sagar942150 and welcome in the MongoDB Community !

Please provide an example of your document and expected result if you want a detailed answer. It’s too vague.

Here is an example based on what I understand from your question:

test:PRIMARY> db.c.insert({array:[1,2,3]})
WriteResult({ "nInserted" : 1 })
test:PRIMARY> db.c.find({array:1})
{ "_id" : ObjectId("5f84717525fa89f1696c3941"), "array" : [ 1, 2, 3 ] }

Here are more resources that hopefully will help you:

https://docs.mongodb.com/manual/tutorial/query-arrays/
https://docs.mongodb.com/manual/reference/operator/query-array/

I hope this helps.

Cheers,
Maxime.

Jonathan_Gautier · 2020-10-12T17:24:54.846Z

@MaBeuLux88_xxx He speaking about Atlas Search not MongoDB

@Sagar942150 Today we cannot search in array of number in $search.
You have to convert your number array to string array.

Like this.

[1,2,3] => ['1','2','3']

Make a mappings for search like string:

{
  "mappings": {
    "dynamic": false,
    "fields": {
      "ArrayNumbersField": {
        "analyzer": "lucene.keyword",
        "searchAnalyzer": "lucene.keyword",
        "type": "string"
      }
    }
  }
}

Make $search with filter for my example and every number you want to search add new filter:

This query will find all documents with as minimum 1 or 2 in “ArrayNumbersField” ( You can update minimumShouldMatch if you want all number required for your search :

[
    {
        "$search": {
            "index": "SearchIndex1",
            "compound": {
                "filter": [
                    {
                        "compound": {
                            "should": [
                                {
                                    "phrase": {
                                        "path": "ArrayNumbersField",
                                        "query": "1"
                                    }
                                },
                                {
                                    "phrase": {
                                        "path": "ArrayNumbersField",
                                        "query": "2"
                                    }
                                }
                            ],
                            "minimumShouldMatch": 1
                        }
                    }
                ]
            }
        }
    }
]

I hope this will help you

Sagar942150 · 2020-10-12T18:41:29.923Z

Hi, Thanks for replying. Actually my question is for mongodb Atlas search query as per there documentation we can’t apply search on array of number type is there a way we can deal with such scenario.

Sagar942150 · 2020-10-12T18:41:47.512Z

It didn’t work for me my collection having a property as grades:[1, 2] it won’t return anything

Jonathan_Gautier · 2020-10-12T19:45:06.776Z

@Sagar942150

Just convert this colum of array of number, by array of string. ( with all documents in your collection )
And when you insert new document dont forget to convert your array of number !

[1,2] => ['1','2']

It’s same just need to convert ( String Value) when you make your query to get numbers ( Numeric Value ).

And for make search and get array of numeric value, you can use aggregation pipeline to make your query -

$search with $compound and $phrase ( like my first example )
$project with $map and $toInt. With this your final result was array of numeric value !

MaBeuLux88_xxx · 2020-10-12T20:41:05.927Z

Oops!
Looks like I got tricked and I read too fast here !

Sagar942150 · 2020-10-13T05:46:14.066Z

Actually, the search should return something with reference to the above code.
$search with $compound and $phrase — It is not working

Jonathan_Gautier · 2020-10-13T11:33:56.663Z

Wait 1 hour i will make you a full example

Sagar942150 · 2020-10-13T19:37:19.138Z

Sure, will wait for your response!!!

Jonathan_Gautier · 2020-10-14T19:48:24.292Z

Sorry for time

I have created new collections with two documents:

{"name":"document1","array":["1","2","3"]} 
{"name":"document2","array":["3","4","5"]}

image1364×546 20.4 KB

Make search Index mappings:

{
  "mappings": {
    "dynamic": false,
    "fields": {
      "array": {
        "analyzer": "lucene.keyword",
        "searchAnalyzer": "lucene.keyword",
        "type": "string"
      }
    }
  }
}

image1364×306 20 KB

And make an aggregation with searching 2 and 4:

[{$search: {
  index: 'default',
  compound: {
    filter: [
      {
        compound: {
          should: [
            {
              phrase: {
                path: 'array',
                query: '2'
              }
            },
            {
              phrase: {
                path: 'array',
                query: '4'
              }
            }
          ],
          minimumShouldMatch: 1
        }
      }
    ]
  }
}}]

This return my two documents:

image1172×420 22.4 KB

And to get Int value in result array of number you can use $project in your pipeline like this

[{$search: {
  index: 'default',
  compound: {
    filter: [
      {
        compound: {
          should: [
            {
              phrase: {
                path: 'array',
                query: '2'
              }
            },
            {
              phrase: {
                path: 'array',
                query: '4'
              }
            }
          ],
          minimumShouldMatch: 1
        }
      }
    ]
  }
}}, {
         $project: { 
            name: 1,
            array:
            {
              $map:
                 {
                   input: "$array",
                   as: "grade",
                   in: { $toInt: "$$grade" }
                 }
            }
         }
}]

image1209×319 18 KB

I cant do more to help you now

Sagar942150 · 2020-10-15T03:15:12.401Z

It’s ok things take time Thank you for your help but actually as I previously said my collection is having array of number array = [1,2,3,4,5] and I have to perform an operation on this array

Jonathan_Gautier · 2020-10-15T10:36:08.609Z

You juste have to convert all your documents like this:

array = [1,2,3,4,5] => array = ['1','2','3','4','5']

I will give you my scrypt python to do this ( You can change query object to apply on specific documents ! )

query = {}
print(lots.count(query))


def idlimit(page_size, skip=None, query=None):
    """Function returns `page_size` number of documents after last_id
    and the new last_id.
    """
    if query is None:
        query = {}
    if skip is None:
        cursor = lots.find(query).limit(
            page_size)
    else:
        cursor = lots.find(query).skip(skip).limit(page_size)

    data = [x for x in cursor]

    if not data:
        return None, None

    if skip is None:
        skip = page_size
    else:
        skip += page_size

    return data, skip


data, skip = idlimit(100, query=query)
count = 0

while skip is not None:
    if data is not None:
        for item in data:
            if len(item['array']) > 0:
                array = list(map(str, item['array']))
                lots.update_one({"_id": item['_id']},
                                {'$set': {'array': array}})
    count += len(data)
    data, skip = idlimit(100, skip=skip, query=query)
    print(count)

Sagar942150 · 2020-10-15T10:44:54.556Z

Thanks !!! I have added a duplicate field with array of string

Jonathan_Gautier · 2020-10-15T10:46:34.548Z

Yes this was another solution also
No problem !

system · 2020-11-05T11:37:13.095Z

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.