i have a timeseries collection whose size is expected to have 50M records, right now i’m doing a poc with 3M records in which i aggregate just using group and it takes 20 sec, how can i make it fast? Note: i have a index on source field but mongo ends up doing collscan.
Below query:
[
{
$group: {
_id: "$source",
sum: {
$sum: 1
}
}
}
]
same problem I am also getting, for me it is taking around 10 sec for 6 million records. Just a normal project and group. my actual logic is taking around a minute.
I wanted to use this for analytics but the performance is not looking great. Did you find any solution.
Try some of the things that were share in
@Ayush_Tiwari2, can you provide on any findings you got while try the proposed alternative.
Please provide some feedback.
will try this and share the findings
| Topic | Replies | Views | Activity |
|---|---|---|---|
| “Operation `users.insertOne()` buffering timed out after 10000ms” | 1 | 1.0k | May 2024 |
| Why is it that mongodb restarts are slow or even impossible to start when the number of collections is large | 3 | 406 | Jun 2024 |
| $group aggregation on array fields is not covered by MultiKey index | 4 | 373 | Jun 2024 |
| Aggregation pipeline performance | 0 | 278 | Jul 2024 |
| Unable to connect again to mongodb database after severel delete request | 5 | 50 | Sep 2024 |