Error to store a 1.3GB json document in MongoDB

[steevej (Steeve Juneau)]

@Juliana_Fernandes

I’m using gridfs to do the import but I’ve got the error

Please share the command you used. I am surprised that gridfs api failed on size limit. And note that storing a JSON document in gridfs is not really useful as you won`t be able to use MQL on the document’s content.

That is why

@Lokesh_Reddy1

Segregate the document into multiple pieces the document must not be contains 16MB of data.

would be absolutely necessary if you want to query. For example, you may use jq to split your features array into separate documents.

The data is quite verbose with long names like TRACE_NUMBER_WITHIN_LINE which is really good when you publish data but not so much when you process it. I recommend shortening all those field names.