Mongod.service wont start after reinstall

Ole_J · 2022-05-25T03:23:26.276Z

It worked perfectly until I removed and reinstalled it.
I deleted the conf file and after installation, with apt-get, there was no config file. I made a conf file and copied the suggested settings in the manual.

Ole_J · 2022-05-25T10:40:41.102Z

Hi, do you know what happens here ?

{“t”:{"$date":“2022-05-24T18:09:47.590-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:23016, “ctx”:“listener”,“msg”:“Waiting for connections”,“attr”:{“port”:27017,“ssl”:“off”}}
{“t”:{"$date":“2022-05-24T18:09:47.593-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23377, “ctx”:“SignalHandler”,“msg”:“Received signal”,“attr”:{“signal”:15,“error”:“Terminated”}}
{“t”:{"$date":“2022-05-24T18:09:47.593-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23378, “ctx”:“SignalHandler”,“msg”:“Signal was sent by kill(2)”,“attr”:{“pid”:1,“uid”:0}}
{“t”:{"$date":“2022-05-24T18:09:47.593-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23381, “ctx”:“SignalHandler”,“msg”:“will terminate after current cmd ends”}

Ole_J · 2022-05-25T10:41:55.703Z

POP_OS is in UBUNTU family.

Tin_Cvitkovic · 2022-05-25T14:23:19.244Z

Hello, a junior and a Mongo Newbie/Enthusiast here,

I have noticed in your log files the following line:
{“t”:{"$date":“2022-05-24T18:09:47.098-04:00”},“s”:“W”, “c”:“ASIO”, “id”:22601, “ctx”:“main”,“msg”:“No TransportLayer configured during NetworkInterface startup”}

You should check permissions in your /data/db folder, try applying these steps :
sudo mkdir /data/db
sudo chown -R $USER /data/db
now run mongo shell with access control
mongod --port 27017 --dbpath /data/db --auth

As can be seen:
{“t”:{"$date":“2022-05-24T18:09:47.580-04:00”},“s”:“W”, “c”:“CONTROL”, “id”:22120, “ctx”:“initandlisten”,“msg”:“Access control is not enabled for the database. Read and write access to data and configuration is unrestricted”,“tags”:[“startupWarnings”]}

I hope my review atleast gives you insight in what to do next.

Ole_J · 2022-05-25T17:15:27.140Z

Hi
, it worked and the mongod started in terminal with my user… But it still can’t run as a service.

------------------------------------- start as service ---------------------------------------
oaj@pop-os:/var/log/mongodb$ sudo systemctl start mongod
oaj@pop-os:/var/log/mongodb$ sudo systemctl status mongod
× mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Wed 2022-05-25 12:46:32 AST; 6s ago
Docs: https://docs.mongodb.org/manual
Process: 11364 ExecStart=/usr/bin/mongod --config /etc/mongod.conf (code=exited, status=100)
Main PID: 11364 (code=exited, status=100)
CPU: 42ms

May 25 12:46:32 pop-os systemd[1]: Started MongoDB Database Server.
May 25 12:46:32 pop-os mongod[11364]: about to fork child process, waiting until server is ready for connections.
May 25 12:46:32 pop-os mongod[11366]: forked process: 11366
May 25 12:46:32 pop-os mongod[11364]: ERROR: child process failed, exited with 100
May 25 12:46:32 pop-os mongod[11364]: To see additional information in this output, start without the “–fork” option.
May 25 12:46:32 pop-os systemd[1]: mongod.service: Main process exited, code=exited, status=100/n/a
May 25 12:46:32 pop-os systemd[1]: mongod.service: Failed with result ‘exit-code’.
oaj@pop-os:/var/log/mongodb$
--------------------------------------------------- log as service -----------------------------------------
{“t”:{“$date”:“2022-05-25T12:46:32.136-04:00”},“s”:“E”, “c”:“CONTROL”, “id”:20557, “ctx”:“initandlisten”,“msg”:“DBException in initAndListen, terminating”,“attr”:{“error”:“IllegalOperation: Attempted to create a lock file on a read-only directory: /var/lib/mongodb”}}

So it could run in terminal with me as user but not as service.
I found this fix:
sudo chown -R mongodb: /var/lib/mongodb

Now I didn’t get : Attempted to create a lock file on a read-only directory: /var/lib/mongodb
, but it still didn’t run as a service.

I’m stuck
-------------------------------------- log ------------------------
{“t”:{“$date”:“2022-05-25T12:53:35.962-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:20698, “ctx”:“-”,“msg”:“***** SERVER RESTARTED *****”}
{“t”:{“$date”:“2022-05-25T12:53:35.967-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:4915701, “ctx”:“main”,“msg”:“Initialized wire specification”,“attr”:{“spec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“outgoing”:{“minWireVersion”:0,“maxWireVersion”:13},“isInternalClient”:true}}}
{“t”:{“$date”:“2022-05-25T12:53:35.967-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23285, “ctx”:“main”,“msg”:“Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols ‘none’”}
{“t”:{“$date”:“2022-05-25T12:53:35.968-04:00”},“s”:“W”, “c”:“ASIO”, “id”:22601, “ctx”:“main”,“msg”:“No TransportLayer configured during NetworkInterface startup”}
{“t”:{“$date”:“2022-05-25T12:53:35.968-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:4648601, “ctx”:“main”,“msg”:“Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.”}
{“t”:{“$date”:“2022-05-25T12:53:35.970-04:00”},“s”:“W”, “c”:“ASIO”, “id”:22601, “ctx”:“main”,“msg”:“No TransportLayer configured during NetworkInterface startup”}
{“t”:{“$date”:“2022-05-25T12:53:35.970-04:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationDonorService”,“ns”:“config.tenantMigrationDonors”}}
{“t”:{“$date”:“2022-05-25T12:53:35.970-04:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationRecipientService”,“ns”:“config.tenantMigrationRecipients”}}
{“t”:{“$date”:“2022-05-25T12:53:35.970-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:5945603, “ctx”:“main”,“msg”:“Multi threading initialized”}
{“t”:{“$date”:“2022-05-25T12:53:35.970-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4615611, “ctx”:“initandlisten”,“msg”:“MongoDB starting”,“attr”:{“pid”:11844,“port”:27017,“dbPath”:“/var/lib/mongodb”,“architecture”:“64-bit”,“host”:“pop-os”}}
{“t”:{“$date”:“2022-05-25T12:53:35.971-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23403, “ctx”:“initandlisten”,“msg”:“Build Info”,“attr”:{“buildInfo”:{“version”:“5.0.8”,“gitVersion”:“c87e1c23421bf79614baf500fda6622bd90f674e”,“openSSLVersion”:“OpenSSL 1.1.1l 24 Aug 2021”,“modules”:,“allocator”:“tcmalloc”,“environment”:{“distmod”:“ubuntu2004”,“distarch”:“x86_64”,“target_arch”:“x86_64”}}}}
{“t”:{“$date”:“2022-05-25T12:53:35.971-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:51765, “ctx”:“initandlisten”,“msg”:“Operating System”,“attr”:{“os”:{“name”:“Pop”,“version”:“22.04”}}}
{“t”:{“$date”:“2022-05-25T12:53:35.971-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:21951, “ctx”:“initandlisten”,“msg”:“Options set by command line”,“attr”:{“options”:{“config”:“/etc/mongod.conf”,“net”:{“bindIp”:“localhost”,“port”:27017},“processManagement”:{“fork”:true},“storage”:{“dbPath”:“/var/lib/mongodb”,“journal”:{“enabled”:true}},“systemLog”:{“destination”:“file”,“logAppend”:true,“path”:“/var/log/mongodb/mongod.log”}}}}
{“t”:{“$date”:“2022-05-25T12:53:35.973-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22270, “ctx”:“initandlisten”,“msg”:“Storage engine to use detected by data files”,“attr”:{“dbpath”:“/var/lib/mongodb”,“storageEngine”:“wiredTiger”}}
{“t”:{“$date”:“2022-05-25T12:53:35.973-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22297, “ctx”:“initandlisten”,“msg”:“Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem",“tags”:["startupWarnings”]}
{“t”:{“$date”:“2022-05-25T12:53:35.973-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22315, “ctx”:“initandlisten”,“msg”:“Opening WiredTiger”,“attr”:{“config”:“create,cache_size=15464M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],”}}
{“t”:{“$date”:“2022-05-25T12:53:36.091-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:91152][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 5 through 6”}}
{“t”:{“$date”:“2022-05-25T12:53:36.120-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:120643][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 6 through 6”}}
{“t”:{“$date”:“2022-05-25T12:53:36.163-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:163086][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_ALL] Main recovery loop: starting at 5/5248 to 6/256”}}
{“t”:{“$date”:“2022-05-25T12:53:36.219-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:219459][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 5 through 6”}}
{“t”:{“$date”:“2022-05-25T12:53:36.265-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:265710][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 6 through 6”}}
{“t”:{“$date”:“2022-05-25T12:53:36.298-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:298416][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_ALL] Set global recovery timestamp: (0, 0)”}}
{“t”:{“$date”:“2022-05-25T12:53:36.298-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:298596][11844:0x7f0d8ac00200], txn-recover: [WT_VERB_RECOVERY_ALL] Set global oldest timestamp: (0, 0)”}}
{“t”:{“$date”:“2022-05-25T12:53:36.305-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:305064][11844:0x7f0d8ac00200], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 1, snapshot max: 1 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 45”}}
{“t”:{“$date”:“2022-05-25T12:53:36.327-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:4795906, “ctx”:“initandlisten”,“msg”:“WiredTiger opened”,“attr”:{“durationMillis”:354}}
{“t”:{“$date”:“2022-05-25T12:53:36.327-04:00”},“s”:“I”, “c”:“RECOVERY”, “id”:23987, “ctx”:“initandlisten”,“msg”:“WiredTiger recoveryTimestamp”,“attr”:{“recoveryTimestamp”:{“$timestamp”:{“t”:0,“i”:0}}}}
{“t”:{“$date”:“2022-05-25T12:53:36.327-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:4366408, “ctx”:“initandlisten”,“msg”:“No table logging settings modifications are required for existing WiredTiger tables”,“attr”:{“loggingEnabled”:true}}
{“t”:{“$date”:“2022-05-25T12:53:36.328-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22262, “ctx”:“initandlisten”,“msg”:“Timestamp monitor starting”}
{“t”:{“$date”:“2022-05-25T12:53:36.344-04:00”},“s”:“W”, “c”:“CONTROL”, “id”:22120, “ctx”:“initandlisten”,“msg”:“Access control is not enabled for the database. Read and write access to data and configuration is unrestricted”,“tags”:[“startupWarnings”]}
{“t”:{“$date”:“2022-05-25T12:53:36.348-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:4915702, “ctx”:“initandlisten”,“msg”:“Updated wire specification”,“attr”:{“oldSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“outgoing”:{“minWireVersion”:0,“maxWireVersion”:13},“isInternalClient”:true},“newSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“incomingInternalClient”:{“minWireVersion”:13,“maxWireVersion”:13},“outgoing”:{“minWireVersion”:13,“maxWireVersion”:13},“isInternalClient”:true}}}
{“t”:{“$date”:“2022-05-25T12:53:36.348-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:5071100, “ctx”:“initandlisten”,“msg”:“Clearing temp directory”}
{“t”:{“$date”:“2022-05-25T12:53:36.349-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:20536, “ctx”:“initandlisten”,“msg”:“Flow Control is enabled on this deployment”}
{“t”:{“$date”:“2022-05-25T12:53:36.350-04:00”},“s”:“I”, “c”:“FTDC”, “id”:20625, “ctx”:“initandlisten”,“msg”:“Initializing full-time diagnostic data capture”,“attr”:{“dataDirectory”:“/var/lib/mongodb/diagnostic.data”}}
{“t”:{“$date”:“2022-05-25T12:53:36.353-04:00”},“s”:“I”, “c”:“REPL”, “id”:6015317, “ctx”:“initandlisten”,“msg”:“Setting new configuration state”,“attr”:{“newState”:“ConfigReplicationDisabled”,“oldState”:“ConfigPreStart”}}
{“t”:{“$date”:“2022-05-25T12:53:36.354-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:23015, “ctx”:“listener”,“msg”:“Listening on”,“attr”:{“address”:“/tmp/mongodb-27017.sock”}}
{“t”:{“$date”:“2022-05-25T12:53:36.354-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:23015, “ctx”:“listener”,“msg”:“Listening on”,“attr”:{“address”:“127.0.0.1”}}
{“t”:{“$date”:“2022-05-25T12:53:36.354-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:23016, “ctx”:“listener”,“msg”:“Waiting for connections”,“attr”:{“port”:27017,“ssl”:“off”}}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23377, “ctx”:“SignalHandler”,“msg”:“Received signal”,“attr”:{“signal”:15,“error”:“Terminated”}}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23378, “ctx”:“SignalHandler”,“msg”:“Signal was sent by kill(2)”,“attr”:{“pid”:1,“uid”:0}}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23381, “ctx”:“SignalHandler”,“msg”:“will terminate after current cmd ends”}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“REPL”, “id”:4784900, “ctx”:“SignalHandler”,“msg”:“Stepping down the ReplicationCoordinator for shutdown”,“attr”:{“waitTimeMillis”:15000}}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“REPL”, “id”:4794602, “ctx”:“SignalHandler”,“msg”:“Attempting to enter quiesce mode”}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“COMMAND”, “id”:4784901, “ctx”:“SignalHandler”,“msg”:“Shutting down the MirrorMaestro”}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“SHARDING”, “id”:4784902, “ctx”:“SignalHandler”,“msg”:“Shutting down the WaitForMajorityService”}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784903, “ctx”:“SignalHandler”,“msg”:“Shutting down the LogicalSessionCache”}
{“t”:{“$date”:“2022-05-25T12:53:36.357-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:20562, “ctx”:“SignalHandler”,“msg”:“Shutdown: going to close listening sockets”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:23017, “ctx”:“listener”,“msg”:“removing socket file”,“attr”:{“path”:“/tmp/mongodb-27017.sock”}}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:4784905, “ctx”:“SignalHandler”,“msg”:“Shutting down the global connection pool”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784906, “ctx”:“SignalHandler”,“msg”:“Shutting down the FlowControlTicketholder”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“-”, “id”:20520, “ctx”:“SignalHandler”,“msg”:“Stopping further Flow Control ticket acquisitions.”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784908, “ctx”:“SignalHandler”,“msg”:“Shutting down the PeriodicThreadToAbortExpiredTransactions”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“REPL”, “id”:4784909, “ctx”:“SignalHandler”,“msg”:“Shutting down the ReplicationCoordinator”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“SHARDING”, “id”:4784910, “ctx”:“SignalHandler”,“msg”:“Shutting down the ShardingInitializationMongoD”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“REPL”, “id”:4784911, “ctx”:“SignalHandler”,“msg”:“Enqueuing the ReplicationStateTransitionLock for shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“-”, “id”:4784912, “ctx”:“SignalHandler”,“msg”:“Killing all operations for shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“-”, “id”:4695300, “ctx”:“SignalHandler”,“msg”:“Interrupted all currently running operations”,“attr”:{“opsKilled”:3}}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“TENANT_M”, “id”:5093807, “ctx”:“SignalHandler”,“msg”:“Shutting down all TenantMigrationAccessBlockers on global shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“COMMAND”, “id”:4784913, “ctx”:“SignalHandler”,“msg”:“Shutting down all open transactions”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“REPL”, “id”:4784914, “ctx”:“SignalHandler”,“msg”:“Acquiring the ReplicationStateTransitionLock for shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“INDEX”, “id”:4784915, “ctx”:“SignalHandler”,“msg”:“Shutting down the IndexBuildsCoordinator”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“REPL”, “id”:4784916, “ctx”:“SignalHandler”,“msg”:“Reacquiring the ReplicationStateTransitionLock for shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“REPL”, “id”:4784917, “ctx”:“SignalHandler”,“msg”:“Attempting to mark clean shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“NETWORK”, “id”:4784918, “ctx”:“SignalHandler”,“msg”:“Shutting down the ReplicaSetMonitor”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“SHARDING”, “id”:4784921, “ctx”:“SignalHandler”,“msg”:“Shutting down the MigrationUtilExecutor”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“ASIO”, “id”:22582, “ctx”:“MigrationUtil-TaskExecutor”,“msg”:“Killing all outstanding egress activity.”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“COMMAND”, “id”:4784923, “ctx”:“SignalHandler”,“msg”:“Shutting down the ServiceEntryPoint”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784925, “ctx”:“SignalHandler”,“msg”:“Shutting down free monitoring”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:20609, “ctx”:“SignalHandler”,“msg”:“Shutting down free monitoring”}
{“t”:{“$date”:“2022-05-25T12:53:36.358-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784927, “ctx”:“SignalHandler”,“msg”:“Shutting down the HealthLog”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784928, “ctx”:“SignalHandler”,“msg”:“Shutting down the TTL monitor”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“INDEX”, “id”:3684100, “ctx”:“SignalHandler”,“msg”:“Shutting down TTL collection monitor thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“INDEX”, “id”:3684101, “ctx”:“SignalHandler”,“msg”:“Finished shutting down TTL collection monitor thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784929, “ctx”:“SignalHandler”,“msg”:“Acquiring the global lock for shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784930, “ctx”:“SignalHandler”,“msg”:“Shutting down the storage engine”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22320, “ctx”:“SignalHandler”,“msg”:“Shutting down journal flusher thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22321, “ctx”:“SignalHandler”,“msg”:“Finished shutting down journal flusher thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22322, “ctx”:“SignalHandler”,“msg”:“Shutting down checkpoint thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22323, “ctx”:“SignalHandler”,“msg”:“Finished shutting down checkpoint thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:20282, “ctx”:“SignalHandler”,“msg”:“Deregistering all the collections”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22261, “ctx”:“SignalHandler”,“msg”:“Timestamp monitor shutting down”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22317, “ctx”:“SignalHandler”,“msg”:“WiredTigerKVEngine shutting down”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22318, “ctx”:“SignalHandler”,“msg”:“Shutting down session sweeper thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.359-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22319, “ctx”:“SignalHandler”,“msg”:“Finished shutting down session sweeper thread”}
{“t”:{“$date”:“2022-05-25T12:53:36.361-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:4795902, “ctx”:“SignalHandler”,“msg”:“Closing WiredTiger”,“attr”:{“closeConfig”:“leak_memory=true,”}}
{“t”:{“$date”:“2022-05-25T12:53:36.362-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“SignalHandler”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1653497616:362959][11844:0x7f0d8abfc640], close_ckpt: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 4, snapshot max: 4 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 45”}}
{“t”:{“$date”:“2022-05-25T12:53:36.430-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:4795901, “ctx”:“SignalHandler”,“msg”:“WiredTiger closed”,“attr”:{“durationMillis”:69}}
{“t”:{“$date”:“2022-05-25T12:53:36.430-04:00”},“s”:“I”, “c”:“STORAGE”, “id”:22279, “ctx”:“SignalHandler”,“msg”:“shutdown: removing fs lock…”}
{“t”:{“$date”:“2022-05-25T12:53:36.430-04:00”},“s”:“I”, “c”:“-”, “id”:4784931, “ctx”:“SignalHandler”,“msg”:“Dropping the scope cache for shutdown”}
{“t”:{“$date”:“2022-05-25T12:53:36.430-04:00”},“s”:“I”, “c”:“FTDC”, “id”:4784926, “ctx”:“SignalHandler”,“msg”:“Shutting down full-time data capture”}
{“t”:{“$date”:“2022-05-25T12:53:36.430-04:00”},“s”:“I”, “c”:“FTDC”, “id”:20626, “ctx”:“SignalHandler”,“msg”:“Shutting down full-time diagnostic data capture”}
{“t”:{“$date”:“2022-05-25T12:53:36.430-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:20565, “ctx”:“SignalHandler”,“msg”:“Now exiting”}
{“t”:{“$date”:“2022-05-25T12:53:36.431-04:00”},“s”:“I”, “c”:“CONTROL”, “id”:23138, “ctx”:“SignalHandler”,“msg”:“Shutting down”,“attr”:{“exitCode”:0}}

Ole_J · 2022-05-25T17:39:41.975Z

I uninstalled and removed the data lib and the config file, and then reinstalled with apt-get.
What I don’t understand is, that the installation didn’t make a new config file and the service suddenly didn’t work. I would expect a clean installation, that works ?

steevej · 2022-05-25T17:54:06.409Z

Ole_J:

ERROR: child process failed, exited with 100

That is not the same error as before. The most likely reason for this is that you did not terminated the mongod you started manually.

Ole_J · 2022-05-25T18:18:39.672Z

I did terminate that process. And I have seen that error before.
I would like to find out why that child process gave an error.

steevej · 2022-05-25T19:25:05.644Z

Share the output of

ls -ld /var/lib/mongodb

Ole_J · 2022-05-25T20:19:10.783Z

oaj@pop-os:/$ ls -ld /var/lib/mongodb
drwxr-xr-x 4 mongodb nogroup 4096 May 25 14:56 /var/lib/mongodb

steevej · 2022-05-25T20:47:21.378Z

Okay that looks good.

Share your mongodb service file.

Ole_J · 2022-05-25T20:53:53.413Z

/lib/systemd/system/mongod.service

[Unit]
Description=MongoDB Database Server
Documentation=https://docs.mongodb.org/manual
After=network-online.target
Wants=network-online.target

[Service]
User=mongodb
Group=mongodb
EnvironmentFile=-/etc/default/mongod
ExecStart=/usr/bin/mongod --config /etc/mongod.conf
PIDFile=/var/run/mongodb/mongod.pid

file size

LimitFSIZE=infinity

cpu time

LimitCPU=infinity

virtual memory size

LimitAS=infinity

open files

LimitNOFILE=64000

processes/threads

LimitNPROC=64000

locked memory

LimitMEMLOCK=infinity

total threads (user+kernel)

TasksMax=infinity
TasksAccounting=false

Recommended limits for mongod as specified in

https://docs.mongodb.com/manual/reference/ulimit/#recommended-ulimit-settings

[Install]
WantedBy=multi-user.target

steevej · 2022-05-25T21:03:14.856Z

Because of

Ole_J:

Group=mongodb

in service file, try to chgrp mongodb /var/lib/mongodb/

It is nogroup now.

Output of

ls -ld /var/lib/mongodb/

Ole_J · 2022-05-25T22:26:50.031Z

( I previously sent this by email. Forum said too many posts by a newbie. )

oaj@pop-os:/$ sudo chgrp mongodb /var/lib/mongodb/
[sudo] password for oaj:
oaj@pop-os:/$ ls -ld /var/lib/mongodb/
drwxr-xr-x 4 mongodb mongodb 4096 May 25 14:56 /var/lib/mongodb/

oaj@pop-os:/$ sudo systemctl start mongod
oaj@pop-os:/$ sudo systemctl status mongod
○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor prese>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 14:56:10 pop-os systemd[1]: Started MongoDB Database Server.
May 25 14:56:10 pop-os mongod[16481]: about to fork child process, waiting unti>
May 25 14:56:10 pop-os mongod[16483]: forked process: 16483
May 25 14:56:10 pop-os mongod[16481]: child process started successfully, paren>
May 25 14:56:10 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting unti>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, paren>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.

------------------------- log ------------------------------

steevej · 2022-05-25T22:54:54.332Z

Please show the output of

ss -tlnp
ps -aef | grep [m]ongod
ls -l /var/run/mongodb/mongod.pid
ls -l /tmp/mongodb-*
date
 sudo systemctl start mongod

And have you looked at:

steevej:

I do not really know this distribution but it may be related to SELinux config being too restrictive.

I usually see a click count but I don’t see any right now.

Ole_J · 2022-05-26T00:33:08.238Z

oaj@pop-os:/$ ss -tlnp
State Recv-Q Send-Q Local Address:Port Peer Address:Port Process
LISTEN 0 32 192.168.130.1:53 0.0.0.0:*
LISTEN 0 32 192.168.122.1:53 0.0.0.0:*
LISTEN 0 4096 127.0.0.53%lo:53 0.0.0.0:*
LISTEN 0 128 127.0.0.1:631 0.0.0.0:*
LISTEN 0 4096 [::ffff:127.0.0.1]:43273 : users:((“java”,pid=6646,fd=138))
LISTEN 0 4096 [::ffff:127.0.0.1]:63342 : users:((“java”,pid=6646,fd=64))
LISTEN 0 128 [::1]:631 [::]:*
LISTEN 0 4096 [::ffff:127.0.0.1]:6942 : users:((“java”,pid=6646,fd=36))
LISTEN 0 511 *:39653 : users:((“apache2”,pid=3282,fd=4),(“apache2”,pid=3281,fd=4),(“apache2”,pid=3279,fd=4))

oaj@pop-os:/$ ps -aef | grep [m]ongod
root 23329 7444 0 17:24 pts/1 00:00:00 sudo gedit mongod.log
root 23330 23329 0 17:24 pts/5 00:00:00 sudo gedit mongod.log
root 23331 23330 0 17:24 pts/5 00:00:34 gedit mongod.log

oaj@pop-os:/$ ls -l /var/run/mongodb/mongod.pid
ls: cannot access ‘/var/run/mongodb/mongod.pid’: No such file or directory

oaj@pop-os:/$ ls -l /tmp/mongodb-*
ls: cannot access ‘/tmp/mongodb-*’: No such file or directory

oaj@pop-os:/$ date
Wed May 25 08:29:03 PM AST 2022

Oh, this came out with a lot:

oaj@pop-os:/$ sudo systemctl start mongod
[sudo] password for oaj:
oaj@pop-os:/$ sudo systemctl status mongod
○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor prese>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting unti>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, paren>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting unti>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, paren>
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor pres>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting unt>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, pare>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting unt>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, pare>
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor prese>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting unti>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, paren>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting unti>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, paren>
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor preset>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting until>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, parent>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting until>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, parent>
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor preset:>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting until >
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, parent >
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting until >
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, parent >
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor preset: e>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting until se>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, parent ex>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting until se>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, parent ex>
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor preset: ena>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting until serv>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, parent exit>
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting until serv>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, parent exit>
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)

○ mongod.service - MongoDB Database Server
Loaded: loaded (/lib/systemd/system/mongod.service; disabled; vendor preset: enabl>
Active: inactive (dead)
Docs: https://docs.mongodb.org/manual

May 25 17:22:21 pop-os systemd[1]: Started MongoDB Database Server.
May 25 17:22:21 pop-os mongod[23189]: about to fork child process, waiting until server>
May 25 17:22:21 pop-os mongod[23191]: forked process: 23191
May 25 17:22:21 pop-os mongod[23189]: child process started successfully, parent exiting
May 25 17:22:22 pop-os systemd[1]: mongod.service: Deactivated successfully.
May 25 20:29:44 pop-os systemd[1]: Started MongoDB Database Server.
May 25 20:29:44 pop-os mongod[35082]: about to fork child process, waiting until server>
May 25 20:29:44 pop-os mongod[35084]: forked process: 35084
May 25 20:29:45 pop-os mongod[35082]: child process started successfully, parent exiting
May 25 20:29:45 pop-os systemd[1]: mongod.service: Deactivated successfully.
~
~
~
~
~
~
~
~
lines 1-15/15 (END)