Docker-compose ReplicaSets - getaddrinfo ENOTFOUND

TheAdrianReza_N_A · 2021-01-13T20:04:33.161Z

As title suggests, I am using docker-compose running 3 mongo containers. I have attached the rs.status() log and also a screenshot of Studio3t to scan my ports for the members.

rs.status()642×990 19.1 KB

Studio3t722×823 49.4 KB

I tried many variations of the connections string and ports based on the mongo documentation. I am new at this and still learning so any info helps!

MaBeuLux88_xxx · 2021-01-13T21:08:05.314Z

Hi @TheAdrianReza_N_A and welcome in the MongoDB Community !

Have you set your IP addresses correctly in your bindIp network configuration? Did you include in there the IP address of your client in your 3 config files?

If that’s not it, could you please share your config file and your docker-compose.yml maybe so we have a bit more information to work with?

Also ─ just to confirm ─ “mongo-rs0-1”, “mongo-rs0-2” and “mongo-rs0-3” are 3 different physical servers, correct?

Cheers,
Maxime.

TheAdrianReza_N_A · 2021-01-13T23:44:44.864Z

I do not believe I have done much in the network configuration. Feel free to suggest ways I can improve my docker-compose.yml file! It’s a boilerplate mongo-rs docker container I found.

And yes they are on 3 different servers.

mongo.conf -

replication:
oplogSizeMB: 1024
replSetName: rs0

image597×838 16.8 KB

Really appreciate the quick response! Let me know if there is anything else I can get you to help my situation!

MaBeuLux88_xxx · 2021-01-14T05:10:16.953Z

From my understanding, docker-compose is a tool that starts multiple containers that will work together on the same machine.

So the way I understand it, your 3 “mongo-rs0-X” containers will be started on the same machine which makes me want to ask a simple question:

Replica Sets are here for one main reason: High Availability in prod. If your 3 nodes depends on some piece of hardware they have in common (same power source, same disk bay, etc), it means you are not really HA because that piece of equipment can fail and bring all your nodes down, all at once. Which is a big NO NO in prod.

That’s the reason why it’s a good practice to deploy your nodes in different data centers.

I also see you are using --smallfiles which is a deprecated option which was only for MMapV1 which is gone now and --oplogSize 128 is definitely a terrible idea.

So ─ based on this ─ I think you are trying to deploy a development or test environment here but then I really don’t see the point of deploying 3 nodes on the same cluster. A single node replica set would most probably be good enough, no?

Here is the docker command I use to start an ephemeral single replica set node on my machine when I need to hack something:

docker run --rm -d -p 27017:27017 -h $(hostname) --name mongo mongo:4.4.3 --replSet=test && sleep 4 && docker exec mongo mongo --eval "rs.initiate();"

I actually made an alias out of it which is in my ~/.bash_aliases file:

alias mdb='docker run --rm -d -p 27017:27017 -h $(hostname) --name mongo mongo:4.4.3 --replSet=test && sleep 4 && docker exec mongo mongo --eval "rs.initiate();"'

And ─ because of the --rm option ─ I can just destroy the container and everything it contains (volumes included) with a simple:

docker stop mongo

Is it what you were looking for or you really need to make these 3 nodes on the same machine work?

Cheers,
Maxime.

Mohammad_Faisal_Khan · 2022-02-23T11:07:27.981Z

Make sure that you have added replica set nodes in the host machine in etc/hosts file.
Just like the below example -

127.0.0.1	mongoset1 mongoset2 mongoset3

Note - 127.0.0.1 is your host machine and mongoset1, mongoset2 and mongoset3 are the nodes (members) of the replicaset.

MaBeuLux88_xxx · 2022-05-18T21:15:25.817Z

Mohammad_Faisal_Khan:

127.0.0.1 mongoset1 mongoset2 mongoset3

It’s a nonsense to run 3 members of the same RS on the same machine. Running multiple data bearing mongod on the same machine shouldn’t exist.

The only exception to that rule would be if you are learning how RS works and you want to experiment while learning.

Maxwell_Krause · 2022-06-01T14:20:03.668Z

" It’s a nonsense to run 3 members of the same RS on the same machine. Running multiple data bearing mongod on the same machine shouldn’t exist."

How are we supposed to test transactions locally? We are already using docker compose for our local setup so not having this functionatliy would make it impossible to test Mongo Transactions. How are you testing your transactions? Are you using them? PS for the record I think this is the only reason you would want to setup replicas locally, or to mirror your hosted env for testing or for educational purposes. This feature does belong in mongod however.

Maxwell_Krause · 2022-06-01T14:26:07.500Z

Hey Maxine -

The but why meme I almost find offensive because I am here ONLY because my team needs to test mongo transactions and it was YOUR TEAM that implemented in a way where they can only be tested with this replica configuration. So to come here, having spent my morning trying to get this to work and see that you meme the OP for doing this when you created the problem is

MaBeuLux88_xxx · 2022-06-01T14:41:03.568Z

I’m sorry that you found that a bit offensive. I’m being a bit sarcastic to REALLY explain why it doesn’t make sense and get the point across. If you read my entire post, the answer and justification is in it.

MaBeuLux88_xxx:

So ─ based on this ─ I think you are trying to deploy a development or test environment here but then I really don’t see the point of deploying 3 nodes on the same cluster. A single node replica set would most probably be good enough, no?

Here is the docker command I use to start an ephemeral single replica set node on my machine when I need to hack something:

I explained in my answer why it’s a bad idea and I also explained the solution: Single Node Replica Set.

Transactions, Change Streams and a few other features in MongoDB rely on the special oplog collection that only exists in Replica Set setups. BUT you can set up a Single Node Replica Set that only contains a single Primary node and all the features will work just as good as in a 7 nodes Replica Set.

So again, I reiterate:

It’s a nonsense to run 3 members of the same RS on the same machine.

Use a Single Node RS instead. Same features but it’s using 3X less ressources.

travelling_cat · 2023-01-13T12:44:58.849Z

Since the original question basically is “How can I access a replica set inside a docker network from the host”, this solution might be useful:

Create a public DNS entry to a “localhost” host on domain you own, for example localhost.somedomain.com → 127.0.0.1
Use this single host in the replica set config as name (use only one mongo in the set)
In your docker setup, override the DNS with the docker host running the replica. In docker-compose, the network aliases section can be used for this

This will result in name resolve allowing access to mongo via localhost.somedomain.com both from inside docker and from the host (given the right exposed port)

Note that the usual solution to this problem is “modify your local /etc/hosts file”, which works too, but requires every dev/system in your organization to modify system files.

Jakub_Ganczorz · 2023-02-10T06:07:01.400Z

So in order to have a docker instance of a replica set MongoDB I need to modify the local etc/hosts file?
How has that behavior ever rolled to a production version?

What about environments I do not have access to the system configuration (eg. CI/CD pipelines)?

Marco_Maldonado · 2023-03-28T21:18:00.301Z

@MaBeuLux88_xxx are you really a mongo employee? this is for testing purposes.

@TheAdrianReza_N_A I believe it has something to do with replicaset config, you can try using bitnami images and try with the MONGODB_ADVERTISED_HOSTNAME as localhost, if my own tests are successful will post back.

Sorry for the half response, but had to chime in to this nonsense with Maxime Beugnet!

MaBeuLux88_xxx · 2023-03-28T22:49:35.465Z

Hi @Marco_Maldonado and welcome in the MongoDB Community !

Yes I am. It’s written right here.

I think I’ll write a blog post about this because apparently nobody wants to hear that single node RS for a localhost dev environment is just fine.

This is what I use daily to run a localhost dev environment:

alias mdb='docker run --rm -d -p 27017:27017 -h $(hostname) --name mongo mongo:6.0.5 --replSet=RS && sleep 5 && docker exec mongo mongosh --quiet --eval "rs.initiate();"'
alias m='docker exec -it mongo mongosh --quiet'

It works perfectly fine. I can use ACID transactions, change streams, …

If I want to keep the data, I can use a volume but I don’t need to.

Cheers,
Maxime.

Brock · 2023-03-29T01:24:45.860Z

@Marco_Maldonado, Maxime is actually correct. You don’t need a multinode cluster for testing or doing things in MongoDB.

I don’t really agree with the “nonsense” comment, but I do understand the sentiment because unless your test environment is intended to directly test and evaluate performance in an actual production environment to actually have full awareness of what impact things will have on an environment level, there really isn’t as much of a need for a multinode replica set.

@MaBeuLux88_xxx otherwise I do agree with.

system · 2023-04-03T01:25:02.193Z

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.