Unable to connect to mongodb atlas server from Databricks

Phani_Kanakamedala · 2024-05-29T00:11:32.316Z

Hi I am unable to connect to mongodb atlas server from Databricks. I have configured Allow all hosts in network access section and i am able to connect to Mongodb from a Mongo Compass client from my system. I am not sure why it’s not working from Databricks cloud. Below is the code i am using, i have installed the required library as specified in this url:

https://docs.databricks.com/en/_extras/notebooks/source/mongodb.html

val connectionString1 = "mongodb+srv://phanivyr:MyPassword@cluster0.awdeasr.mongodb.net/sample_airbnb?retryWrites=true&w=majority&appName=Cluster0"

val database = "sample_airbnb"
val collection = "listingsAndReviews"

val df = spark.read.format("mongodb").option("database", database).option("spark.mongodb.input.uri", connectionString1).option("collection", collection).load()

df.printSchema()

Aasawari · 2024-05-31T12:58:10.281Z

Hi @Phani_Kanakamedala and welcome to the community forum

As this looks a Databricks issue. I would recommend reaching out to Databricks public forum for more accurate information.
Having said that, could you help me with the error message that you are seeing while making the connection ?

Regards
Aasawari

Phani_Kanakamedala · 2024-06-05T10:46:38.637Z

Hi Aasawari, Below is the error i am getting:

MongoTimeoutException: Timed out after 30000 ms while waiting to connect. Client view of cluster state is {type=UNKNOWN, servers=[{address=localhost:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketOpenException: Exception opening socket}, caused by {java.net.ConnectException: Connection refused (Connection refused)}}]

Phani_Kanakamedala · 2024-06-05T10:46:53.431Z

Below is the connection string:

mongodb+srv://:@cluster0.awdeasr.mongodb.net/sample_airbnb?retryWrites=true&w=majority

Harut_Abgaryan · 2024-07-02T09:38:16.709Z

@Phani_Kanakamedala @Aasawari any update here? I’m getting the same issue when trying to connect to my MongoDB from Databricks, I did everything based on documents but I’m getting the same issue

Aasawari · 2024-10-03T09:50:31.385Z

Hi all,

Thank you for reaching out.
There could be more than one reason to find the solution to this issue being seen depends on further information.

If you are looking to find a solution for the same, please raise a support ticket with the support team and provide all the information.

Regards
Aasawari

Sandeep_S2 · 2024-10-08T16:05:13.100Z

Hi @Phani_Kanakamedala, @Aasawari

You can use the code below to connect to Mongo Altas using Databricks.

df = spark.read.format("mongodb")\
    .option("database", "sample_airbnb")\
    .option("collection", "listingsAndReviews")\
    .option("spark.mongodb.read.connection.uri", "mongodb+srv://phanivyr:MyPassword@cluster0.awdeasr.mongodb.net")\
    .load()

Note: My Databricks compute configuration is as below
Spark: 3.5.3
scala - 2.13
mongo-connector : org.mongodb.spark:mongo-spark-connector_2.13:10.4.0
Install the mongo-connector from Maven Central