Relational Migrator with Confluent Cloud throwing exception

Ahmed_Rasool · November 11, 2024, 4:11am

I’m migrating a production app from SQL Server to MongoDB. For the purpose, I’m using relational migrator v1.10.0.

I’ve mapped collections, designed schema and I’ve been able to run migration jobs with sample data collection set.

Because I’ve data around 30GB, I’m trying to set it up with confluent cloud kafka. When I start the job, it throws error:
Cannot invoke "java.util.Set.stream()" because the return value of "com.mongodb.migrator.application.migration.confluent.model.ConnectV1CustomConnectorPluginList.getData()" is null

Please note that I’ve configured the Confluent correctly as you can see the confluent icon here:

Here the system_info

{


  "migrator_deployment" : "confluent",
  "migrator_version" : "1.10.0",
  "system_cores" : "4",
  "jvm_vendor" : "Eclipse Adoptium",
  "os_version" : "10.0",
  "telemetry_user_id" : "6d7a9ac4-0f4b-4b85-859c-abac6d24b49e",
  "os_arch" : "amd64",
  "system_memory" : "15 GB",
  "os_name" : "Windows Server 2019",
  "jvm_version" : "17.0.12"
}

The logs from the logs file are also here

2024-11-07 00:36:04,378 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='672c0b74a00a7c1a45a32832', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017] Discovered replica set primary veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017 with max election id 7fffffff00000000000000d7 and max set version 29
2024-11-07 00:36:04,611 INFO c.m.m.a.p.t.ConfluentCustomConnectorTask [pool-6-thread-1] Checking Confluent for Debezium Source Custom Connector
2024-11-07 00:36:04,634 INFO c.m.m.a.m.s.MigrationStateMachine$1 [pool-6-thread-1] Transition from: PRE_TASKS, trigger: FAIL
2024-11-07 00:36:04,638 WARN c.m.m.a.m.j.MigrationJobService [pool-6-thread-1] Migration job finished with exception
java.lang.NullPointerException: Cannot invoke "java.util.Set.stream()" because the return value of "com.mongodb.migrator.application.migration.confluent.model.ConnectV1CustomConnectorPluginList.getData()" is null
	at com.mongodb.migrator.application.premigration.task.ConfluentCustomConnectorTask.hasConnector(ConfluentCustomConnectorTask.java:76)
	at com.mongodb.migrator.application.premigration.task.ConfluentCustomConnectorTask.hasSourceConnector(ConfluentCustomConnectorTask.java:66)
	at com.mongodb.migrator.application.premigration.task.ConfluentCustomConnectorTask.run(ConfluentCustomConnectorTask.java:44)
	at com.mongodb.migrator.application.premigration.task.PreMigrationTaskRunner.lambda$runTasks$0(PreMigrationTaskRunner.java:22)
	at java.base/java.util.ArrayList.forEach(Unknown Source)
	at com.mongodb.migrator.application.premigration.task.PreMigrationTaskRunner.runTasks(PreMigrationTaskRunner.java:22)
	at com.mongodb.migrator.application.migration.job.MigrationJobService.lambda$initializeMigrationStateMachine$5(MigrationJobService.java:162)
	at com.github.oxo42.stateless4j.StateConfiguration$6.doIt(StateConfiguration.java:284)
	at com.github.oxo42.stateless4j.StateConfiguration$6.doIt(StateConfiguration.java:281)
	at com.github.oxo42.stateless4j.StateConfiguration$7.doIt(StateConfiguration.java:300)
	at com.github.oxo42.stateless4j.StateConfiguration$7.doIt(StateConfiguration.java:297)
	at com.github.oxo42.stateless4j.StateRepresentation.executeEntryActions(StateRepresentation.java:122)
	at com.github.oxo42.stateless4j.StateRepresentation.enter(StateRepresentation.java:101)
	at com.github.oxo42.stateless4j.StateMachine.publicFire(StateMachine.java:225)
	at com.github.oxo42.stateless4j.StateMachine.fire(StateMachine.java:145)
	at com.mongodb.migrator.application.migration.statemachine.MigrationStateMachine.lambda$trigger$0(MigrationStateMachine.java:88)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)
2024-11-07 00:36:04,694 INFO c.m.m.a.m.s.MigrationStateMachine$1 [pool-6-thread-1] Transitioned to: FAILED

I need help as I’m stuck here

tomhollander · November 11, 2024, 5:03am

Hi @Ahmed_Rasool -

Sorry that you’ve run into this problem. This is a new issue that seems to be caused by some unexpected responses from Confluent’s API. We have a fix for this and it will be included in our next release which should be out by early December.

If you can’t wait for the new release, I’d recommend running the job without Kafka/Confluent. 30GB is not a very large job in the scheme of things and if your networking environment is good you should expect to have this complete within a few hours.

Let me know if you have any further questions.
Tom

Ahmed_Rasool · November 13, 2024, 1:16pm

Hi @tomhollander

First of all, thank you for replying. Although it took many days for someone to look into it and I had almost forgot about this post. But thanks anyways.

Secondly, although 30GB is not very big amount of data but it fails sometimes due to a bunch of reasons:

There’s deadlock on my source (SQL Server), and decides to stop the relational migrator related transaction/process.
MongoDB Atlas sometimes fails due to indecisiveness when there’s an election for primary if it goes down. I don’t know if it’s quite common but I’ve faced this issue 2-3 times. I’m using M40 cluster but still my primary node is overwhelmed when there’s a burst of data coming in.

Another challenge is that I’m doing it in 2 live environments. The source and sink databases are in production usage for 2 different applications.

And the irony is that when CDC fails, I’ve to re-run the whole job again from scratch.

Ahmed_Rasool · December 12, 2024, 7:14am

@tomhollander

I’ve got the updated Relational Migrator v1.11, that Confluent exception is gone now, but a new one is there.

Please review this and if there’s something you could guide me through, that would be appreciated.

Warm Regards

Ahmed_Rasool · December 12, 2024, 9:54am

Here’s the log file output:

2024-12-12 09:39:13,784 INFO c.m.m.a.a.AtlasService [http-nio-8278-exec-4] Failed to get command line options
com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=SCRAM-SHA-256, userName='data-migrator', source='admin', password=<hidden>, mechanismProperties=<hidden>}
	at com.mongodb.internal.connection.SaslAuthenticator.wrapException(SaslAuthenticator.java:300)
	at com.mongodb.internal.connection.SaslAuthenticator.lambda$authenticate$0(SaslAuthenticator.java:95)
	..
	..
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344)
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:384)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:905)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1741)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1190)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.mongodb.MongoCommandException: Command failed with error 18 (AuthenticationFailed): 'Authentication failed.' on server veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017. The full response is {"ok": 0.0, "errmsg": "Authentication failed.", "code": 18, "codeName": "AuthenticationFailed", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1733996349, "i": 6}}, "signature": {"hash": {"$binary": {"base64": "XRayLSxNR5mmsi8QU+htFy4QP0k=", "subType": "00"}}, "keyId": 7398159370124525570}}, "operationTime": {"$timestamp": {"t": 1733996349, "i": 6}}}
	at com.mongodb.internal.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:210)
	at com.mongodb.internal.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:520)
	at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceiveInternal(InternalStreamConnection.java:448)
	at com.mongodb.internal.connection.InternalStreamConnection.lambda$sendAndReceive$0(InternalStreamConnection.java:375)
	at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:378)
	at com.mongodb.internal.connection.CommandHelper.sendAndReceive(CommandHelper.java:100)
	at com.mongodb.internal.connection.CommandHelper.executeCommand(CommandHelper.java:49)
	at com.mongodb.internal.connection.SaslAuthenticator.sendSaslContinue(SaslAuthenticator.java:246)
	at com.mongodb.internal.connection.SaslAuthenticator.lambda$authenticate$0(SaslAuthenticator.java:83)
	... 209 common frames omitted
2024-12-12 09:39:13,795 INFO c.m.i.d.l.SLF4JLogger [http-nio-8278-exec-4] Waiting for server to become available for operation with ID 76. Remaining time: 29999 ms. Selector: ReadPreferenceServerSelector{readPreference=primary}, topology description: {type=REPLICA_SET, servers=[{address=veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, type=REPLICA_SET_SECONDARY, TagSet{[Tag{name='availabilityZone', value='usw1-az3'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='AWS'}, Tag{name='region', value='US_WEST_1'}, Tag{name='workloadType', value='OPERATIONAL'}]}, roundTripTime=6.0 ms, state=CONNECTED}, {address=veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017, type=REPLICA_SET_SECONDARY, TagSet{[Tag{name='availabilityZone', value='usw1-az1'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='AWS'}, Tag{name='region', value='US_WEST_1'}, Tag{name='workloadType', value='OPERATIONAL'}]}, roundTripTime=8.9 ms, state=CONNECTED}, {address=veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=SCRAM-SHA-256, userName='data-migrator', source='admin', password=<hidden>, mechanismProperties=<hidden>}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18 (AuthenticationFailed): 'Authentication failed.' on server veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017. The full response is {"ok": 0.0, "errmsg": "Authentication failed.", "code": 18, "codeName": "AuthenticationFailed", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1733996349, "i": 6}}, "signature": {"hash": {"$binary": {"base64": "XRayLSxNR5mmsi8QU+htFy4QP0k=", "subType": "00"}}, "keyId": 7398159370124525570}}, "operationTime": {"$timestamp": {"t": 1733996349, "i": 6}}}}}].
2024-12-12 09:39:14,291 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf41eb82d97c1c608ec9', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017] Monitor thread successfully connected to server with description ServerDescription{address=veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, type=REPLICA_SET_PRIMARY, cryptd=false, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=25, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=3952700, minRoundTripTimeNanos=0, setName='atlas-6h7t61-shard-0', canonicalAddress=veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, hosts=[veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017], passives=[], arbiters=[], primary='veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='usw1-az1'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='AWS'}, Tag{name='region', value='US_WEST_1'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=7fffffff00000000000000d8, setVersion=29, topologyVersion=TopologyVersion{processId=6745db0af7493f6bc6a263e9, counter=6}, lastWriteDate=Thu Dec 12 09:39:09 UTC 2024, lastUpdateTimeNanos=4949156435995500}
2024-12-12 09:39:14,292 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf41eb82d97c1c608ec9', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017] Discovered replica set primary veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017 with max election id 7fffffff00000000000000d8 and max set version 29
2024-12-12 09:39:14,320 INFO c.m.m.a.a.AtlasService [http-nio-8278-exec-4] Failed to get data size
com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=SCRAM-SHA-256, userName='data-migrator', source='admin', password=<hidden>, mechanismProperties=<hidden>}
	at com.mongodb.internal.connection.SaslAuthenticator.wrapException(SaslAuthenticator.java:300)
	at com.mongodb.internal.connection.SaslAuthenticator.lambda$authenticate$0(SaslAuthenticator.java:95)
	..
	..
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1190)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.mongodb.MongoCommandException: Command failed with error 18 (AuthenticationFailed): 'Authentication failed.' on server veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017. The full response is {"ok": 0.0, "errmsg": "Authentication failed.", "code": 18, "codeName": "AuthenticationFailed", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1733996349, "i": 6}}, "signature": {"hash": {"$binary": {"base64": "XRayLSxNR5mmsi8QU+htFy4QP0k=", "subType": "00"}}, "keyId": 7398159370124525570}}, "operationTime": {"$timestamp": {"t": 1733996349, "i": 6}}}
	at com.mongodb.internal.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:210)
	at com.mongodb.internal.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:520)
	at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceiveInternal(InternalStreamConnection.java:448)
	at com.mongodb.internal.connection.InternalStreamConnection.lambda$sendAndReceive$0(InternalStreamConnection.java:375)
	at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:378)
	at com.mongodb.internal.connection.CommandHelper.sendAndReceive(CommandHelper.java:100)
	at com.mongodb.internal.connection.CommandHelper.executeCommand(CommandHelper.java:49)
	at com.mongodb.internal.connection.SaslAuthenticator.sendSaslContinue(SaslAuthenticator.java:246)
	at com.mongodb.internal.connection.SaslAuthenticator.lambda$authenticate$0(SaslAuthenticator.java:83)
	... 211 common frames omitted
2024-12-12 09:39:14,478 INFO c.m.m.a.m.s.MigrationStateMachine$1 [pool-6-thread-1] Transition from: NOT_STARTED, trigger: COMPLETE
2024-12-12 09:39:14,485 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-srv-veronicas-insurance.ui2ap.mongodb.net] Adding discovered server veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017 to client view of cluster
2024-12-12 09:39:14,512 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-srv-veronicas-insurance.ui2ap.mongodb.net] Adding discovered server veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017 to client view of cluster
2024-12-12 09:39:14,514 INFO c.m.i.d.l.SLF4JLogger [pool-6-thread-1] MongoClient with metadata {"application": {"name": "MongoDBRelationalMigrator"}, "driver": {"name": "mongo-java-driver|sync", "version": "5.2.1"}, "os": {"type": "Windows", "name": "Windows Server 2019", "architecture": "amd64", "version": "10.0"}, "platform": "Java/Eclipse Adoptium/17.0.13+11"} created with settings MongoClientSettings{readPreference=primary, writeConcern=WriteConcern{w=1, wTimeout=null ms, journal=true}, retryWrites=true, retryReads=true, readConcern=ReadConcern{level=null}, credential=MongoCredential{mechanism=null, userName='data-migrator', source='admin', password=<hidden>, mechanismProperties=<hidden>}, transportSettings=null, commandListeners=[], codecRegistry=ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, CollectionCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, Jsr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.client.model.mql.ExpressionCodecProvider@4d247986, com.mongodb.Jep395RecordCodecProvider@5755f011, com.mongodb.KotlinCodecProvider@6dc89e6c]}, loggerSettings=LoggerSettings{maxDocumentLength=1000}, clusterSettings={hosts=[127.0.0.1:27017], srvHost=veronicas-insurance.ui2ap.mongodb.net, srvServiceName=mongodb, mode=MULTIPLE, requiredClusterType=REPLICA_SET, requiredReplicaSetName='atlas-6h7t61-shard-0', serverSelector='null', clusterListeners='[]', serverSelectionTimeout='30000 ms', localThreshold='15 ms'}, socketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=0, receiveBufferSize=0, proxySettings=ProxySettings{host=null, port=null, username=null, password=null}}, heartbeatSocketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=10000, receiveBufferSize=0, proxySettings=ProxySettings{host=null, port=null, username=null, password=null}}, connectionPoolSettings=ConnectionPoolSettings{maxSize=100, minSize=0, maxWaitTimeMS=120000, maxConnectionLifeTimeMS=0, maxConnectionIdleTimeMS=0, maintenanceInitialDelayMS=0, maintenanceFrequencyMS=60000, connectionPoolListeners=[], maxConnecting=2}, serverSettings=ServerSettings{heartbeatFrequencyMS=10000, minHeartbeatFrequencyMS=500, serverMonitoringMode=AUTO, serverListeners='[]', serverMonitorListeners='[]'}, sslSettings=SslSettings{enabled=true, invalidHostNameAllowed=false, context=null}, applicationName='MongoDBRelationalMigrator', compressorList=[], uuidRepresentation=UNSPECIFIED, serverApi=null, autoEncryptionSettings=null, dnsClient=null, inetAddressResolver=null, contextProvider=null, timeoutMS=null}
2024-12-12 09:39:14,515 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-srv-veronicas-insurance.ui2ap.mongodb.net] Adding discovered server veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017 to client view of cluster
2024-12-12 09:39:14,519 INFO c.m.m.a.p.t.MongoCollectionCleanUpTask [pool-6-thread-1] Skipping MongoDB collection clean up
2024-12-12 09:39:14,634 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017] Monitor thread successfully connected to server with description ServerDescription{address=veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, type=REPLICA_SET_PRIMARY, cryptd=false, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=25, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=2843400, minRoundTripTimeNanos=0, setName='atlas-6h7t61-shard-0', canonicalAddress=veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, hosts=[veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017], passives=[], arbiters=[], primary='veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='usw1-az1'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='AWS'}, Tag{name='region', value='US_WEST_1'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=7fffffff00000000000000d8, setVersion=29, topologyVersion=TopologyVersion{processId=6745db0af7493f6bc6a263e9, counter=6}, lastWriteDate=Thu Dec 12 09:39:09 UTC 2024, lastUpdateTimeNanos=4949156778051900}
2024-12-12 09:39:14,639 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017] Discovered replica set primary veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017 with max election id 7fffffff00000000000000d8 and max set version 29
2024-12-12 09:39:14,641 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017] Monitor thread successfully connected to server with description ServerDescription{address=veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, type=REPLICA_SET_SECONDARY, cryptd=false, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=25, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=8475800, minRoundTripTimeNanos=0, setName='atlas-6h7t61-shard-0', canonicalAddress=veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, hosts=[veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017], passives=[], arbiters=[], primary='veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='usw1-az3'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='AWS'}, Tag{name='region', value='US_WEST_1'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=null, setVersion=29, topologyVersion=TopologyVersion{processId=6745dcc93f92822d3560267e, counter=3}, lastWriteDate=Thu Dec 12 09:39:09 UTC 2024, lastUpdateTimeNanos=4949156785632700}
2024-12-12 09:39:14,657 INFO c.m.i.d.l.SLF4JLogger [cluster-ClusterId{value='675aaf42eb82d97c1c608eca', description='MongoDBRelationalMigrator'}-veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017] Monitor thread successfully connected to server with description ServerDescription{address=veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017, type=REPLICA_SET_SECONDARY, cryptd=false, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=25, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=2504200, minRoundTripTimeNanos=0, setName='atlas-6h7t61-shard-0', canonicalAddress=veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017, hosts=[veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-01.ui2ap.mongodb.net:27017, veronicas-insurance-shard-00-00.ui2ap.mongodb.net:27017], passives=[], arbiters=[], primary='veronicas-insurance-shard-00-02.ui2ap.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='usw1-az1'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='AWS'}, Tag{name='region', value='US_WEST_1'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=null, setVersion=29, topologyVersion=TopologyVersion{processId=6745d964e14b5b2419738df4, counter=4}, lastWriteDate=Thu Dec 12 09:39:09 UTC 2024, lastUpdateTimeNanos=4949156800469500}
2024-12-12 09:39:15,171 INFO c.m.m.a.p.t.ConfluentCustomConnectorTask [pool-6-thread-1] Checking Confluent for Debezium Source Custom Connector
2024-12-12 09:39:15,186 INFO c.m.m.a.p.t.ConfluentCustomConnectorTask [pool-6-thread-1] Debezium Source Custom Connector not found, downloading from S3 and uploading now
2024-12-12 09:39:16,973 INFO c.m.m.a.m.s.MigrationStateMachine$1 [pool-6-thread-1] Transition from: PRE_TASKS, trigger: FAIL
2024-12-12 09:39:16,977 WARN c.m.m.a.m.j.MigrationJobService [pool-6-thread-1] Migration job finished with exception
java.nio.file.FileSystemException: C:\Windows\TEMP\download10772134064703545896zip -> C:\Windows\TEMP\debezium-kafka-connect-source-sqlserver-3.0.1.Final.zip: The process cannot access the file because it is being used by another process
	at java.base/sun.nio.fs.WindowsException.translateToIOException(Unknown Source)
	at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
	at java.base/sun.nio.fs.WindowsFileCopy.move(Unknown Source)
	at java.base/sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source)
	
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)
2024-12-12 09:39:17,024 INFO c.m.m.a.m.s.MigrationStateMachine$1 [pool-6-thread-1] Transitioned to: FAILED

Here’s the output screen