For AI agents: a documentation index is available at https://www.mongodb.com/docs/llms.txt — markdown versions of all pages are available by appending .md to any URL path.
Docs Menu
Docs Home
/ /
Manage Connections
Docs Home
/
Development
/
Atlas Stream Processing
/
Manage Connections
Docs Home
/
Development
/
Atlas Stream Processing
/
Manage Connections

Add an AWS Lambda Private Link Connection

Atlas Stream Processing supports creating Private Link connections to AWS Lambda using the $externalFunction stage. Select an option to display the procedure to add the connection using your preferred interface:

Add an AWS Lambda Private Link Connection through the Atlas Administration API

To add an AWS Lambda Private Link connection to your stream processing workspace through the Atlas Administration API, follow these steps:

1

Create AWS resources.

Follow the procedure described in the $externalFunction documentation.

2

Configure a Service Account.

Create a service account.

Grant this service account the following roles within your Atlas Stream Processing project:

3

Create the Private Link Connection.

The Atlas Administration API provides an endpoint to Create One Private Link

For an $externalFunction Private Link connection, set the following key-value pairs:

Key
Value

vendor

"LAMBDA"

provider

"AWS"

region

The AWS region in which you create the endpoint.

serviceEndpointId

"com.amazonaws.<region>.s3" where <region> is the name of the AWS region in which you create the endpoint.

Use Return All Private Link Connections to check the state of your endpoint. When it reaches a DONE state, note the value of the _id field and proceed to the next step.

4

Create the AWS Lambda connection.

The Atlas Administration API provides an endpoint to Create One Connection.

For an AWS Lambda Private Link connection, set the following key-value pairs:

Key
Value

name

The name you want to give to the connection.

type

"AWS Lambda"

aws.roleArn

Value of the ARN noted in an earlier step.

publicPrivateNetworking.access.type

"PRIVATE_LINK"

publicPrivateNetworking.access.connectionId

The _id value in the response when you create the Private Link connection.

Add an AWS Lambda Private Link Connection through the Atlas CLI

To add an AWS Lambda Private Link connection to your stream processing workspace through the Atlas CLI, follow these steps:

1

Create AWS resources.

Follow the procedure described in the $externalFunction documentation.

2

Configure a Service Account.

Create a service account.

Grant this service account the following roles within your Atlas Stream Processing project:

3

Create the Private Link Connection.

To a Private Link endpoint for a stream processor connection using the Atlas CLI, run the following command:

atlas streams privateLinks create [options]

To learn more about the command syntax and parameters, see the Atlas CLI documentation for atlas streams privateLinks create.

In your configuration file, set the following key-value pairs:

Key
Value

vendor

"LAMBDA"

provider

"AWS"

region

The AWS region in which you create the endpoint.

serviceEndpointId

"com.amazonaws.<region>.s3" where <region> is the name of the AWS region in which you create the endpoint.

Use atlas streams privateLinks list command to check the state of your endpoint. When it reaches a DONE state, note the value of the _id field and proceed to the next step.

4

Create the AWS Lambda connection.

To create one connection for the stream processing workspace you specify using the Atlas CLI, run the following command:

atlas streams connections create [connectionName] [options]

To learn more about the command syntax and parameters, see the Atlas CLI documentation for atlas streams connections create.

In your configuration file, set the following key-value pairs:

Key
Value

name

The name you want to give to the connection.

type

"AWSLambda"

aws.roleArn

Value of the ARN noted in an earlier step.

publicPrivateNetworking.access.type

"PRIVATE_LINK"

publicPrivateNetworking.access.connectionId

The _id value in the response when you create the Private Link connection.

Add an AWS Lambda Private Link Connection through the Atlas UI

To add an AWS Lambda Private Link connection to your stream processing workspace through the Atlas UI, follow these steps:

1

In Atlas, go to the Database & Network Access page for your project.

  1. If it's not already displayed, select the organization that contains your project from the Organizations menu in the navigation bar.

  2. If it's not already displayed, select your project from the Projects menu in the navigation bar.

  3. In the sidebar, click Database & Network Access under the Security heading.

The Database & Network Access page displays.

2

Navigate to the Atlas Stream Processing private endpoint interface.

  1. In the sidebar, click Private Endpoint.

  2. Click the Atlas Stream Processing tab.

    If you have not created an Atlas Stream Processing private endpoint previously, click Create endpoint. If you have, click Add ASP Endpoint.

3

Select your cloud provider and vendor.

  1. Set Cloud Provider to AWS.

  2. Set Vendor to Lambda.

  3. Click Next, enter service details

4

Provide your AWS Lambda endpoint region.

Your endpoint must be in the same region in which you intend to host the stream processors that use it.

5

Set up Unified AWS Access.

Follow the procedure described in Set Up Unified AWS Access.

Note the ARN value in Statement.Principal.AWS to use later in this procedure.

6

In Atlas, go to the Users page.

  1. If it's not already displayed, select your desired organization from the Organizations menu in the navigation bar.

  2. Click All Projects in the sidebar under the Identity & Access section, and select your desired project.

  3. Click Project Identity & Access in the sidebar under the Security section.

The Users page displays.

7

In Atlas, go to the Stream Processing page for your project.

  1. If it's not already displayed, select the organization that contains your project from the Organizations menu in the navigation bar.

  2. If it's not already displayed, select your project from the Projects menu in the navigation bar.

  3. In the sidebar, click Stream Processing under the Streaming Data heading.

The Stream Processing page displays.

8

Go to the Connection Registry.

  1. Locate the overview panel of the stream processing workspace you want to modify and click Configure.

  2. Select the Connection Registry tab.

9

Click + Add connection.

10

Add a new connection.

  1. Select an AWS Lambda connection.

  2. Provide a Connection Name. Each connection name must be unique within a stream processing workspace. This is the name used to reference the connection in Atlas Stream Processing aggregations.

  3. Click the PrivateLink button. Then, toggle Enable PrivateLink networking.

    From the dropdown menu, select the private endpoint you created earlier.

  4. From the AWS IAM Role ARN dropdown, select the ARN of the unified access role you authorized in a prior step.

  5. Click Add connection.

Back
Kinesis Private Link
Next
Google Pub/Sub Private Service Connect
Rate this page