Docs Menu
Docs Home
/
MongoDB Atlas
/
MongoDB Atlas Data Lake
/
Manage Data Lake Pipeline

Pause Data Ingestion for Your Data Lake Pipeline - Preview

On this page

  • Pause Data Ingestion for Your Data Lake Pipeline
  • Resume Data Ingestion for Your Data Lake Pipeline

You can pause and resume ingestion of snapshot data from the Atlas cluster to Atlas Data Lake datasets. You can't pause on-demand ingestion of snapshot data.

Pause Data Ingestion for Your Data Lake Pipeline

When you pause your Data Lake pipeline, Atlas doesn't ingest new datasets. You can continue to query previous snapshots from which data has been ingested.

To pause the specified data lake pipeline for your project using the Atlas CLI, run the following command:

atlas accessLists create [entry] [options]

To learn more about the command syntax and parameters, see the Atlas CLI documentation for atlas accessLists create.

Tip

See: Related Links

To pause a pipeline through the API, send a POST request to the Data Lake pause endpoint with the name of the pipeline for which you want to pause the ingestion schedule. To learn more about the API syntax and parameters for the pause endpoint, see Pause One Data Lake Pipeline.

To pause a pipeline from the Atlas UI:

1

Log in to MongoDB Atlas.

2

Go to Atlas Data Lake in the Atlas UI.

  1. If it's not already displayed, select the organization that contains your project from the Organizations menu in the navigation bar.

  2. If it's not already displayed, select your project from the Projects menu in the navigation bar.

  3. In the sidebar, click Data Lake under the Deployment heading.

3

Click the pause button for the pipeline that you wish to pause.

4

Click Confirm in the Pause Ingestion confirmation window.

When you pause your Data Lake pipeline, the Last Updated column for the pipeline in the Atlas UI shows the status for the pipeline as Paused.

Resume Data Ingestion for Your Data Lake Pipeline

When you resume data ingestion for a paused Atlas Data Lake pipeline, Atlas begins to take snapshots, which are then ingested in to your Data Lake datasets.

To start the specified data lake pipeline for your project using the Atlas CLI, run the following command:

atlas dataLakePipelines start <pipelineName> [options]

To learn more about the command syntax and parameters, see the Atlas CLI documentation for atlas dataLakePipelines start.

Tip

See: Related Links

To resume data ingestion for a pipeline from the API, send a POST request to the Data Lake resume endpoint with the name of the pipeline for which you want to resume the data ingestion. To learn more about the API syntax and parameters for the resume endpoint, see Resume One Data Lake Pipeline.

To resume data ingestion from the Atlas UI:

1

Log in to MongoDB Atlas.

2

Go to Atlas Data Lake in the Atlas UI.

  1. If it's not already displayed, select the organization that contains your project from the Organizations menu in the navigation bar.

  2. If it's not already displayed, select your project from the Projects menu in the navigation bar.

  3. In the sidebar, click Data Lake under the Deployment heading.

3

Click in the Actions column for the pipeline that you wish to resume and select Resume Ingestion.

4

Click Confirm in the Resume Ingestion confirmation window.

When you resume data ingestion for a paused Atlas Data Lake pipeline, the Last Run Time column for the pipeline in the Atlas UI shows the date and time when data ingestion for the pipeline resumed.

Back

Ingest Data On Demand