Orchestrate continuous pipelines with continuous jobs
docs.databricks.com databricks.com
This is what was read here when it was published. databricks.com no longer carries it in what it publishes now.
Listen to this summary
You can now run a continuous Lakeflow pipeline with a continuous job. When a continuous job orchestrates a pipeline, the job determines the execution mode, and the pipeline can use job-level features such as serverless Standard performance mode and additional notification destinations. Databricks recommends this pattern over the pipeline's built-in continuous setting, which is not being removed.
See Run a continuous pipeline with a continuous job and Run a pipeline continuously with a continuous job.
More ways to use this
Open on another device
Scan to open this page. Your saved notes and account access are not included.