Notably, the new Lakeflow Declarative Pipelines capabilities allow data engineers to build end-to-end production pipelines in SQL or Python without having to manage infrastructure.

The second part is LakeFlow Pipelines, which is essentially a version of Databricks’ existing Delta Live Tables framework for implementing data transformation and ETL in either SQL or Python.

Prophecy has launched an integration for Databricks, one that will allow users of the lakehouse to build data pipelines more easily.

Getting high-quality data to the right places accelerates the path to building intelligent applications," said Ali Ghodsi, Co-founder and CEO at Databricks. "Lakeflow Designer makes it possible for ...

Lakeflow : Databricks veut unifier sa gestion des pipelines de données Alors que les fonctions d’ingestion, de transformation de données et de gestion des tâches d’ingénierie de données sont séparées ...

It only took 60 minutes to build this AI agent." The Agent Bricks are now available in beta. Reliable ETL pipelines via drag-and-drop Databricks has also announced the preview of Lakeflow Designer.

Who needs rewrites? This metadata-powered architecture fuses AI and ETL so smoothly, it turns pipelines into self-evolving engines of insight.