Data Pipelines and Dafaflow Gen2 · Learn Microsoft Fabric

Data Pipelines and Dafaflow Gen2

I know most of you will be aware of the limitations of Pipelines inside Fabric - in that not all items are currently supported, specifically Dataflow Gen2 unfortunately. I wanted to share some feedback I have form the MS Development team on where they are with this and the timelines around anything changing. I asked from them to allow me to decide on where my Data Engineers should invest their time - you can draw your own conclusions on priorities based on the same information :_

Dataflow Gen 2 is not currently supported in deployment pipelines. You cannot use the standard Git integration either at present. The Git integration is likely to arrive in Q4 CY25.

In the meantime, it is recommended to do something like the following

Export the Dataflow as a Template:

Open the Dataflow Gen2 you want to move.
Use the Export template option in the toolbar to save the dataflow as a PQT file (Power Query Template) to your local machine.
Check this into version control.
Prepare the Target Workspace: Open the target workspace where you want to deploy the dataflow. Create a new Dataflow Gen2 in this workspace.
Import the Template: In the new Dataflow Gen2, select the option to Import from Power Query template. Upload the PQT file you exported earlier.
Adjust Connections and Settings: Update any data source connections if necessary. This might involve changing workspace IDs or other identifiers to match the new environment. Ensure that all steps in the dataflow are correctly configured to point to the appropriate resources in the new workspace.
Publish the Dataflow: Once all adjustments are made, publish the dataflow in the new workspace.

I appreciate this is a not ideal, but we are making efforts to bring DFGen2 in line with the rest of the deployment pipeline capability.

4 comments