Convert an ADF mapping data flow into dlt and dbt and prove parity
Order or customer reporting still comes from an Azure Data Factory mapping data flow whose logic lives only on the ADF canvas, with no tests or review.
- Transformation
Larger outcome
9 RecipesLegacy and platform re-engineering
Recipes for moving existing SQL, notebooks, connectors and estates onto dbt, dlt and Fabric, from assessing what a move would take to converting each piece.
Assess a Synapse dedicated pool or SSIS estate for a Fabric rebuild and recommend whether to go
A Synapse dedicated SQL pool or a set of SSIS packages is due to move to Fabric, and nobody can say what is in it, what each piece would take or what stops it.
- Re-engineering
Convert a legacy SQL script or view into a dbt model and prove parity
A report or table is still produced by a hand-run SQL script or a database view outside dbt, with no tests, lineage or review.
- Transformation
Replace a Fivetran or Airbyte connector with a dlt pipeline and reconcile the result
A managed connector's bill changed shape, or it broke and the vendor fix has been pending for weeks, and the team wants the load in code it owns.
- Ingestion
Convert a materialized view into a dbt model and preserve its required refresh semantics
Warehouse logic lives in a materialized view that nobody can test, review or trace, and the team wants it in the dbt project.
- Transformation
Convert a notebook transformation into a dbt model and prove parity
A table or report is still produced by running a notebook by hand, pulling warehouse data into dataframes, with no tests, lineage or review.
- Transformation
Convert a scalar SQL function into a dbt macro and prove equivalence
Models or views call a scalar function created directly in the warehouse, so dbt cannot see the dependency and changes to it are not reviewed or tested.
- Transformation
Convert a Spark ingestion notebook into a dlt pipeline and reconcile what it lands
A Spark notebook lands raw files into bronze, and the team wants that load as tested pipeline code without keeping a cluster for it.
- Ingestion
Convert a stored procedure into a dbt model and prove parity
A nightly load is a stored procedure nobody fully understands, and it inserts, updates, deletes or merges rows in a table people depend on.
- Transformation