Set up development, staging, and production with dual execution
When everyone develops against production because there is no separate environment to test in.
- Environment
Platform
78 RecipesMicrosoft Fabric
Every Recipe that runs on a Fabric Lakehouse, a Fabric Warehouse, or both. Which of the two a Recipe needs is stated on the Recipe, because it decides whether the work can run where you are.
Get running in your own environment 1
Re-engineer something you own 10
Refactor dbt models without changing consumer output
When one model is hundreds of lines long and nobody dares touch it.
- Transformation
Convert a full-refresh dbt model to incremental and show the runtime delta
A dbt model is correct but a full refresh is too slow or too expensive to run routinely.
- Transformation
Backfill a bounded date range after a logic change without a full refresh
When a definition changed and months of history need recomputing, but a full refresh would take all weekend.
- Transformation
Convert a legacy SQL script or view into a dbt model and prove parity
When a scheduled SQL script is the real production logic and nobody can prove a rebuild would match it.
- Transformation
Convert a stored procedure into a dbt model and prove parity
When the nightly load is a stored procedure nobody fully understands anymore.
- Transformation
Replace a Fivetran or Airbyte connector with a dlt pipeline and reconcile the result
When the connector bill changed shape, or the connector has been broken with a pending fix for weeks.
- Ingestion
Convert a materialized view into a dbt model and preserve its required refresh semantics
When a materialized view refreshes on a schedule nobody wrote down and downstream reports assume that cadence.
- Transformation
Convert a notebook transformation into a dbt model and prove parity
When a transformation only exists as a notebook someone runs by hand before the numbers go out.
- Transformation
Convert a Spark ingestion notebook into a dlt pipeline and prove landed parity
When a Spark notebook is the only thing that lands a source into bronze and nobody can run it unattended.
- Ingestion
Convert a scalar SQL function into a dbt macro and prove equivalence
When a scalar SQL function is called from a dozen models and lives outside version control.
- Transformation
Build something that is not there yet 60
Land a SaaS or REST API into bronze with an incremental cursor and schema contract
When a script is about to be written to pull the same API every night and nobody has decided what happens when a field changes.
- Ingestion
Load a database table set into bronze with a bounded incremental strategy and landed-data proof
When someone is about to write a Python script to copy a database table by hand.
- Ingestion
Load a recurring file drop into bronze with file-completeness and schema controls
When a folder of files lands on a schedule and nobody checks whether a file is missing before the build runs.
- Ingestion
Promote a spreadsheet or CSV to a governed, tested table
When the spreadsheet everyone depends on moved a column again and nothing downstream noticed until it broke.
- Ingestion
Author an incremental dbt model with its contract and prove idempotency
When a fact table is too big to rebuild from scratch and has to be incremental from the first version.
- Transformation
Add history to a slowly changing dimension with a dbt snapshot
When a customer's segment changes and the history rewrites itself instead of tracking the change.
- Transformation
Declare source freshness SLAs and make stale data fail before downstream work
When stakeholders notice yesterday's data before the data engineer does.
- Data quality
Define governed metrics as a MetricFlow semantic model over a gold mart
When revenue is defined six different ways across six dashboards and nobody can say which one is right.
- Semantic layer
Publish a Direct Lake semantic model over governed gold tables
When the gold marts exist and the BI team is about to rebuild the star schema by hand in Power BI.
- Semantic layer
Author a Fabric Data Pipeline that sequences ingestion, dbt, and downstream refresh as committed code
When the pipeline was built by clicking in the workspace and lives nowhere a diff can show what changed.
- Orchestration
Gate a consumer pipeline on upstream data readiness instead of a clock
When the mart runs at a fixed hour whether or not the upstream load actually finished.
- Orchestration
Tag PII columns, apply masking, and prove the masked view to a lower-privilege role
When an erasure request arrives and nobody can list which tables hold personal data.
- Governance and cost
Tie the general ledger to its subledgers and classify every break
When month-end stalls every period because the GL doesn't tie to the AR and AP subledgers.
- Transformation
- Finance
Produce the trial balance and close pack as code
When the close pack is rebuilt by hand in a spreadsheet every period.
- Transformation
- Finance
Age receivables and compute DSO from open invoices as of any date
When the aging report is rebuilt by hand each month and never reconciles to the ledger.
- Transformation
- Finance
Age payables from open items as of any date and reconcile the total
When AP can't say how much sits past terms without pulling a manual extract from the ledger.
- Transformation
- Finance
Detect duplicate invoice candidates from explicit matching rules before payment
When AP paid a duplicate invoice and only found out after the payment run cleared.
- Data quality
- Finance
Compare budget and forecast to actuals at cost-center grain
When the budget lives in a spreadsheet and variance analysis is a monthly copy-paste exercise.
- Transformation
- Finance
Generate the revenue-recognition schedule and deferred-revenue roll-forward from contracts
When contracts, invoices, and recognized revenue live in three systems and the deferred-revenue roll-forward doesn't tie.
- Transformation
- Finance
Build the headcount balance and its monthly roll-forward
When HR, finance, and the board deck each report a different headcount for the same date.
- Transformation
- People
Measure attrition and tenure by hire cohort
When leadership asks whether attrition is rising and where, and the answer takes a week to produce.
- Transformation
- People
Reconcile payroll to the general ledger every pay period
When payroll expense in the GL doesn't match the payroll register and nobody can say why by how much.
- Transformation
- People
Check pay against bands and report pay gaps at an aggregate grain
When a pay-equity review is due and compensation data can't leave HR unmasked.
- Governance and cost
- People
Snapshot the opportunity pipeline daily and measure stage conversion and slippage
When pipeline coverage changes every time someone re-runs the CRM report because history isn't kept.
- Transformation
- Revenue operations
Tie bookings to billings to cash and classify every break
When sales, finance, and the bank each report a different number for the same quarter's business.
- Transformation
- Revenue operations
Compute quota attainment and commission-eligible bookings from explicit plan rules
When comp plans are calculated in spreadsheets and a payout dispute surfaces after the fact.
- Transformation
- Revenue operations
Reconcile inventory positions across warehouse, ERP, and physical counts
When on-hand quantity disagrees between the warehouse system and the ERP and nobody notices until the annual count.
- Transformation
- Supply chain and operations
Measure on-time-in-full delivery by customer, carrier, and plant
When customers complain about late deliveries but OTIF differs depending on who computes it.
- Transformation
- Supply chain and operations
Build the procurement spend cube and flag off-contract spend
When procurement can't answer how much the company spends with a vendor across entities without a manual pull.
- Transformation
- Supply chain and operations
Allocate cloud and platform spend to teams and flag untagged cost
When the cloud bill grew sharply month over month and nobody can attribute the increase to a team or product.
- Governance and cost
- IT and FinOps
Measure SaaS license utilization and shelfware before renewal
When a SaaS renewal is due in weeks and nobody knows how many of the paid seats are actually used.
- Governance and cost
- IT and FinOps
Track ticket SLA attainment and backlog aging outside the vendor dashboard
When support reports SLA compliance from a vendor dashboard nobody on the data team trusts or can reproduce.
- Transformation
- Service
Standardize names and addresses and mint deterministic match keys
When the same customer appears three different ways across systems and mail bounces on half the addresses.
- Transformation
Deduplicate customers into a golden record with a source crosswalk
When three source systems each carry their own customer id and every report double-counts the same person.
- Transformation
Conform product and SKU hierarchies across systems
When category roll-ups never agree because the ERP, the e-commerce platform and the marketing catalog each keep their own hierarchy.
- Transformation
Resolve B2B account hierarchies and roll measures to the ultimate parent
When revenue by customer is split across a dozen subsidiaries and nobody sees the group total.
- Transformation
Build retention cohorts and a churn feature table
When "what's our churn rate" gets three different answers depending on who is asked.
- Transformation
Score customers with RFM and maintain segments incrementally
When segmentation runs in an analyst's notebook and nobody else can rerun it.
- Transformation
Compute historical customer lifetime value with margin
When the acquisition-payback conversation lacks an LTV figure anyone trusts.
- Transformation
Unify consent and communication preferences with auditable latest-wins logic
When a customer who opted out of email still gets a marketing send from a different system.
- Governance and cost
Sessionize event streams and build reproducible funnels from batch exports
When product analytics can't be reproduced outside the vendor's own dashboard.
- Transformation
Attribute conversions to touchpoints under several models side by side
When marketing and sales each have a spreadsheet proving their own channel drove the same revenue.
- Transformation
- Revenue operations
Normalize multi-currency amounts to a reporting currency with as-of rates
When reports mix currencies because each source system stored whatever rate it had on hand.
- Transformation
Build the calendar and fiscal-period dimension every mart shares
When week boundaries differ between two reports because each model computes its own calendar logic.
- Transformation
Build sell-through and stockout risk by store, SKU, and day
When sell-through and days-of-supply are recomputed in a spreadsheet from three separate exports every week.
- Transformation
- Retail
Measure trade-promotion lift against an explicit baseline
When trade spend is the second-largest cost line and nobody can say what any promotion actually paid back.
- Transformation
- Consumer goods
Build loan delinquency roll-rates and vintage curves
When roll-rates get rebuilt every quarter from a query nobody on the current team owns.
- Transformation
- Banking
Build AML monitoring features at account-day grain
When the monitoring vendor wants governed features and the team hand-writes them with no tests behind them.
- Transformation
- Banking
Build paid and incurred claims loss triangles by accident and development period
When actuarial rebuilds the triangles from a fresh claims extract every quarter.
- Transformation
- Insurance
Reconcile claims denials and remittances by payer
When revenue cycle can't see denial rates by payer without a manual claim-by-claim match.
- Transformation
- Healthcare
Build a thirty-day readmission cohort with explicit exclusions
When every department applies a different exclusion list before reporting the readmission rate.
- Transformation
- Healthcare
Build clinical-trial enrollment and site-performance models
When enrollment against target lives in a slide deck that gets updated by hand from EDC exports.
- Transformation
- Life sciences
Build overall equipment effectiveness and a downtime Pareto
When OEE comes from a spreadsheet a shift supervisor fills in by hand.
- Transformation
- Manufacturing
Reconcile meter reads to bills and quantify unbilled energy
When metered and billed consumption diverge and nobody can say how much of the gap is unbilled energy.
- Transformation
- Utilities
Land and aggregate call-detail batches into subscriber-day usage with manifest completeness
When call-detail files arrive daily and a missing or short file goes unnoticed until someone downstream complains.
- Ingestion
- Telecom
Build the MRR waterfall and net revenue retention
When net revenue retention depends on which spreadsheet happens to be open when the board asks.
- Transformation
- SaaS
Build occupancy, ADR, and RevPAR by property and day
When revenue management pulls occupancy and RevPAR nightly and the numbers don't match finance's month-end figures.
- Transformation
- Hospitality
Track grant funds from award through obligation, spend, and drawdown
When awards, obligations, and spend are tracked in separate spreadsheets that never reconcile to each other.
- Transformation
- Public sector
Build fleet utilization by vehicle and day from explicit utilization rules
When operations can't say which vehicles are underused without a manual pull against the trip log.
- Transformation
- Logistics
Build on-time transport performance by lane and day from trip events
When on-time percent by lane gets recalculated with a different tolerance every time someone asks.
- Transformation
- Logistics
Prove a change is safe before you ship 1
Prove an existing dbt change is safe to merge without modifying it
When a pull request changes dbt models and nobody wants to merge it on faith.
- Data quality
Explain a number after you shipped 1
Attribute warehouse or capacity spend to the models and jobs that caused it
When the bill jumped sharply and nobody can name which model caused it.
- Governance and cost
- IT and FinOps
Work across more than one platform 5
Move a dbt project to a new destination and prove parity before cutover
When the warehouse is changing and the dbt project has to follow it.
- Transformation
Assess a Synapse dedicated pool or SSIS estate for a rebuild on Fabric
When Fabric is the mandate and the estate is hundreds of packages nobody wants to open.
- Governance and cost
Make a dbt macro work on DuckDB and Microsoft Fabric
When a macro's SQL is written for one dialect and silently produces wrong results on the other.
- Transformation
Convert a scheduled data job to another platform without changing its required behavior
When a scheduled job needs to run on a new platform without anyone renegotiating what it is supposed to do.
- Orchestration
Reconcile equivalent data across two live platforms before cutover
When two platforms are running the same logic in parallel and nobody has proven they agree.
- Data quality