Skip to content
Vibedata

Build something that is not there yet

Deduplicate customers into a golden record with a source crosswalk

  • When three source systems each carry their own customer id and every report double-counts the same person.
  • When a merge run by hand missed a match rule and quietly combined two different customers.

Deduplicate customer records from multiple source systems into a golden record, with match rules applied in a stated precedence and a crosswalk from every source id to its golden id. Survivorship rules decide the field values that win; assembling a full customer view on top of this crosswalk is a separate outcome.

Area
Transformation
Runs on
  • Microsoft Fabric Lakehouse
  • Microsoft Fabric Warehouse
  • MotherDuck
  • DuckDB
Built with
  • dbt
Industry
Banking, Insurance, Healthcare, Retail
Readiness
SupportedEverything this Recipe composes runs today, without a case that proves this exact shape.
Before you start
needs survivorship rules agreed per attribute

Sample This Recipe has not been materialized in the Cookbook repository yet. Its trigger, description, prompt, agent guidance and acceptance conditions, and the explanation below, are prototype drafts. Its name, job, area and readiness come from the reconciled Cookbook seed snapshot. Readiness is a separate question from this one: it says whether the capability exists, not whether the writing has been reviewed.

Use this Recipe

Use the VibeData Recipe `identity-golden-record-crosswalk` at https://getvibedata.ai/cookbook/identity-golden-record-crosswalk Read the Recipe and execute it in the context of the current Intent.

Recipe id identity-golden-record-crosswalk · Not yet materialized in the Cookbook repository, so the pointer addresses this page.

Verified by

What has to be observably true before this Recipe is finished.

  • every source system id maps to exactly one golden id
  • no merge combines two records with conflicting attributes unless a survivorship rule covers that attribute
  • the match rules are applied in the stated precedence and that precedence is recorded
  • a sample of merged customers matches the expected golden record by hand
Recipe promptThe task specification the agent reads. Reference only — it is not what you copy.
Deliver: Deduplicate customers into a golden record with a source crosswalk.

Deduplicate customer records from multiple source systems into a golden record, with match rules applied in a stated precedence and a crosswalk from every source id to its golden id. Survivorship rules decide the field values that win; assembling a full customer view on top of this crosswalk is a separate outcome.

Execute inside the current Intent. Its Domain, repository, platform, environment and attached sources are the context for this work — read them rather than asking for them.

The work is done when:
- every source system id maps to exactly one golden id
- no merge combines two records with conflicting attributes unless a survivorship rule covers that attribute
- the match rules are applied in the stated precedence and that precedence is recorded
- a sample of merged customers matches the expected golden record by hand

Report the evidence for each condition above with the result. A condition you cannot meet is something to say, not something to work around.
Agent guidanceHow the agent approaches the work, and what it will not do.

Profile the inputs the grain, joins and measures actually depend on before proposing a model. Put the design up for review — grain first — then build in an isolated copy with tests and documentation landing beside the model rather than after it.

Composes

  • dbt model authoring and layering
  • dbt in the project
  • isolated-copy execution and gate verification

Asks first

Semantic decisions the Intent cannot supply. Never context Studio already holds.

  • which Fabric target this work lands on, when the Domain carries both a Lakehouse and a Warehouse

Guardrails

  • Build in an isolated copy. Production is read, never written.

What you need

  • Microsoft Fabric Lakehouse, Microsoft Fabric Warehouse, MotherDuck, or DuckDB.
  • A dbt project you can build, and read access to the models it starts from.
  • dbt in the project, or the intent to add it.
  • Needs survivorship rules agreed per attribute.

How it goes

  1. State the outcome in one sentence, in the language the request arrived in.
  2. Let it profile the inputs the grain, the joins and the measures actually depend on.
  3. Review the design. Disagreeing about grain here costs a sentence; after the model exists it costs a rewrite.
  4. Let it build in an isolated copy, with the tests and the documentation landing beside the model rather than after it.
  5. Read the acceptance conditions against the run.

What you end up with

The deliverable, in your own repository, as transformation work a reviewer who knows the project reads as native to it. Alongside it, the evidence for every one of the acceptance conditions above — which is the part that is still there in three weeks when somebody asks.