Master data Data quality

Data quality, run by agents and enforced on the golden record.

Every rule in Lima is a small agent with a scope, a schedule and a level of autonomy it has earned.

Profileshape of the data01profiler agentCheckall applicable rules02rule agentsProposefix with evidence03corrector agentDecideauto, or a person04guardrails · stewardWrite backto the source05connector · ackLearnfrom every decision06model · per actionTHE LOOP, ON EVERY RECORD OF EVERY DOMAINeach accepted or rejected fix tunes the next proposalGolden record: in flow until every applicable rule passes, then promoted; quarantined the moment one fails laterin flow · golden · quarantined — the state is visible at every door: grid, API, SQL, write-backRules are the smallest agentswhat · where · when, in a sentenceAutonomy is earned per action typeL0 observe → L3 act within limitsEvery step lands in the audit trailwho or what, why, before, after, ack
The loop on every record of every domain: profile, check, propose, decide, write back, learn. The golden record sits underneath with its three states.
6
quality dimensions measured per record, source and domain
product
4
autonomy levels, from observe to act within limits
product
96%
of proposed corrections accepted by stewards on the showcase estate
showcase
41 → 6
alerts a week after learned patterns replaced fixed thresholds
showcase
12
pages in this section
catalogue
In one paragraph

What this section adds to master data management

The capability pages explain how golden records are assembled, structured, governed and served. This section explains how they are kept correct.

A golden record is assembled from its sources once; it is kept correct every day. That work is a loop: measure the data, check it against rules, propose fixes, decide, apply and write back, learn. Lima runs the loop with agents. A rule agent is the smallest kind: one check, bound to a place and a schedule, written as a sentence. Service agents do the wider jobs: profiling a source, finding duplicates, verifying a value against an outside registry, correcting a field, watching for anomalies.

Agents act within a level of autonomy they have earned. At the first level they observe and report; at the last they act alone within a budget while every guard holds. Promotion between levels runs through a gate: a passing evaluation on golden test cases, a wired escalation route and a human stamp. Every action, at every level, lands in the audit trail with its evidence.

Enforcement closes the loop. A record is in flow while checks run, golden once every applicable rule passes, and quarantined the moment a rule fails later. The grid, the headless API, SQL and the write-back each behave according to that state, and quality contracts with consuming systems say what happens when a threshold is breached.

MeasureSix dimensions scored per record, column, source and domain, before any rule is written.
The pages

Concepts first, then the mechanics, then how to start

The six dimensions

Completeness, validity, consistency, uniqueness, accuracy and timeliness, each with the question it answers and how it is scored on master data.

Concept →

A rule is the smallest agent

What, where and when in one sentence; the eight blocks every agent has; dry runs on live rows.

Concept →

The quality services

Profiler, duplicate finder, verifier, corrector, monitor: what each does, what it produces, what it may do alone.

Concept →

Autonomy is earned

The four levels, the promotion gate, guardrails and policy floors, and how a level is taken back.

Concept →

Configuration

Packs, scope, thresholds, schedules, owners, escalation routes and contracts, and how drift is tracked.

Mechanics →

Profiling and scoring

Column scores, cross-source comparison, trends and business impact, before and after rules.

Mechanics →

Data correction

From finding to learned outcome: evidence, proposal, decision, the change, the write-back and its acknowledgement.

Mechanics →

Enforcement on the golden record

In flow, golden, quarantined; the publish gate; what each door does; quality contracts with consumers.

Mechanics →

Verification

Tax ids, registrations, addresses and bank details checked against outside services, with the evidence stored.

Mechanics →

Monitoring

Volume, freshness, structure and values watched on every source; learned patterns; root cause through lineage.

Mechanics →

Quality at the source

The same rules before save at every entry point, so a record is born clean.

Mechanics →

The first week

Profile on Monday, enforce on Friday; the scorecard the owner reads on day 30.

How to start →
How it relates to the capabilities

Quality uses the rules, the stewardship queue and the audit trail; it adds the agents, the scoring and the gate

Already on the capability pagesWhat this section adds
Rules at three levels: the language for column, row and business rulesEach rule runs as an agent with a scope, a schedule, a level and an evaluation; packs stamp rules across a scope
Stewardship: the queue sorted by confidence and value at stakeWhere the proposals come from, what evidence they carry, and which of them the agents may apply alone
AI-assisted: models propose, rules validate, people approveThe four autonomy levels in detail, the promotion gate, guardrails and policy floors
Golden records: match, survive, cross-reference, unmergeThe three states of a record and the gate that promotes it; cross-source scores feeding survivorship
Audit trail: every change and sensitive read, append-onlyEvery agent action with its guard verdicts, and the write-back acknowledgements beside each change
Integration and sync: write-back through released interfacesCorrections as the main writer, with the acknowledgement stored per system and per field
Proof

What has run, with its evidence label

Questions

Is this a separate product?

It is part of Lima master data. The rules language, the steward queue, the audit trail and the connectors are the same ones the capability pages describe; this section adds the agents that run the rules, the scoring, the correction loop and the enforcement gate.

Do the agents change data on their own?

Only at the levels they have earned, per action type, inside guardrails and a daily budget, with every action in the audit trail. Most agents run at the propose level; the ones promoted to act alone got there through a passing evaluation and a human stamp, and the level can be taken back at any time.

Where does the AI model sit?

Inside Lima's own environment. Definitions can be co-drafted with an outside model, and metadata may cross that boundary; row data stays inside. The AI-assisted page has the boundary in full.

How does this show up for an analyst?

It answers the 'data quality and cleansing' and 'stewardship and governance support' duties of the market definition, with the agent model as the distinctive part; the analyst guide maps the vocabulary.

See quality run on your own domain

Bring one domain and two systems. In a week the sources are profiled, the ten costliest fields are under rules, the first corrections are written back with their acknowledgements and the publish gate is on.