Data quality Correction

Every correction is a ticket, and every ticket ends with an acknowledgement.

A finding becomes a ticket with the evidence snapshot; the corrector proposes a fix with its basis and a confidence; a person or, within limits, the agent decides; the golden record changes and is versioned; the agreed value is written back to the owning system and the acknowledgement is stored; and the decision teaches the model.

Findingrule + evidence01Proposalfix · confidence02Decisionauto, or a person03Golden recordchanged · versioned04Write-backto the source05Acknowledgedack stored06Learnedfeeds the model07ONE TICKET, SEVEN STEPSthe ticket for supplier 100482 · countrybefore: “United Kingdom”after: “GB”basis: ISO 3166 list · 1,204 identical fixes accepted · 0.99decided by: corrector agent at L3, inside its budget of 500 a dayfour-eyes check skipped: the field is publicwrite-backSAP: BAPI change · ack 14:02:11 · doc 4711CRM: REST PATCH · ack 14:02:12golden version 7 → 8 · ledger entry #88,102both acknowledgements stored beside the changeRejected fixes teach as much as accepted ones“NL” kept as NL: the model stops proposing NetherlandsAnything can be undonerollback restores the version; unmerge restores the recordsbulk corrections run the same seven steps per row, with one approval for the set and one ledger entry per row
One ticket from finding to learned outcome, with the write-back to SAP and the CRM acknowledged and the ledger entries beside the change.
7
steps per correction, each in the ledger
product
14,200
corrections in a month on the showcase estate
showcase
96%
accepted by stewards
showcase
100%
of writes complete only on the source's acknowledgement
product
The seven steps

What happens, and what is recorded

StepWhat happensRecorded
01 FindingA rule agent fails a record and takes an evidence snapshot: the values seen, the rule version, the runFinding id, rule, evidence
02 ProposalThe corrector drafts a fix with its basis (a list, a winning source, a verification result, a learned mapping) and a confidenceBefore, after, basis, confidence
03 DecisionAt L1 or L2 a person decides on the escalation screen; at L3 the agent decides when every guard holdsWho or what, the guard verdicts, the time
04 Golden recordThe value changes; the record gets a new version; consumers see the change at the next readVersion n → n+1, ledger entry
05 Write-backThe agreed value goes to each owning system through its released interface, per fieldInterface, request, attempts
06 AcknowledgedThe source confirms; the change is complete only now, and the golden tag is setAcknowledgement per system, document numbers
07 LearnedAccepted and rejected proposals train the model for that action typeTraining example, model version
The queue

What a steward sees at 08:30

Sorted by confidence and by value at stake, with the explainer's reason on each ticket.

supplier 100482 · countryUnited Kingdom → GB99%ISO 3166 · 1,204 identical fixes accepted · applied at L3 within budget
supplier 100913 · bank accountGB29 NWBK ···· 1234 → GB29 NWBK ···· 129891%verifier mismatch against the bank · four eyes → treasury
material 7710-22 · lead time0 → 2184%supplier's quoted lead time on the info record · planning pack
supplier 100557 · registered nameAcme Mfg → Acme Manufacturing Ltd97%company registry · exact match on registration number
dispatch DC-8841 · site codeMan DC 01 → DC-MAN-0194%learned mapping · 48 variants seen for 12 sites
supplier 100224 · countryXX-UNKNOWN-REG → no proposalno basis in any source or list · manual

Six tickets from the showcase queue. The first was applied by the agent inside its budget; the second waits for two people in treasury; the last has no proposal and goes to the steward as it is.

Bulk corrections

One approval for the set, one ledger entry per row

Identical fixes are grouped: 1,204 records with “United Kingdom” in the country field become one proposal, “United Kingdom → GB”, with the count, the confidence and a sample. The steward approves the set once, or the agent applies it at L3 within its budget. Each row still gets its own ledger entry, its own version and its own write-back acknowledgement, so the audit trail reads per record.

A set is capped by the daily budget of the action type; a set larger than the budget runs across days and reports progress. A set whose acceptance falls during review is paused and returned to the steward.

Rollback restores a record to a previous version, with the write-back reversed through the same interface and acknowledged in the same way. Unmerge restores the source records of a merged golden record and moves the transactions back. Both are ordinary actions with their own ledger entries, so a mistaken bulk correction is undone as a set.

Corrections that touch a field with the four-eyes mark go to two people whatever the level; the corrector prepares the evidence and the two people decide. The verification page covers the treasury pattern for bank details.

Learning

Accepted and rejected proposals tune the next ones

Every decision is a training example for the action type: an accepted country mapping raises the confidence of that mapping; a rejected one lowers it and adds the steward's reason. On the showcase estate the country-standardisation model went from 88% confidence on day one to 99.9% on day ninety, from 141 decisions a day.

Learning is per estate, on the estate's own data, inside Lima's environment. Definitions can be co-drafted with an outside model; row data stays inside. A model version is recorded on every proposal, so a change in behaviour can be traced to the version that caused it.

88% → 99.9%

confidence in ninety days

Country-code standardisation on the showcase estate, from the stewards' own decisions.

showcase estate
4%

of proposals rejected

The rejected ones carry the reason and train the model; a rising rejection rate demotes the agent by policy.

showcase estate
74%

less manual remediation effort

Reported for the illustrative consumer-goods estate after ninety days.

illustrative
1

model version on every proposal

So a change in behaviour is traceable to the version that caused it.

product
Questions

What if the source rejects the write-back?

The change stays pending on the golden record with the rejection reason, retries on the connector's schedule, and escalates to the application owner after the retry budget. Consumers reading the golden record see the pending state.

Can a correction be made directly in the source instead?

Yes, and the next read picks it up: the finding closes when the rule passes on the new value, whichever system it was corrected in. The at-the-source page covers corrections at creation.

How are conflicting proposals handled?

Two agents proposing different values for one field produce one ticket with both proposals; the decision goes to a person, or to a weighted arbitration inside a spread the owner has set, with the outcome recorded.

Is there an approval workflow?

The escalation route is the workflow: a screen network with hops and SLAs, where the ticket carries its evidence and accumulated fix from screen to screen. The SmartApps pages describe the screen networks in full.

See quality run on your own domain

Bring one domain and two systems. In a week the sources are profiled, the ten costliest fields are under rules, the first corrections are written back with their acknowledgements and the publish gate is on.