Lima Backbone reads SAP S/4HANA through released CDS views, types the data correctly on landing, writes it into Google BigQuery as raw, conformed and history datasets, and keeps it current from the source’s changes. Every run ends with a row count and a control total per table.
Choosing partition and cluster keys so MERGE stays cheap on large tables.
The first load is assembled from these objects through released CDS views. Change capture (delta-enabled CDS views, change pointers, table-level change capture) keeps the daily volume small afterwards.
| Planning object | Source objects | Destination in Google BigQuery |
|---|---|---|
| Items | I_Product · MARA · MARC | raw dataset → conformed dataset (MERGE) |
| Bills of material | STKO · STPO · MAST | raw dataset → conformed dataset (MERGE) |
| Routings and production versions | PLKO · PLPO · MKAL | raw dataset → conformed dataset (MERGE) |
| Stock by status | MATDOC · MARD | raw dataset → conformed dataset (MERGE) |
| Open purchase orders | EKKO · EKPO · EKET | raw dataset → conformed dataset (MERGE) |
| Open sales orders | VBAK · VBAP · VBEP | raw dataset → conformed dataset (MERGE) |
| Production orders | AFKO · AFPO | raw dataset → conformed dataset (MERGE) |
| Planned independent requirements | PBIM · PBED | raw dataset → conformed dataset (MERGE) |
| Customers and suppliers | KNA1 · LFA1 · BUT000 | raw dataset → conformed dataset (MERGE) |
| Calendars | TFACD · T001W | raw dataset → conformed dataset (MERGE) |
Released CDS views, table reads through a named function module, BAPIs, change pointers and extractor delta queues. No ODP RFC (SAP Note 3255746), no RFC_READ_TABLE in production (SAP Note 382318), no reading of the HANA database log (SAP Note 2971304). No add-on is installed in SAP.
Every check either passes a row or turns it into an exception record with an owner. Nothing is dropped silently.
| Check | Kind | What it catches, with an example |
|---|---|---|
| Types set from the source | typing | SAP dates and times stored as text become dates and times; currency decimals shifted by the currency's rule |
| Keys complete and unique | keys | client or organisation columns kept in the key; zero-padded keys preserved |
| Deletes applied | consistency | rows deleted in the source are marked or removed in the copy |
| Late changes land in order | consistency | a change that arrives after a later one is applied by its source timestamp |
| Wide and cluster tables complete | completeness | every column of a wide table lands; cluster tables read through the released module |
| Partitions cover the range | completeness | every date partition present; gaps reported |
| Counts and control totals match | reconciliation | rows and amounts per table compared between source and target |
| Schema changes noticed | drift | a new or changed column is flagged before it breaks a downstream query |
After the first landing, Google BigQuery receives the source's changes: delta-enabled CDS views, change pointers, table-level change capture. A migration month costs the same as a quiet month on the same tier.
The tables you name, landed in Google BigQuery with types set, keys complete and a count and control total per table, then kept current. Scoped in one call.
Offers and principles →Two weeks on your largest tables: terabytes moved, rows per minute, reconciliation variance and cost per terabyte against your current tool.
The offer →Days for the first tables; a full-history migration is sized by table count and volume, and read in partitions inside the run windows your administrators allow.
Counts per step, the check that stopped a row, the owner and the replay point, and the lineage of any number back to its source column.
Your team, on the schedule you set, with the same report after every run; or your systems integrator; or Lima's team under the subscription.
One call scopes the dataset, the run window and the tier. The reconciliation report at the end is the acceptance test.