Platform Lima Backbone

The data backbone for your enterprise systems.

Lima Backbone moves data between the systems you run, changes its shape on the way, and brings results back. It handles the simple jobs, such as a nightly copy of ERP tables into your data lake, and the demanding ones, such as a full integration between SAP or Oracle and your planning applications with the results written back into the ERP. The tools and the way of working stay the same at every level.

WHERE DATA COMES FROMWHERE DATA GOESSAPECC · S/4HANA · tables · BAPIs · CDS views · change capture OracleEBS · Oracle Cloud · PeopleSoft · delta capture · APIs Other databases and warehousesSQL Server · PostgreSQL · Db2 · Snowflake Files, SFTP and object storageCSV · JSON · Parquet · S3 · Azure · GCS Streams, APIs and applicationsKafka · Kinesis · REST · webhooks · WMS · 3PL Data lake or warehouseSnowflake · Databricks · Fabric · S3 · Redshift Reporting and BIPower BI · Tableau · certified views · APIs Planning applicationsKinaxis · o9 · Blue Yonder · SAP IBP · OMP Partner systems and filesSFTP · EDI · supplier and 3PL portals Back into the ERPSAP BAPI / IDoc · Oracle interfaces · confirmed Lima BackboneONE ENGINE · ONE WAY OF WORKING1Extractfull, changes only, or as they happen 2Transformclean, join and calculate 3Loadinsert, update, replace or partition 4Orchestrateon a schedule, an event or a deadline 5Checkvalid rows continue; rejects get an owner 6Returnresults go back and are confirmedSTEP 6 · RESULTS RETURN TO THE SOURCE SYSTEM AND ARE CONFIRMED
Six steps for every job, from a simple copy to a planning integration. A simple copy uses the first three or four steps. Step six sends results back into the system they came from, and that system confirms each write.
40+
connectors: ERPs, databases, files, streams, applications
connector library
220M rows
615 tables · ~30 GB · ~30 min on 64 vCPU
performance estimate
80 GB/day
moved and transformed every day
production · semiconductor enterprise
22 days
from contract to production
showcase estate
8–10 wks
to a first planning load
delivery record 2020–2026
What it is used for

Four levels, one engine.

Each level adds capability on top of the one before it. A team can start with a nightly copy and grow into a full planning integration without changing tools.

Level 1 · Copy and refresh

Move tables into a data lake, warehouse or reporting system

Take tables from an ERP, a database or a file location and land them somewhere useful, on a schedule or as changes happen. This is the everyday job of a data team, and it is where most Backbone estates start.

ExampleEvery night, the order and inventory tables from Oracle EBS land in Snowflake as Parquet files; from then on, only the rows that changed are copied every 15 minutes.
Replication and sync →
Level 2 · Migrate and archive

Move full history at large volume, with a count check per table

Move the complete history of a system into a lakehouse, tier cold data out of an expensive ERP database, or retire a legacy system while its data stays readable. Each table is reconciled: rows in, rows out, totals compared.

ExampleBefore an ECC system is switched off, every non-empty table is extracted in parallel, landed in tiered storage, catalogued, and checked table by table; the history stays queryable for auditors.
Legacy decommissioning →
Level 3 · Consolidate and synchronise

Bring several systems into one model and keep them aligned

Combine data from several ERPs into one consistent model, keep master data aligned across systems, and feed reporting, partner and planning systems from the same governed copy. Change capture keeps the copies current.

ExampleSix SAP systems, an Oracle EBS system and PeopleSoft are combined into one planning model: 615 tables and about 220 million rows in roughly 30 minutes on a 64-vCPU node (estimate).
How the engine scales →
Level 4 · Integrate and return

Feed a planning application on its calendar and write the plan back

Deliver data into Kinaxis, o9, Blue Yonder, SAP IBP or OMP before the planning run, apply transformations at MRP scale, route bad records to the people who own them, and write accepted plans back into SAP or Oracle with a confirmation for every write.

ExampleSAP into Kinaxis every night before the 06:00 MRP run; planned orders return to SAP through BAPI transactions, each one confirmed and reconciled. In production since 2021.
Planning integration →
How every job runs

Six steps, in order.

Every job on the Backbone follows the same six steps. Simple jobs use the first three or four; a planning integration uses all six.

Step six sends results back to the system they came from, and that system confirms each write.
StepWhat happensWhat Backbone brings to it
1 · ExtractData is read from the source: the whole table, only the rows that changed since the last run, or every change as it happens.Reads SAP and Oracle through the interfaces each vendor supports, with delta and change capture built in. ERP extraction →
2 · TransformData is cleaned, joined, converted and calculated into the shape the target needs.150+ visual operators, Python where you need it, and a parallel engine for very large joins. Pipelines →
3 · LoadData is written to the target: inserted, updated in place, replaced, or loaded into a partition.Target-aware writes for warehouses, lakehouses, databases, files and planning applications.
4 · OrchestrateJobs run on a schedule, on an event, or in time for a business deadline, and are watched while they run.Deadlines on the business calendar; jobs pause on a data problem and resume from where they stopped. Orchestration →
5 · CheckRows that fail a rule are separated from valid rows; counts and totals are compared with the source.Every rejected row is kept and becomes a record with an owner and a deadline. Exceptions →
6 · ReturnResults such as accepted plans or corrected master data are written back into the source system.Every write carries a unique key, is confirmed by the ERP, and is reconciled at the end of the run. Write-back →
Worked examples

From a nightly copy to a planning integration.

Three jobs, written out step by step. The same six steps apply; the difference is how many of them the job needs and how much rides on each one.

Example 1 · Level 1 · Oracle EBS tables into a data lake every night

ConnectA read-only database user for Oracle EBS is registered once, with its credentials stored in the vault. Backbone tests the connection and reads the table list.
ExtractThe first run copies the whole of each order and inventory table. Every run after that reads only rows whose last-update column changed since the previous run.
LoadRows land in Snowflake as Parquet files partitioned by date. New rows are inserted; changed rows update the existing ones.
OrchestrateThe full refresh runs at 01:00; the change copy runs every 15 minutes. If a run is late, the data team hears about it on Slack with the reason attached.
CheckRow counts per table are compared with the source at the end of each run and recorded in the run log.

Example 2 · Level 2 · ECC history into a lakehouse before the system is retired

InventoryBackbone lists every non-empty table in the ECC system with its row count and size, so the scope is known before anything moves.
Extract in parallelTables are read through supported interfaces, many at a time. A large table is split into partitions so several threads read it together.
Land and tierData lands in the lakehouse or in object storage. Recent history goes to the fast tier; older history to the cheap tier, with a retention rule per table.
ReconcileFor every table, rows in and rows out are compared, along with control totals on key amount columns. Differences are listed for review before sign-off.
Keep it readableTables are catalogued with their lineage, so auditors and the business can still query the history through the Data Fabric after the old system is switched off.

Example 3 · Level 4 · SAP into Kinaxis, and the plan back into SAP

Extract from SAPMaterial, BOM, stock, order and forecast tables are read through supported SAP interfaces; changes are captured during the day so the night run is small.
Transform at MRP scaleBills of material are exploded, units and calendars converted, and demand pegged to supply, on a parallel engine sized for millions of item-plant combinations.
Check and routeRows that fail a rule, such as a negative quantity or an unknown plant, become exception records that go to the planner or buyer who owns them. Valid rows continue.
Load before the deadlineThe planning dataset is loaded into Kinaxis inside its run window, before the 06:00 MRP run. If a quality rule stops the pipeline, it resumes from its last checkpoint once the data is fixed.
Return and confirmPlanned orders accepted in Kinaxis are posted to SAP through BAPI transactions. Each write carries a unique key, receives a confirmation, and is reconciled in the run ledger.
A related pipeline on the showcase estate

otif_nightly: SAP changes and WMS data pass a quality check, feed the OTIF calculation and a certified view, and fan out to the board KPI, the SC report and the OTIF API before the 06:30 deadline. When a data problem was detected at 02:14, the pipeline paused, resumed at 02:58, and finished with three and a half hours to spare.

What it takes care of

Seven things the Backbone takes care of.

Each item has its own capability page with its evidence. Together they turn a set of pipelines into a backbone the business can rely on.

01

Reads SAP and Oracle by each vendor’s rules

SAP is read through tables, BAPIs, CDS views and application-level change capture. Oracle is read through database access, delta capture and released APIs. No add-on is installed in either system, and no extra vendor licence is needed.

SAP Note 3255746 · ECC and S/4HANA · Oracle EBS and Oracle Cloud
02

Writes results back and gets a confirmation

Plans, requisitions and corrected master data go back into the ERP through its released transactions. Every write carries a unique key, receives a confirmation from the ERP, and is reconciled at the end of the run.

SAP BAPI / IDoc · Oracle open interfaces · in production since 2021
03

Keeps deadlines set on the business calendar

A job is scheduled against the business event it serves, such as the 06:00 MRP run or the Friday S&OP review. When a data problem stops a job, it pauses, keeps its place, tells the owner, and resumes once the data is fixed.

showcase estate: 44-minute hold, deadline met with 3h 32m to spare
04

Gives every bad record an owner

Incoming data is split into valid rows and exception rows. Each exception keeps its full context, goes to the buyer, planner or steward responsible, and is replayed into the pipeline once it is fixed.

showcase estate: routing time from 3.4 hours by email to seconds by rule
05

Runs any volume on fixed capacity

One parallel engine handles a nightly delta and a terabyte migration. Subscription is sized by the capacity you run on, so a large migration costs the same as a small one.

~220M rows in ~30 min on 64 vCPU (estimate) · 80 GB/day in production
06

Recovers from interruptions on its own

Every run keeps checkpoints. After a hold, a network fault or a source outage, the job resumes from its last checkpoint and replays the changes it missed in order, without duplicates.

showcase estate: 841K events replayed in order after a 44-minute hold
07

Comes with the governance of the platform

Pipelines use the same catalog, lineage, quality rules and access policy as everything else on Lima. Lineage is recorded as the pipeline runs, and access rules apply to the data it moves.

one catalog · lineage by execution · row- and column-level access
Any source.Any target.Any pattern.Any volume.Priced by capacity.HOW THE ENGINE SCALES → /platform/backbone/scale
Where it fits with the Data Fabric

Read it in place, or move it.

The platform gives you two ways to work with data. The Data Fabric reads data where it lives, for questions, dashboards and agents. The Backbone moves data when a system needs a prepared, checked copy delivered on time. Both use the same catalog, lineage, quality rules and access policy, so the choice depends only on the job.

What you want to doRead it in place (Data Fabric)Move it (Backbone)Why
Ask questions, build dashboards, run agentsYes—The data is read where it lives and answers come back in seconds. The data stays in the source system.
Feed a planning application—YesPlanning engines load a prepared dataset inside a time window; they need the data delivered, checked and on time.
Calculate at MRP scale—YesExploding a 20-level bill of material for millions of item-plant combinations is heavy computation, which is what the parallel engine is for.
Keep a month-end or regulatory snapshot—YesAn auditor needs a fixed copy with a hash, kept as evidence.
Archive, offload or retire a systemRead the archiveMove it onceThe Backbone moves the history; the Fabric keeps it readable afterwards.
Migrate to a lakehouse—YesLarge volume, reconciled table by table, then kept current with change capture.

The full decision guide, with the economics of each choice →

The demanding end

Five planning applications, supported as targets.

Planning applications are the most demanding destination: they need complete, checked data inside a time window, and they produce plans that belong back in the ERP. Backbone treats each of them as a first-class target.

Deployment and pricing

Where it runs, and how it is priced.

Your cloud or ours

Run Backbone as a service on Lima-managed AWS, in your own cloud account, or on your own servers. The same reference configurations apply everywhere, from 32 vCPU with 256 GB of memory to 128 vCPU with 512 GB. Each installation is single-tenant, runs across three availability zones, connects to SAP over a private link, and uses your single sign-on.

Deployment options and reference configurations →

Priced by capacity

The subscription is sized by the estate and the capacity you run on. There is no charge per row, per connector, per run or per question, so a large migration costs the same as a small refresh on the same tier. Fixed-price entry offers give a trial a clear end point: a free extraction assessment, a four-week first load with a reconciliation report, a fixed-price migration conversion, and a per-system archive-and-decommission.

Pricing principles and entry offers →

Standards and trust

Standards and certifications, with dates.

OpenLineageOpen Data Contract StandardMCP serverApache Airflow 3dbtIceberg / Delta outputArrow / ADBCOpenAPI 3.1SAML · SCIM

Open standards, with dates

A conformance matrix lists each standard, whether it is shipped, in progress or scheduled, and the quarter it lands. Technical evaluators can answer their checklist from the page.

Standards conformance →

Trust, stated plainly

The SAP extraction compliance statement, the write-back audit model, and the rule that metadata may go to an external AI model while row data stays inside. Certification status is shown with dates, and reports can be requested under NDA.

Trust center →

Proof

Delivery references.

Customers are anonymised until each approval to name them lands. Every figure on this site is labelled with where it comes from: estimate, lab, production or showcase estate.

Semiconductor equipment · since 2021

$75B semiconductor manufacturer

Planning-data bridge across 1,000+ SAP tables into the planning suite; integration cost 70% lower than the quoted programme.

Industrial · planning COE

$25B manufacturer

800+ tables bridged; first planning load in 8–10 weeks with reconciliation per table.

Industrial · since 2022

$6B industrial

ERP-to-planning backbone in production since 2022; net-change loads on the planning calendar.

CPG · since 2020

$5B consumer goods

Multi-ERP consolidation and planning master data feeding the planning cycle since 2020.

All outcomes and the ROI method → · The Backbone Benchmark: method published now, results next quarter →

Terms on this page

Plain meanings.

ETL and ELTTwo orders of the same three steps. ETL transforms data inside the Backbone before loading it; ELT loads raw data first and transforms it with the warehouse’s own compute. Backbone supports both, and a mix.
Change data captureReading only the rows that were inserted, updated or deleted since the last run, as close to real time as the source allows.
Control totalsRow counts and sums of key columns, compared between source and target at the end of a run to show that every row arrived once.
Run windowThe period in which a job must finish so that a business step, such as the MRP run, can start on time.
Exception recordA row that failed a rule, kept with its full context, assigned to a person, and replayed into the pipeline once fixed.
Write-backSending results from a target system back into the source system through its released interfaces, with a confirmation for each write.
Questions

Asked before the first call.

Is Backbone a separate product from the Lima platform?

Backbone is the name for the pipeline, orchestration and change-capture engine inside Lima, the part that moves data and brings results back. It can be licensed on its own and inherits the platform’s catalog, lineage, quality rules and access policy either way.

We already have a scheduler or an orchestration tool. Does Backbone replace it?

You keep it. Lima tasks run inside your Airflow DAGs, and enterprise schedulers can trigger Lima jobs and receive their status back. Backbone adds the pieces those tools leave to you: deadlines on the business calendar, pause and resume on a data problem, exception records with owners, and confirmed write-back.

Which ERPs are supported?

SAP ECC and S/4HANA, Oracle E-Business Suite and Oracle Cloud, and PeopleSoft, through each vendor’s supported interfaces. Other databases and applications connect through the 40+ connector library or the connector SDK.

Do we have to start with a planning integration?

Most teams start at level 1 or 2: a nightly copy into a data lake, a migration, or an archive. The planning integration is the most demanding job the engine does, and the same engine and tools carry a team there when they are ready.

How is it priced?

By the estate and the capacity you run on, as a subscription with fixed-price entry offers. There is no charge per row, connector, run or question.

Run your first load.

Four weeks, one dataset, one target: your ERP into a data lake or a planning application, with a reconciliation report at the end.