Outcomes Backbone benchmark

The numbers, and how to reproduce them.

Lima quotes a performance estimate: about 220 million rows across 615 tables, about 30 GB, in about 30 minutes on 64 vCPU. An estimate is a sizing calculation. This benchmark replaces it with a measured run anyone can repeat: a synthetic SAP planning dataset, a reference configuration, four scores and a published harness. The method is published now; the results follow next quarter; a terabyte run is scheduled after it.

DATASETSynthetic SAP planning datasetMARA · MARC · MAST · STKO · STPO · EKKO…Sized like a real estate~600 tables · ~200M rows · ~30 GBTHE RUN, ON 64 VCPUExtracteach method timed separatelyTransforminto the planning modelLoadKinaxis Maestro, referential orderReconcilecounts and control totals per tableWHAT IS SCOREDFour scoresrows/min · hours to first load · window…
The run. A synthetic SAP planning dataset sized like a mid-sized estate is extracted by each method in turn, transformed into the Kinaxis model, loaded in referential order and reconciled. Four scores are recorded.
220M rows
615 tables · ~30 GB · ~30 min on 64 vCPU
performance estimate · to be replaced
12M rows
10 GB in 15 minutes on 64 vCPU
lab run
80 GB/day
moved and transformed every day
production · semiconductor enterprise
4
scores per run
method
1
harness to download when results publish
method
Why publish the method first

Because a number without its method is a claim.

Most performance figures in this category are quoted without the dataset, the hardware or the scoring. This page publishes those three first, so that when the results appear they can be checked, and so that anyone can run the same harness on their own tables and compare.

The figures Lima quotes today carry their labels: estimate, lab, production. The estimate is the one this benchmark exists to replace.

The method

Dataset, hardware, run, scores.

PartWhat it isWhy
DatasetA synthetic SAP planning dataset generated with the shapes of real tables: material master (MARA, MARC), bills of material (MAST, STKO, STPO), routings (PLKO, PLPO), purchasing (EKKO, EKPO), sales (VBAK, VBAP), production (AFKO, AFPO), stock (MARD, MSEG). About 600 tables and 200 million rows, about 30 GB.Real table shapes without real data; sized like a mid-sized estate.
HardwareThe 64C reference tier: one node, 64 vCPU, 512 GB, in Lima's cloud; the instance type is named in the harness.The tier most estates start on.
Extraction methodsEach method timed on its own: table reads through the released function module, BAPIs, delta-enabled CDS views, change pointers, extractor delta queues; for Oracle, partitioned JDBC and LogMiner.Rows per minute per method is the question buyers ask.
TransformationThe planning model for Kinaxis Maestro: Part, PartSource, BillOfMaterial, OnHand, ScheduledReceipt, IndependentDemand, Calendar.The hardest shaping step in a planning load.
LoadFull load, then a net-change load of 2% of rows, into a Kinaxis test tenant in referential order.Both the first load and the nightly case.
ScoresRows per minute per method; hours to first full load; run-window adherence against a 4-hour window; reconciliation variance (rows and control totals).The four numbers a planning program needs.
HarnessThe generator, the pipeline definitions and the scoring script, downloadable when results publish; runnable on any Lima instance.Reproducibility.
Timeline

Method now, results next quarter, terabytes after.

Sep 2026
Method publishedThis page. The dataset generator and scoring definitions are frozen.
Q4 2026
Results publishedThe four scores on the 64C tier, with the harness for download and the raw run logs.
Q1 2027
The terabyte runA multi-terabyte, billion-row workload on 128C: a full-table archive extract, a reconciled lakehouse migration to Iceberg or Delta, and a restore from the archive into a target, with cost per terabyte stated.
Quarterly
Field editionAnonymised aggregate results from customer bake-offs: rows per minute, hours to first load, variance, window adherence.
Run it on your own tables

The same protocol, on your estate.

A two-week bake-off runs the same protocol on your real SAP or Oracle tables and your planning system, and adds one confirmed write-back. The numbers are yours to keep, and they feed the field edition in anonymised form if you agree.

Book a bake-off →

Terms on this page

Plain meanings.

EstimateA sizing calculation from table counts and volumes; labelled as such until a measured run replaces it.
Lab runA measured run in Lima's own environment on a generated dataset.
ProductionA figure measured on a running customer estate.
Run-window adherenceWhether a load finished inside its window; scored as met or missed, with the margin.
Reconciliation varianceRows and control totals that differed between source and target after a load.
HarnessThe scripts that generate the dataset, run the pipelines and score the result.
Questions

Asked about this guide.

Why not publish the results today?

Because the run has to be made on the frozen method, and the method was frozen this month. Results follow next quarter, with the logs.

Will the terabyte run use real data?

No. A generated dataset with realistic shapes, sized to terabytes. Customer runs stay on customer estates and enter the field edition only in anonymised aggregate.

Can we compare another tool on the same harness?

Yes. The dataset generator and the scoring script are tool-neutral. Load the same dataset with any tool and score it the same way.

Be told when the results are out.

One email when the 64C results publish, one when the terabyte run does.