AI Data Mapping

Entity mapping & extraction with LLMs

The most expensive data problem in a company is rarely missing software – it's heterogeneous data: every supplier, partner, or customer delivers the same information in their own structure, language, and naming habits. And someone has to map it onto your account trees, schemas, and master data. By hand.

We automate exactly this work – with a clear division of labour: deterministic matchers (exact, alias, fuzzy, phonetic, tree context) run first and handle everything string metrics can handle. The LLM comes deliberately last and takes over only the semantic remainder no string comparison can read – for instance that a role label belongs on the account of the corresponding function.

Confidentiality is built in: when reading calculations, the model receives a masked digest in which every number and formula is replaced by placeholders – only labels and structure reach the LLM. Hallucinated account IDs are filtered against the real taxonomy, and a validation layer reconciles the result against the source file's own totals.

And quality can only go up: every human correction becomes a locked regression test. In real-world projects the pipeline auto-maps over 90 percent of positions.

AI Data Mapping

Hybrid instead of either-or

Why LLM + deterministic engine wins

The right order

String matching alone typically reaches only about a third of the lines in heterogeneous sources. Deterministic matchers go first – the LLM specifically rescues the lines nobody else can place.

Privacy by design

The model reads layout and labels, never amounts: numbers and formulas are masked in the digest, and deterministic code applies the recognised structure to the real cells.

Validation against the source

The imported result is reconciled against the file's own totals. Discrepancies surface as warning cards instead of silent guesses – and every correction becomes a regression test.

Mapping in practice

Four patterns from our project work – from Excel import to title resolution against a catalogue.

Every budget is a different Excel
The semantic remainder
Title lists against the catalogue
Names as a free side effect
Document Extraction

Every budget is a different Excel

A regional film fund receives production cost calculations in every conceivable Excel format – exports from the industry's standard calculation software, hand-built sheets, bilingual layouts. The import pipeline works in three stages: an LLM reads only the layout of a masked digest and returns a machine-executable structure spec, deterministic code applies it to the real cells, and mapping onto the industry-standard account tree is done by recommenders – deterministic first, LLM last. In real-world testing, 20 of 22 projects were imported, with over 90% of positions auto-mapped.

Entity Mapping

The semantic remainder

A major studio's budgeting system normalises incoming production budgets – each in its own account structure, language, and naming habits – onto a target account tree. The deterministic matcher chain plateaued at roughly a third of the lines; the LLM runs deliberately last and reads what string metrics cannot: that a director's role label belongs on the directing account, or that a vehicle line is a transport cost. Confident suggestions auto-apply through the same threshold machinery as all matchers – the rest surface as ranked suggestions for humans.

MCP

Title lists against the catalogue

A licensing and royalty platform for a global media group resolves every incoming title – a distribution partner's spreadsheet row, a localized film title, an episode reference – to the house product identifier. The deterministic mapping engine is exposed as an MCP server: the user's AI client supplies the inputs, the engine passes the verdict – per row an identifier with explicit certainty, or an honest no-match. Answers cannot drift between channels because the same engine decides everywhere.

Entity Extraction

Names as a free side effect

The same paid LLM call is mined a second time: person names embedded in budget lines are extracted and resolved against a talent database – as a free side effect of the mapping. This replaced a dedicated cloud NER service.

Comparability is half the battle

Why this is the lever

Mapped data is more than clean data: only when heterogeneous sources sit on a shared taxonomy do budgets become comparable, reports aggregatable, and analysis possible at all. That's why data mapping is not an import feature to us, but the foundation that analysis assistants, findings agents, and reports build on.

Highlights

  • Deterministic matchers first – the LLM only for the semantic remainder
  • Masking: amounts and formulas never reach the model
  • Hallucinated IDs are filtered against the real taxonomy
  • Every human correction becomes a locked regression test
  • Over 90% auto-mapped positions in real-world projects

Software Development in Hamburg!

Start new project with us or upgrade an existing one to the next level