Logiciel Solutions Contact Us
Success Stories Tech News Investors Contact Us
whitepaper

Retrieval Architecture: An Engineering Reference.

The model is a set of weights. The index is a second copy of your documents, chunked and embedded, and the access controls the source system enforced rarely survive the trip. This is a lookup catalogue rather than an argument: twenty-eight numbered controls across seven families, each naming what it requires, the artefact a reviewer can hold, and the layer of the stack that owns it.

Two failures recur in every family. A control that sits in the interface instead of the retrieval call, and a control that sits in a notebook instead of a pipeline.

In depth

Treat The Index As A Build Artefact, Not A Side Effect.

01

An index built interactively cannot be rebuilt.

Parser version, chunk size, overlap rule and embedding model decide what the retriever can find, and when all four live in a notebook the index serving production cannot be reproduced and a change to any one of them cannot be attributed. Pin them in a single manifest, store it with the index, and resolve a named alias to a version the way you already do for a container image. A rebuild that diffs cleanly against what is in service is the whole test.

In shortA rebuild that diffs cleanly against what is in serv…
02

Permission enforcement in the interface is not enforcement.

The retriever returns everything that matches, the application hides part of it, and the model has already read all of it into the answer it is composing. Nine in ten AI-related breaches land where no AI access control exists, and six organisations in ten cannot say who may reach a model or its data (IBM, 2026). The caller identity belongs in the search call as an entitlement predicate, with a cross-tenant attempt run on every release.

In shortwith a cross-tenant attempt run on every release
03

Deletion has to survive the next rebuild.

Clearing the source row leaves the vector behind, and a rebuild from a snapshot taken before the request quietly puts the record back, which is the quieter failure of the two and much the harder to notice. Erasure under GDPR Article 17 reaches chunks, embeddings, caches and every derived index, so deleted identifiers go into a suppression list the build manifest reads. A tombstone store is what stands between a completed deletion and a rebuild that undoes it.

In shortA tombstone store is what stands between a completed…
The detail

Three Families Where Retrieval Stacks Give Way First.

Seven families cover the catalogue, from corpus registration through to trace retention. These three carry most of what goes wrong once real traffic arrives, and each one is settled by an object somebody can open in front of you rather than by an assurance.

Zone · 01

Permission-aware retrieval

Caller identity resolves to an entitlement predicate evaluated inside the search call, never as a filter over results already returned. Entitlement changes reach index metadata within a stated interval, with revocations propagated ahead of grants. The artefact is a retrieval API contract that refuses any call arriving without a principal attached to it.

Zone · 02

Freshness and deletion

Freshness is published per corpus as the lag between source updated-at and indexed-at, reported at p95 rather than as a mean. Deleted identifiers go to a suppression list every build consults. A subject access request gets answered from the index itself, through a reverse lookup from a source record to the chunk ids derived from it.

Zone · 03

Evaluation and traces

Quality asserted by demonstration is what this family exists to prevent: a handful of questions work in a review, nothing is labelled, and a user reports the first regression. A labelled query set owned outside the build reports recall@k and nDCG per release, a gate blocks promotion below baseline, and every answer retains the index version that produced it.

By the numbers

The figures that make it a board-level conversation.

28
numbered controls across seven families, from corpus registration to trace retention
92%
of AI-related breaches hit organisations running no AI access controls
40%
of organisations control access to their own AI models and data
Inside the report

What you'll take away.

01

Step 1 - Register the corpus before its first ingestion run

Owner, source system, lawful basis, licence, sensitivity class and retention period, recorded before any data moves. Ingestion refuses a corpus that has no entry, and logs the rejection.

02

Step 2 - Pin the whole build in one manifest

Parser version, chunker parameters, embedding model and dimension in a single file stored alongside the index. Regression test chunk boundaries so a parser upgrade cannot reshape the corpus silently.

03

Step 3 - Move the predicate inside the search call

Filtering results after retrieval means the model has read them already. Enumerate the service accounts reading the index too, since one non-human identity with corpus-wide read defeats the rest.

04

Step 4 - Give retrieval a path for the empty set

A similarity floor below which the retriever returns nothing, and a written contract for what the system says then. Vector search hands back its nearest neighbours whether or not they are relevant.

Questions

Frequently asked.

What is the quickest control to check on an existing index?

Ask whoever owns the retrieval service to show the API contract. If a search call can be made without a principal attached, entitlements are being applied somewhere above the retriever, which means the model has already read whatever matched before anything was hidden from the user.

Does a chunk really need all that metadata?

Source document id, source system, document version, ingestion run id and ingested-at timestamp are what make the rest possible. Without them you cannot answer a subject access request from the index, cannot suppress a deleted record across a rebuild, and cannot trace a bad answer to the version of a document that caused it.

How do we stop a rebuild reintroducing deleted records?

Keep a suppression list of deleted identifiers that the build manifest reads on every run, so a snapshot taken before the deletion cannot reinstate the content. Then test it: delete a known identifier, restore an older snapshot, rebuild, and confirm the record does not come back.

Our retrieval quality is fine. Why build an evaluation set?

Quality you cannot measure is quality you cannot defend through a change. A labelled query set held outside the build gives you recall@k and nDCG against a recorded baseline, so an embedding swap or a chunker upgrade reports its own damage instead of waiting for a user to find it.

How does this differ from your report on retrieval under regulation?

This one is the build. Retrieval Architecture Under Regulation covers which legal regime reaches which part of the stack and what evidence satisfies it, which is the argument. Read that for what is required of you, and this catalogue for the controls and artefacts that deliver it.

Who should be reading this?

Data and platform engineers who own an index, and the technical leads reviewing their work. It assumes you have retrieval in production or close to it, and want the control numbers to cite in tickets rather than a case for why retrieval matters.

Where should a team start if they can only fix one family?

Permissions, in almost every case. A reproducibility gap costs you time and a measurement gap costs you confidence, but a retriever that returns what the caller may not read turns an engineering problem into a disclosure, and that one does not stay inside the team.

Get the whitepaper

Have it emailed to you.

Drop your details and we'll send Retrieval Architecture: An Engineering Reference straight to your inbox - no spam, unsubscribe anytime.

Download whitepaper
Next step

Open it at the family you are building, then go find the artefact.

Point a two-week trial sprint at one family, usually permissions or deletion, and find out which artefacts your retrieval stack can produce today. Working code in your repository, not a slide. SECTION 7 - FAQ - 5 to 8 questions

Book a retrieval review