Skip to content
NovaeMinds

— NovaeMinds team · 6 min read

Verifiable RAG: cite or abstain, never from memory

Verifiable RAG cites or abstains: it delivers the whole procedure with its citation, or it tells you it has no support. It never answers from memory and never hands over half a procedure. In operations, where a missing step is a hazard, that’s the difference between a useful assistant and a dangerous one.

Why does generic RAG fail in operations?

RAG (retrieval-augmented generation) is the technique that lets an AI assistant search your documents and answer with what it finds. In an office demo it works. In a control room or next to a machine, it fails in three ways.

It answers with fragments

The usual approach chops documents into chunks and gives the model the ones that look most like the question. A 12-step procedure ends up split across several chunks, the assistant receives steps 3 to 7, and it answers with those.

Half a procedure is worse than none. Whoever reads it doesn’t know steps are missing, and neither does the assistant.

It makes things up with the same confidence it has when it’s right

When the search finds nothing relevant, the model answers anyway, from what it learnt in training. Same tone, same format. Nobody can tell the answer backed by the manual from the one that was invented.

It doesn’t say where the answer comes from

Without a citation to document, revision and section, nobody can check whether the answer comes from the current revision of the manual or from one withdrawn two years ago.

Add two conditions of real operations: many manuals can’t leave your network, and in the field there isn’t always coverage.

Why does this matter now?

Because the knowledge sits with people who are leaving. In energy, there are 2.4 workers close to retirement for every new entrant under 25 (IEA, December 2025). The urban water sector names the loss of know-how as one of the challenges of generational turnover (DAQUAS, October 2026).

Your technicians call “the one who knows”, and the one who knows is retiring. Much of what they know is in the manuals. An assistant that reads them properly makes it available to the whole shift. One that reads them badly is a new risk.

And because more and more organisations want their data kept close. 61% of CIOs in Western Europe will increase their reliance on local cloud providers because of geopolitics (Gartner, November 2025). If your manuals describe how to run an infrastructure, you probably don’t want to upload them to a cloud assistant either.

What rules should RAG follow in operations?

These four, without exception:

  1. Cite or abstain. Every answer carries document, revision and section. If there is no support, it says so.
  2. The whole procedure or nothing. If the answer is a procedure, it arrives complete.
  3. Never from memory. The assistant answers with what the index hands it, not with what it remembers from training.
  4. Never degrade silently. If something fails, the system says so.

And here is the difference, point by point, with the naive approach:

AspectNaive RAGVerifiable RAG
What the assistant receivesThe chunks that look most like the questionThe whole section
When there is no supportThe model answers anywayIt says so
CitationOptionalDocument, revision and section
What goes into the indexWhatever is uploadedWhat passes a quality check and your approval
When an update goes wrongNo way backYou roll back to the previous index version

How does RAGNIX do it?

RAGNIX, our document retrieval engine, applies those rules in three steps.

Controlled ingestion

Today it takes Markdown, Word and HTML, and extracts the figures of each revision. Nothing goes in without passing a quality check and your approval, and every change is logged. You decide which documents feed the assistant, not whoever has access to a shared folder.

A local, versioned, immutable index

Search combines exact words and meaning. Exact words find an equipment code or an alarm number; meaning finds the answer even when the technician asks in their own words.

Every version of the index is immutable. If a document update goes wrong, you roll back to the previous one.

Answers over MCP, with the whole section

Your assistant connects over MCP, searches and receives the whole section with its citation. It can also browse the document’s table of contents to get to the section it needs. You don’t need a specific model: RAGNIX connects over MCP to whichever assistant you already use.

The citation isn’t decoration. It’s what lets your technician open the manual at the right section and check the answer before acting. The AI proposes; the person checks and decides.

Does it work offline and with small models?

Yes, that’s what it’s designed for. RAGNIX works with small, local language models, and indexing, search and serving all run inside your network. It sends us no telemetry.

It’s an 8.5 MB executable that runs on a laptop or a server, with no vector database, no Python and no containers. It fits on an air-gapped network or on a technician’s laptop.

Access control goes down to the fragment: collections are isolated and restricted content is hidden by default. You can keep several collections on the same system without them mixing. And there is no per-query cost and no dependence on a cloud AI provider.

How much does it cost compared with sending the whole manual to a long-context model?

The alternative to RAG is to put the whole manual into a long-context cloud model and ask it questions. It works, but you pay to re-read the entire manual on every question.

We have an estimate, not a measurement. With a 200,000-token manual, a two-question session costs about 24 times less with RAGNIX than sending the whole manual to a long-context model in the cloud. Assumptions: public prices from September 2026, output tokens not included. The experiment with a real manual is under way.

What we don’t promise: better answers than putting the whole manual into a giant cloud model. What we do promise is that, with several manuals, offline and with a small model, the answer still arrives with its citation.

What stage is RAGNIX at?

In pilot with a first customer. Today it indexes Markdown, Word and HTML and extracts the figures of each revision.

On the way: PDF, serving figures over MCP, encryption and authentication of the MCP channel, and access with your company’s SSO. We say so up front because, if your documentation lives in PDF, you should know before the first meeting.

Where do you start?

With a manual your technicians look up often and a list of real questions. It’s the same idea as accountable AI, applied to your documents: every answer comes with its evidence.

If you want to try it with one of your manuals, see how RAGNIX works; if it’s part of a bigger project, tell us about it on our services page.

FAQ

Frequently asked questions

What is verifiable RAG?

A document retrieval system that hands the AI assistant information from your documents with its citation: document, revision and section, so anyone can check where the answer comes from. If it finds no support, it doesn’t make things up: it says so. And when the answer is a procedure, it delivers the whole procedure, never half of it.

Why does a RAG assistant make up answers?

Because a language model always answers. If the search finds nothing relevant, or only a fragment, the model fills the gap with what it learnt in training, in the same tone it uses when it’s right. Verifiable RAG changes the rule: no citation, no answer, and when there is no support, it says so.

Can you run RAG offline with local language models?

Yes. RAGNIX does indexing, search and serving inside your network, with no telemetry, and it is designed to work with small, local language models. It is an 8.5 MB executable that runs on a laptop or a server, with no vector database, no Python and no containers, so it fits an air-gapped network.

Is RAG cheaper than a long-context model?

By our estimate, not a measurement: with a 200,000-token manual, a two-question session costs about 24 times less with RAGNIX than sending the whole manual to a long-context model in the cloud, based on public prices from September 2026 and excluding output tokens. The experiment with a real manual is under way.

Which document formats does RAGNIX support?

Today it indexes Markdown, Word and HTML, and extracts the figures of each revision. PDF is on the way. Every document passes a quality check and needs your approval before it enters the index, and every change is logged. If an index version doesn’t convince you, you roll back to the previous one.

CONTACT

Tell us what your operation has to withstand.

45 minutes with the team that would build it. You leave with a written technical assessment, whether we work together or not.

BOOK AN ASSESSMENT