Industrial RAG systems are sold as “chat with your manuals.” The manuals change. A valve torque table updates. A LOTO sequence gains a blind. A vendor PDF replaces pages without changing the filename. If the assistant’s index still embeds last quarter’s text, operators get fluent answers that cite retired truth. Citation ledgers catch a single bad quote after the fact. This brief owns the upstream failure: SOP change without retrieval invalidation.
Why a diff is an AI event
When a controlled document revises, three systems must move together:
- Authoritative store — new revision ID, effective date, retired watermark.
- Chunk/index refresh — old embeddings removed or marked non-retrievable.
- Runtime citations — answers must pin revision, not only title.
Miss any one and you have a chatbot that sounds more confident than your document control clerk.
If the diff never reaches the index, the model did not get the memo.
Revision lists are not decorative—they are retrieval allowlists.
Failure modes already shipping
| Failure | What operators experience | | --- | --- | | Filename-stable replace | Assistant cites “SOP-441” with yesterday’s steps | | Partial re-embed | Mixed chunks from rev C and rev E in one answer | | No effective dating | Future-dated SOPs retrieved early—or late | | Shadow PDF shares | Uncontrolled copies outrank the controlled library |
An anonymized maintenance copilot that “reduced search time” quietly taught a wrong torque after a PDF swap kept the same object name in the share drive. Humans would have checked the footer. The model checked similarity.
Controls that keep knowledge plant-grade
- Treat document revision publish as a pipeline event—rebuild or surgically delete affected chunks.
- Require citation UI to show revision + effective date, not title alone.
- Ban indexing of uncontrolled shares for assistant-readable corpora.
- Diff-gate major safety SOPs: human ack that RAG refresh completed before the revision is marked effective for AI.
- Audit weekly: sample answers against current footers.
Adjacent fences
Citation ledgers own single-answer provenance theater. MES free-text hygiene owns comment injection. Override telemetry owns human force labels. Soft-sensor cards own model gates. This page owns document change as RAG MoC. Do not celebrate an assistant go-live and let SOP deltas accumulate as silent lies.