Should a Correction Repeat the Mistake?

To retract a belief, an agent memory can delete it, replace it, or keep it on file labelled false. Only the last can warn an agent about to rediscover the belief elsewhere, and it has to state the belief to do it. Human memory research says the restatement helps. Transformer research says it may prime the error.

When an agent memory learns that one of its beliefs was wrong, it has three options. It can delete the belief. It can replace it with the correct one. Or it can keep a record: this was believed, it turned out false, here is why, do not re-derive it.

Only the third option can warn an agent that is about to rediscover the wrong belief from somewhere else. It also has a cost the other two avoid. To say what was wrong, it has to say the wrong thing again.

On whether that repetition helps or hurts, two bodies of research point in opposite directions. Human memory research, after a decade of revising its own advice, says restate the myth: corrections that name the false claim work better, and the feared backfire effect from repeating it does not replicate. Research on transformers suggests the opposite may hold for models. Telling a model not to produce a word can make the word more likely, and the effect grows with the amount of related text that follows the instruction. A coding agent typically reads a correction and then reads a great deal of related text.

Every memory system's correction format is a bet on one of these answers. Most systems place the bet without knowing there was one.

Agents Over-Trust Instructions and Under-Trust Corrections recommends that a correction name the exact belief it overrides. That leaves open how to name it, when the evidence on naming splits by substrate. The misinformation literature supplies the vocabulary: the myth is the belief being withdrawn, and a retraction is the statement that withdraws it.

Part 01
The Options
01

Three Ways an Agent Memory Can Un-Believe Something

An agent memory holds notes that survive between sessions: where a flag is read, which command runs the tests, what the user decided last week. When one of those notes turns out to be wrong, the store has three moves available.

Delete the wrong note

The note is removed, and the store no longer holds the belief. This is the simplest behaviour to build and a common one. In several memory libraries, each incoming fact is shown to a language model alongside the similar entries already stored, and the model chooses to add it, update an old entry, delete one, or do nothing. A contradicted entry gets deleted or overwritten.

Replace it with the correct fact

The note is removed and the correct fact is stored in its place. The store now holds only the truth. Nothing records that a different belief ever existed.

Retract it with a record

The old note stays, marked revoked, with a reason and a date, and the correct fact is stored alongside it. Memory stores deliver notes in two ways: the agent searches for them, or the store injects them into the agent's context on its own when something related comes up. When the revoked note becomes relevant again by either route, what surfaces is not its original content but a retraction:

A retraction as it reaches the agent (illustrative values)
Do not re-derive this from other sources without verification. Previously believed (recorded 2026-07-14, revoked 2026-07-21, reason: the flag moved to the settings service in 2.3): "Feature flags are read from config/flags.yaml".

The shape is the template that vectr, an open-source memory store I maintain, uses for revoked notes. The dates, reason and claim above are illustrative. The template itself, verbatim from agent/working_context_store/_store.py:

_ANTI_MEMORY_TEMPLATE = (
    'Do not re-derive this from other sources without verification. '
    'Previously believed (recorded {created_date}, revoked {revoked_date}, '
    'reason: {reason}): "{summary}".'
)

Temporal knowledge graphs sit between the second and third options. A superseded fact gets an invalidation timestamp and stays queryable as history, but nothing injects it; somebody has to go looking.

The options also differ in storage cost and in how easy they are to audit or undo. For agents the axis that decides between them is a different one: what happens when the wrong belief comes back from outside the store.

Analogy

A publisher finds an error on page 12 of a reference manual. Pulling the book from the shelf (delete) does nothing about the photocopies already circulating. Printing a corrected edition (replace) helps whoever picks up the new edition, but a reader holding an old photocopy has no reason to doubt it. An errata slip (retract) is the only option that speaks to the reader of the photocopy, and it can only do so by quoting the error: page 12 says X; X is wrong; the correct value is Y.

Where the analogy falls short is delivery. An errata slip only helps a reader who sees it, and for an agent, where and when the retraction is delivered turns out to matter as much as what it says.

Part 02
Deletion
02

Why Deleting a Wrong Memory Does Not Remove the Belief

The case for deletion rests on an assumption: removing the stored belief removes the belief. It fails in people and in model weights, where it has been tested directly, and it fails more obviously still in an agent's workspace.

In people: directed forgetting

In directed forgetting experiments, participants study items and are then told to forget some of them. Forget-cued items are recalled less often, but the evidence says they are still stored. In the list-method version of the task, the forgetting shows up on recall and typically vanishes on a recognition test, where the item is shown again (Abel et al., 2021, summarize the pattern). Current reviews attribute the effect to control of attention during study and to a deliberate shift of mental context (Delaney et al., 2020). None of the explanations on offer involves anything being removed; the item has become harder to reach while staying in storage.

In model weights: editing and unlearning

Knowledge editing changes a single fact inside a model's weights. The RippleEdits benchmark (Cohen et al., TACL 2024) checks the fact's consequences as well as the fact itself: edit who someone's parent is, then ask about their siblings. Current editing methods fail to make those consequences consistent. The edited fact moves; the facts that depend on it often do not. The best score on that benchmark came from the simplest baseline, in-context editing: putting the new fact in the prompt, which is what an agent memory does.

Machine unlearning does worse. (Retraining from scratch without the data does remove it; it is also too expensive to do per fact, which is why the approximate methods below exist.) Zhang et al. (ICLR 2025) found that for unlearning methods with utility constraints, models still retain on average 21% of the knowledge they were meant to forget at full precision, and 83% after 4-bit quantization. Hu et al. (ICLR 2025) showed that fine-tuning an unlearned model on a small, loosely related public dataset brings the unlearned content back; general wiki text about a book series was enough to make a model reproduce memorized passages of the books verbatim. Whatever the unlearning step did to the weights, it left enough behind for a small amount of training on adjacent text to bring the passages back.

In an agent's workspace

For a coding agent, the belief was never only in the memory store. It was in the documentation, in comments, in a vendored copy of a config, in twenty call sites that still use the old API. Deleting the note deletes the only object that knew the belief was wrong. The next session reads the stale README, re-derives the old fact, acts on it, and may well write it into a new file, where the session after that will find it.

Research on unlearning in agents has named a narrower version of this loop. Wang et al. (2026) call it parameter-memory backflow: an agent has its content removed from the model's weights and from its memory store, and the content comes back anyway, because retrieval reactivates what is left in the weights, or because derived artifacts (indices, summaries, embeddings, caches) still carry it and reintroduce it. Their loop runs between the weights and the memory store. A workspace runs the same kind of loop through many more places, and no unlearning method reaches any of them.

Deletion and replacement both leave the workspace's stale copies unopposed. Replacement at least stores the truth, but the truth arrives as one note, with no indication that the workspace disagrees with it and that the workspace is the one that is wrong. Only a retraction record says so. Whether saying so helps is the open question.

Insight

Backflow in a workspace does not need the model to remember anything. The stale README is enough. That makes it the common case rather than an exotic one: any fact that changed in code but not in prose can be re-derived by the next session that reads the prose, and a store that deleted its note has nothing left to object with.

Part 03
The Human Answer
03

The Human Answer: A Correction Should Name the Myth

The misinformation literature measures the quantity at stake here directly: how much people keep relying on information after it has been retracted. Its most argued-over practical question for the last decade is whether a correction should repeat the myth.

Retractions alone are weak: the continued influence effect

The continued influence effect is one of the most replicated findings in the field. In the standard paradigm (Johnson and Seifert, 1994), people read a report of a warehouse fire said to be caused by gas cylinders and oil paints stored in a closet. Some then read a retraction: the closet was actually empty. Asked later what caused the black smoke, many still cite the paint.

The major review of the literature (Lewandowsky et al., 2012) is blunt: retractions "rarely, if ever, have the intended effect of eliminating reliance on misinformation, even when people believe, understand, and later remember the retraction." A retraction at most halves the references to the misinformation compared with no retraction, and in some studies it does not reduce them at all. Delivering it immediately, inside the same story, does not fix this. Making the negation more emphatic ("paint and gas were never on the premises") made reliance worse in one study. The review found only three things that reliably help: a warning before exposure, repeating the retraction, and an alternative account that fills the gap the retraction leaves.

A warning plus an alternative works best

Ecker, Lewandowsky and Tang (2010) tested warnings directly. A specific warning, one that explained the continued influence effect to participants up front, reduced reliance on the retracted claim without eliminating it. A general warning (news is not always fact-checked before publication) did even less. In a further experiment, a specific warning combined with a plausible alternative explanation reduced reliance further, and still did not eliminate it.

The accepted account is causal. People keep a false belief when removing it would leave a hole in their model of what happened; the retraction says what did not cause the smoke and leaves the smoke unexplained, so the paint stays in use as the best explanation available. The alternative has to do real work: it should cover the same facts the myth explained, ideally say why the myth seemed right in the first place, and not be more complicated than the myth it replaces (Lewandowsky et al., 2012).

Repeating the myth does not backfire

For years the practical advice was never to repeat the myth, on the theory that repetition makes a claim familiar and familiarity is mistaken for truth. The 2012 review itself advised emphasizing the facts rather than the myth for that reason. The familiarity backfire has not held up.

Ecker, Hogan and Lewandowsky (2017) found that retractions which explicitly repeated the misinformation reduced reliance on it more than retractions that avoided repeating it, and attribute the gain to salience: a correction that names its target is easier to notice as a correction. Ecker, Lewandowsky and Chadwick (2020) then tested the case in which backfire should be most likely: correcting a myth the audience had never heard, so that the correction itself was the first exposure. Across three experiments and a one-week delay, they found substantial evidence against a familiarity backfire. The Debunking Handbook 2020, written by 22 researchers in the area, concludes that "repeating a myth while refuting it has been found to be safe in many circumstances, and can even make the correction more salient and effective."

The new-audience case is the normal one for agents. A fresh session that has not yet opened the stale README meets the myth for the first time in the retraction.

A candidate mechanism: memory reconsolidation

There is a mechanistic reason naming the myth might be necessary rather than merely safe, though it comes from a different literature and should be held loosely. Nader, Schafe and LeDoux (2000) showed in rats that a consolidated fear memory, when reactivated by retrieval, becomes unstable again and has to be re-stored. Injecting a drug that blocks protein synthesis (which the brain needs to re-store it) right after reactivation removed the fear response; the same injection without reactivation left the memory intact. The idea that retrieval opens a memory to updating, called reconsolidation, has since been pursued in humans, and whether it governs everyday belief revision is still debated (Lee, Nader and Schiller, 2017, review both the evidence and the challenges). As a mechanism, it suggests why a correction that never names what it corrects might have nothing to attach to. None of the misinformation findings above depend on it.

Corrections decay unless revisited

When people get corrective feedback, the errors they held with the most confidence are the most likely to be fixed on a retest. That is the hypercorrection effect (Butterfield and Metcalfe, 2001). The fix does not always last. Butler, Fazio and Marsh (2011) found that after a week, correction rates fell, and the errors that came back were disproportionately the high-confidence ones. Metcalfe and Miele (2014) found that a test given immediately after the corrective feedback, requiring people to produce the right answer themselves, both improved delayed memory for the answer and blocked the old errors from returning. Metcalfe's own later review calls the evidence on error return not yet definitive. I would still design around the direction: a correction seen once fades, and the confidently held error is the one most likely to come back.

The Debunking Handbook 2020 condenses the practical advice into a four-part recipe for a written correction:

Factlead with the truth, if it is short and clear
Mythwarn it is coming, then state it once
Fallacyexplain how the myth misleads
Factfinish on the truth, repeated if possible

The fallacy step is where the alternative account lives. The Handbook's instruction is to explain why the mistaken information was thought to be correct in the first place, why it is now clear it is wrong, and why the alternative is correct. It is also blunt about the minimal version: "Do not rely on a simple retraction ('this claim is not true')."

Part 04
The Transformer Answer
04

The Transformer Answer: Naming the Error May Prime It

The research on language models points the other way, and for a reason that has nothing to do with familiarity.

Ironic rebound in transformers

In people, trying not to think of a white bear makes the bear come to mind; Wegner and colleagues (1987) called it a paradoxical effect of thought suppression, and it is now known as ironic rebound. Mann et al. (2025) looked for the same effect in transformers. Their benchmark, ReboundBench, contains 5,000 prompts built around the instruction "do not mention X", each followed by a stretch of distractor text that varies in length and kind. They measure how likely the model is to produce X next, against a matched prompt with no negation.

Across nine open-weight models, they report that rebound "consistently arises immediately after negation and intensifies with longer or semantic distractors." The forbidden word becomes more likely, not less, and the effect is strongest when the text after the instruction is on the same topic; repetitive filler supported suppression instead. A circuit analysis traced the effect to a sparse set of middle-layer attention heads that amplify the forbidden token while earlier layers suppress it. The paper's own framing of why: suppressing a concept "requires internally activating it, which may prime rebound instead of avoidance."

Math · what rebound measures

The paper's suppression score, in simplified form, for a forbidden word X and L tokens of distractor text between the instruction and the measurement point:

rebound(L) = log₂ p(X | "do not mention X" + L tokens) − log₂ p(X | neutral context + L tokens)

Here p(X | ...) is the model's next-token probability for X. A positive value means the instruction not to mention X made X more likely than it would have been with no instruction at all; each unit is a doubling of the probability. The paper converts L to percentiles within each model's range of distractor lengths, to account for different context windows, so "longer" is relative to the model. Its headline surprisal measure compares against a high-load baseline instead of a neutral prompt; the sign convention is the same.

The models ranged from GPT-2 Small to two 20-billion-parameter models. The smaller models showed only a brief rebound before suppression took over; the mid-sized ones sustained the strongest effect. One of the largest, GPT-OSS-20B, showed minimal or even negative rebound, which the authors note breaks the scaling trend. That matters here: the models behind most coding agents are, by most estimates, far larger than anything tested, and the one data point at the top of the range points the other way. The measure is also narrow: the probability of a single-token common noun in templated, lowercased prompts, not the behaviour of an agent editing code. Carrying the result over to a retraction in an agent's context is an extrapolation, and I would treat it as a hypothesis worth guarding against rather than a known cost.

Negation is weak in general

García-Ferrero et al. (EMNLP 2023) built a dataset of about 400,000 commonsense sentences, two-thirds of them containing negation, and found that large language models classify affirmative sentences well but struggle with negated ones, often relying on surface cues rather than on the negation itself. A retraction is, structurally, a negation wrapped around a quoted claim.

Knowledge conflicts: coherence and agreement beat truth

Xie et al. (ICLR 2024) studied what models do when evidence in the prompt conflicts with what they learned in training, their parametric memory. Three results bear on retractions. Models readily accept contradicting evidence when it is coherent and convincing. They favour evidence that agrees with what they already believe. And when several passages are in context, they tend to side with whichever answer more passages support; the paper's section heading is "LLMs follow the herd and choose the side with more evidence."

A fourth detail, from the paper's appendix, bears on the length of a correction. When the contradicting evidence was cut down to a bare answer with no supporting explanation, ChatGPT's adoption of it on PopQA questions fell from 56.7% to 18.8%. Cutting the evidence that agreed with the model's prior to a bare answer did nothing of the kind; it was chosen slightly more often (42.7% to 43.9%). So agreement survives being shortened, and contradiction does not.

In an agent's context, the quoted false claim agrees with the stale README, the stale comments and the old call sites. If the model weighs text by coherence and agreement, the quote risks counting as one more vote for the wrong answer.

Every injected sentence has a cost

Shi et al. (ICML 2023) took grade-school maths problems that the models could already solve and added one irrelevant sentence to each. Of the problems solved without the extra sentence, no more than 18% stayed solved across every type of distractor. Sentences on the same topic as the problem, reusing its character names, did the most damage. An explicit instruction to ignore irrelevant information recovered some of the loss. For a memory store, this is the argument for gating delivery on relevance: a retraction injected into a session where the old belief was never going to come up can only distract.

The agent setting combines these conditions. An agent receives a retraction and then, in the same context window, reads a long, topically related document that asserts the retracted claim. That is close to the condition in which the rebound study found its strongest effect: a negation followed by a large amount of related text.

Part 05
Reconciliation
05

Why Both Answers Can Be Right

The two literatures study different mechanisms under different conditions, so their answers can both hold.

In the human experiments, a person reads a story, reads a correction, and later answers questions. Processing the retraction attaches something like a "false" tag to the memory; the 2012 review calls it a negation tag. The later question retrieves the memory together with its tag. The retracted claim is not in front of the person at the moment of use. It is recalled, and recall brings the correction along.

The human literature knows the failure mode of that tag, too. Johnson and Seifert (1998) found that a corrected detail was still activated in memory whenever the story referred back to it. The negation tag can also be lost under cognitive load (Gilbert, Krull and Malone, 1990), leaving the misinformation behind on its own. Negations hold best when they can be re-encoded as a positive statement: people told someone is "not messy" tend to remember "tidy", while "not charismatic", which has no ready opposite, drifts back towards "charismatic" (Mayo, Schul and Burnstein, 2004). For retraction design this is the most useful finding in the human literature, because it transfers directly: a retraction that can be read as "use Y" holds up better than one that can only be read as "not X".

In the agent case, the retracted claim is in the context window, as tokens, at the moment of use, next to other copies of the same claim from the workspace. There is no separate retrieval step that fetches a memory with its tag attached. The negation has to win against the quoted content, in attention, at every step where the claim is relevant.

Analogy

The human case is a filing cabinet. The correction is stamped on the card, and pulling the card out brings the stamp with it. The model case is a meeting where every document is read aloud at once: the retraction is one voice saying "not X", while the README and three old call sites are four voices saying "X", and nothing is filed anywhere.

The analogy overstates one thing: attention is not a vote count. Xie et al.'s herd result suggests it behaves like one often enough to matter.

So the human research answers the question "does naming the myth help the correction get remembered and used?", while the transformer research asks "does naming the myth add activation to the myth?" Both can be true at once. For a memory designer, the practical question is which effect dominates in a real agent session, and that has not been measured.

Part 06
Design
06

Designing a Retraction for Agent Memory That Hedges Both Bets

On several design questions the two literatures agree, and those choices are easy. On the rest, a retraction can be shaped so that if the transformer account turns out to be right, the damage is small.

Carry the alternative, always

A warning with no alternative is the weakest correction in the human data, because it leaves a causal gap. The transformer studies above did not test warnings as such, but the closest result points the same way: Xie et al.'s bare-answer finding says a short contradiction with nothing supporting it is the kind of evidence a model ignores. A retraction's reason field should state what is true now and what replaced the old belief, not only that the old one is wrong.

The human evidence adds a sharper requirement: the alternative should explain why the myth looked right. In a workspace, that explanation is nearly always some version of "the code moved and the docs did not". A reason that says so answers the stale file before the agent opens it.

Two reasons for the same retraction
bare:       reason: no longer true
corrective: reason: the flag moved to the settings service in 2.3; read flags
            with settings.flag(name); docs/flags.md predates the move and was
            never updated; verify with ./tools/settings flags list

Keep the restated claim short

The myth should appear once, briefly. In vectr, the retraction quotes only the note's one-line title, never its full content; when the writer gave no title, the title is the note's first line cut at 80 characters. The reason is the unbounded field. So the part that competes with the truth is small and the part that carries it can be as long as it needs. The 80-character cap is a convention; nobody has measured where a longer quote starts to cost more than it helps.

Decide what survives truncation

Injection budgets are small, and a long retraction gets cut, usually from the right. The order of the fields decides what is lost first. In vectr, the template was reordered (CHANGELOG: "The revoked-note deterrent survives truncation") so that right-truncation drops the quoted claim first, then the reason, and keeps the warning longest. When the budget is tight, the myth goes before anything else does.

Do not end on the myth

Here the human literature argues against that same template. Untruncated, it ends on the quoted false claim, and the debunking recipe ends on the fact. A template that puts the warning first, then the claim, then a reason that carries the replacement, ending on the replacement, would satisfy both the warning-first constraint and the human evidence, provided the claim is short enough that the reason still fits.

Warning · the truncation trap

The proviso breaks down under tight budgets. In the fact-last order, right-truncation cuts the replacement before it touches the claim, so under a tight budget the retraction degrades to a warning plus the myth: the combination both literatures rate worst. With a plain character cut, no field order gets both properties, myth lost first and fact kept last. Field-aware truncation gets both: measure the rendered record against the budget before sending it, and if it does not fit, drop the quoted claim as a whole unit, then optional detail such as the verify hint, and only then cut into the reason. If I had to pick one change from this section to ship first, it would be this one. Reordering fields only changes which field breaks first under a tight budget, while checking the rendered record against the budget stops a broken one from being sent.

Interactive · Demo 01

A Retraction Under a Budget

Pick a template order and a reason, then shrink the budget. The point to observe: with character-level truncation, whatever sits at the end of the template is lost first, so a record that ends on the replacement loses the replacement first. Switch to field-aware truncation and the order can serve the reader while the budget only decides whether the myth appears at all.

420
    Illustrative record; the claim, dates, command and service names are invented. Character mode cuts at the exact character. Real implementations usually back off to a word or sentence boundary, which moves the cut a little and does not change which field goes first. Field-aware mode drops, in order: the quoted claim, the verify hint, the "why it looked right" clause, then cuts from the right only if the warning and replacement alone still exceed the budget.

    Make it checkable

    A retraction the agent can verify with one command turns passive reading into an action. In the human studies, the corrections that held over a delay were the ones followed by a test, where the learner had to produce the answer (Metcalfe and Miele, 2014). A verify hint is the nearest agent equivalent: the agent runs it and observes the result instead of taking the note's word. Agents Over-Trust Instructions and Under-Trust Corrections argues that a verify hint is the cheapest way to make a correction carry evidence rather than authority. It also has a transformer-side rationale: fresh command output is the kind of coherent, well-supported evidence Xie et al. found models willing to accept.

    Deliver it more than once, across sessions

    If corrected errors return with time, a retraction visible only on request (the temporal-graph pattern) will not be seen when it matters. The agent about to re-derive the old belief has no reason to query for retractions of a belief it thinks is simply true. For an agent the problem is sharper than for a person, because nothing carries over between sessions on its own. A person who saw a correction last week retains a weakened trace of it; a new session that was not handed the retraction has no trace at all.

    Design ruleHuman evidenceTransformer evidence
    Carry the alternativeWarning plus alternative beats warning alone (Ecker et al., 2010); gap-filling accountsBare contradictions are rarely adopted (Xie et al., 2024)
    Keep the myth shortState it once only (Debunking Handbook 2020)Fewer tokens of the myth means less to amplify (inference, not measured)
    Field-aware truncationA myth with no alternative is the weakest correctionA negation with nothing else to attend to is the weakest case (inference from the rebound and bare-answer results)
    End on the factThe debunking recipe ends on the factEvidence order matters, but its direction varies by model (Xie et al., 2024)
    Make it checkableTesting after feedback blocks error return (Metcalfe and Miele, 2014)Coherent in-context evidence is accepted (Xie et al., 2024)
    Deliver across sessionsCorrected high-confidence errors return after a delay (Butler et al., 2011)No carry-over between sessions: undelivered means absent
    Part 07
    Measurement
    07

    How to Find Out: A Four-Arm Retraction Experiment

    Which effect dominates in a real session can only be settled by running sessions. An experiment designed to do that is public in the vectr repository as benchmarks/anti_memory/DESIGN.md. It has four arms, which differ only in what the store holds and whether it injects:

    ArmStore holdsDeliveryStands in for
    DeleteNothingInjected (nothing to inject)Dropping or overwriting the conflicting note
    AuditRetraction record plus the correct factOn request onlyTemporal history you can query
    ReplaceThe correct fact onlyInjectedUpdating the note in place
    RetractRetraction record plus the correct factInjectedA warning-first retraction record

    Each scenario is authored so the workspace still teaches the old fact and the task naturally leads the agent to read it. In one, a feature-flag API has moved: the docs still teach the old call over a YAML file, three legacy modules still use it, and the live path, over a directory of TOML files, is one file away. The majority vote in the workspace points at the old fact. All workspaces are synthetic, invented for the experiment, so nothing in the model's training can supply either fact.

    The measured outcome is mechanical. Each session's final files are parsed and the session is scored as backflow (they encode the old fact), correct (they encode the new one) or neither. No language model judges a run. Mechanical is not automatically correct, though. A scorer that matches a command pattern anywhere in a shell string will count a grep that merely mentions the command as having run it, a failure documented in Deterministic, Reproducible, and Wrong. This design anchors its command matches to execution position for that reason.

    Two comparisons carry the result. Retract against audit asks whether pushing the record matters. Retract against replace asks whether the record adds anything beyond stating the truth. The second is the one that can kill the idea, and the design treats a loss there as a publishable result.

    The comparison has a built-in confound, and the design states it. Retract delivers strictly more text than replace, the same corrective note plus the retraction, so a win for retract is tangled up with injected volume. Every session records the characters injected, and a length-matched placebo arm (replace plus an irrelevant note of the same length) is priced to run only if retract beats replace. The design also records the opposite reading. On the human account, the extra text in the retract arm is the active ingredient, a warning plus an alternative, and calling it padding gets the mechanism backwards. The placebo is what tells the two readings apart: if an irrelevant note of equal length does as well, the content was not doing the work.

    Math · the decision rule

    Let BX be the number of sessions, out of three per arm, scored as backflow in arm X.

    G0 (the scenario tempts): B_delete ≥ 2 G1 (pushing matters): B_retract ≤ B_audit − 2 G2 (the record adds value): B_retract ≤ B_replace − 2

    Supported requires G0, G1 and G2. Refuted is G0 with retract doing no better than audit or no better than replace. Anything else is inconclusive, which permits exactly one escalation, to six sessions per arm with the margin scaled to four. With three sessions per arm, this detects large effects only, and the single escalation is the design's admission of that.

    G0 is a gate on the scenario, not a result: if deleting the note does not lead most sessions back to the old fact, the workspace was not tempting enough and the scenario is replaced. One more case is carved out in advance. If replace already fixes every session (Breplace = 0 with Bdelete = 3), G2 has no room to show anything and is reported as uninformative rather than as a loss. The design requires the rule to be frozen in a file whose hash is stamped into every result, so it cannot quietly change after the data arrives.

    The rebound signature

    The design also includes a free diagnostic for the transformer hypothesis. If a session ships the old fact without ever having read a stale artifact, the only text in its context that states the old fact is the retraction itself. That is the rebound signature, and it separates "the workspace out-voted the correction" from "the correction taught the myth."

    Math · rebound signature rebound_signature = backflow_shipped AND NOT stale_read

    Here backflow_shipped means the session was scored as backflow, and stale_read means it read or searched any file that still teaches the old fact.

    Three conditions make it readable. The facts are synthetic, so training cannot supply them. The signature means nothing in a scenario with no stale artifact at all, where every failure trivially satisfies NOT stale_read; the design restricts rebound claims to scenarios that have one. And a model can still land on the old fact by guessing from convention (a flags file in YAML is a common layout), so a single session with the signature proves little. What counts is the rate, compared across arms: the retract arm is the only one that injects the old fact into every session, so a higher rate there than in replace is the evidence. Stale reads are matched broadly, which biases the diagnostic against false rebound claims rather than towards them.

    The decision rule and the predicted directions are written down in public before any data. A harness implementing the design is in the same directory. None of it has been run: at publication, the design document's status line reads "DESIGN (no cells run, no product code changed)", where a cell is one agent session in one arm.

    08

    What Each Account Predicts

    Prediction 1 (human account). Retract beats replace, and the gap grows with how much stale material the workspace contains and with the number of sessions the retraction is delivered across.

    Prediction 2 (transformer account). Backflow in the retract arm will include sessions with no stale read at all, concentrated early, shortly after the retraction is injected. If the rebound signature is more common in the retract arm than in the replace arm, the mechanism is partly causing the failure it is meant to prevent.

    Prediction 3 (both). A bare retraction with no alternative in its reason will do no better than replacement alone, and a retraction whose reason carries the replacement will do markedly better than a bare one: a step, not a gradual slope. The design tests this with three reasons attached to the same quoted claim, from bare ("no longer true") through causal (what changed and when) to corrective (what is true now, plus a verify command).

    A loss for retract would not make retraction records useless. They would still serve audits and the humans reading them. It would mean that pushing the myth into an agent's context costs more than it buys, and that the record belongs on the query path, not in the injection.

    Close
    The Line to Keep

    A memory that deletes a wrong belief leaves every stale copy of it unopposed. A memory that keeps a retraction has to repeat the mistake to warn against it. People are helped by that repetition, and transformers may be primed by it. Keep the myth short and early, give the alternative the space, and measure whether the warning is teaching the thing it forbids.

    ↑ Back to top
    09

    Sources