Forgetting Is a Capability, Not a Failure

Every memory system is built so that nothing is lost, and calls that a feature. The shorter description is the understood one, so a system that cannot drop what it has already generalized is not remembering more. It is only understanding less, more expensively.

Every agent memory system is built to retain. Loss is the failure mode the design is organized against: notes persist, deletion is guarded, expiry is a reluctant concession to storage limits, and the marketing promise is that nothing you tell it will be dropped.

That framing has it backwards, and the reason is not sentimental.

Generalization is lossy compression. To know that every handler in a module shares a shape, the system has to have stopped holding each handler separately. To know a rule, the system has to have discarded the instances the rule replaced. A store that retains every particular with equal fidelity has not learned the general case. It has an index of particulars, and an index is not an abstraction.

Principled forgetting is a capability that current memory systems do not have and are not trying to build. They have eviction, which is forgetting under storage pressure, chosen by whatever is cheapest to lose. That is not the same thing, and the difference is the whole subject.

Before the argument runs, three disambiguations. First, the case for validity is different: a note that was true becoming a note that is no longer true argues that the note should change state rather than vanish. This one is about redundancy: a note that is still perfectly true but has been subsumed by a generalization the store also holds. Those are different reasons to stop keeping something, and the operations that handle them are different. Second, the forgetting here is the opposite of catastrophic forgetting in continual learning, which is the model's failure to retain what it has already learned. The forgetting here is the deliberate removal of items that have been subsumed, which is a feature. Third, the cognitive-science phenomenon of retrieval-induced forgetting in humans is close in spirit and is evidence for the same underlying claim. The difference is the level of operation: RIF is a side effect of retrieval in biological memory, while the operation argued for here is a deliberate, content-aware removal in an agent memory store.

Part 01
The Distinction
01

Eviction Is Not Forgetting

The distinction is worth being exact about, because every memory system will claim it already forgets.

Eviction answers a specific question: the store is too big, what goes? The criterion is a proxy for cost. LRU drops what has not been touched for the longest time. A score-based policy drops the item with the lowest retrieval-weighted score. The trigger is pressure, and the policy is indifferent to meaning. Nothing about an LRU rule asks whether the store is better afterwards; it asks whether it is smaller.

Forgetting, as a capability, answers a different question: this item has been superseded by something more general, and keeping it now costs more than it returns. That is a judgment about content and its relationship to the rest of the store, and it can fire when there is no pressure at all.

The tell is the trigger. If your forgetting only happens when you are running out of room, you have eviction. If it never fires on a store with infinite space, it is not a capability; it is a constraint.

And the direction matters. Eviction under pressure drops what is cheapest to lose, which correlates with what is rarely retrieved, which correlates with what is unusual. Principled forgetting should often drop what is most common, because that is what has been successfully abstracted. The two policies do not merely differ. They point opposite ways.

Insight

Most production agent memory stores implement some form of pressure-based eviction, but none implements principled forgetting. Mem0's update path is ADD, UPDATE, DELETE, or NOOP, all invoked when the model writes a new fact, not because the store noticed redundancy. Zep's invalidation fires on contradiction rather than subsumption. Letta hands eviction to the agent itself, which means whatever forgets is whatever the model decided to forget, not whatever the store noticed was redundant. The cheapest available memory operation in the field is still pressure-based.

This is also the place to draw a line that will return: forgetting here is not a synonym for deletion. Some compression operations that change the store may not destroy a row. The count-min sketch, the sufficient statistic, the pattern plus its frequency, all of these drop the instances and keep a derived form. The operation argued for here is the broader category of content-aware reduction, of which destruction is one implementation.

Part 02
The Pathology
02

Why Total Retention Degrades Retrieval

The case against total retention is usually made on cost: storage, indexing time, retrieval latency. Those are real, and they are not the interesting part.

The interesting part is that retention actively makes retrieval worse, and it does so in a way that gets worse with success.

Every stored item is a competitor in every future retrieval. Twenty near-identical observations of the same behavior do not make that behavior twenty times easier to find. They occupy twenty slots that could have held twenty different things, and they crowd out the distinct answer the query was actually reaching for. The store's coverage of a question rises at the same time as its ability to answer that question falls, which is a property the field does not have a name for, because it is so counter to the usual assumption that more data is better.

Worse, the items most likely to pile up are the ones the system encountered most often, which are exactly the ones a working abstraction would have replaced with a single statement. The redundancy concentrates on the topics the system knows best. A store with no forgetting is least useful precisely where it has the most experience.

Analogy

A reader's index card file works the same way. Two hundred cards about the same author, one per paper, is not a better index than ten cards: it is a worse one, because the specific cards now compete with each other for the same retrievals and the user can no longer find a card about any author without first sorting past the ones about this one. The remedy in a real index is the same remedy the argument here proposes: collapse the per-instance cards into a single statement, with the count of supporting instances noted next to it. The index is now smaller and answers more questions.

This is not hypothetical and it is not exotic. It is the ordinary end state of any append-only store that runs long enough. The retrieval-quality fall is steepest on the topics with the most stored items, which is the diagnostic signature of the pathology. A store that gets uniformly worse as it grows is suffering a scaling problem; a store that gets worse faster on the topics it knows most about is suffering this specific disease.

The mechanism is easy to see and worth stating. A retrieval system that ranks by similarity to a query is, on a query about a topic the store has seen many times, presented with a long list of near-duplicates. Each one looks like a viable answer. Each one carries the same surface form. The ranking is forced to break the tie somewhere, and the tie-break is usually a usage signal, which means the items retrieved most often in the past are retrieved again, which means they are retrieved even more often in the future. Recall becomes a write operation, and the dense cluster of duplicates accumulates retrieval history that hides the more general note the store should have promoted.

Part 03
The Hard Part
03

Three Failure Modes of Principled Forgetting

If the argument stopped at Part 2 it would be too easy. The reason nobody builds this is not oversight. Three properties make principled forgetting the hardest operation in the store.

The failure is silent and irreversible

A retrieval miss is visible as an empty result; the caller knows something is wrong. A wrongly forgotten item produces a confident, well-formed answer with a hole in it, and nothing anywhere says so. Combine that with irreversibility and you have the worst error profile in the system: undetectable at the time, unrecoverable afterwards.

The system looks fine. Retrieval returns. The model uses the answer. The user sees a coherent reply. The missing evidence is invisible because the question that would have surfaced it was never asked, and the missing evidence is unrecoverable because the row that carried it is gone.

The exception is what you need, and the exception looks droppable

The instance that violates a generalization is, by construction, rare, rarely retrieved, and low-scoring on every usage proxy. Every cheap forgetting policy targets it first. The one case where the general rule fails is the one case a naive policy is most likely to discard, and it is also the case where being wrong is most expensive. A store that drops its exceptions loses the only evidence that the rule is bounded, and a rule with no known exception is a rule that is one observation away from being false.

This is a sharp property and it cuts against the whole argument. Principled forgetting that does not protect exceptions is not principled at all. It is just a smarter eviction policy that knows how to find the rare items.

The abstraction can be wrong

Replacing twenty instances with a rule is an inference. If the rule is wrong and the instances are gone, the evidence that would have corrected the rule has been destroyed by the same operation that created it. That is a closed loop with no exit, and it is the most dangerous single property in the whole proposal.

The store now holds a confident-looking note, derived from a sample the size of which it can no longer reconstruct, about a pattern that may not actually be there. The note looks load-bearing because it is abstract. The next time the system is asked, the abstract note answers. The exceptions that would have shown the abstraction was wrong are no longer in the store to do that work.

Warning

Any serious design has to answer these, not route around them. The obvious mitigations, keeping a compressed trace of what was dropped, keeping counter-examples preferentially, making the abstraction reversible while its evidence survives, all cost exactly the space forgetting was meant to reclaim. That tension is real, and an argument that pretends otherwise is not worth making. The position here is that the tension is worth resolving, not that it is resolved.

Part 04
The Design
04

What a Real Forgetting Policy Would Need

Sketched as design directions rather than solutions, because none of these has been validated at the level Part 6's experiments would demand. The bar is to give each of Part 3's three failure modes a structural answer.

Forget the subsumed, not the unused

The candidate for removal is an item whose content is entailed by a more general item that is also stored. That is a relationship between two stored things, computable without reference to usage, and it points at redundancy rather than at rarity. The store notices, in other words, that one note is the abstraction of a hundred others, and acts on the relationship, not on the access history.

This is the part that is the most clearly missing from every shipped system. None of the current designs inspect the relationship between stored items on a regular schedule. The store sees a collection of rows; it does not see a graph of entailments.

Protect the exception explicitly

If an item contradicts a stored generalization, it is the single most valuable thing in the store, because it is the only evidence that the generalization is bounded. It should be the last thing dropped, not the first. This inverts the usual policy, and it is probably the highest-leverage single rule available.

The rule composes with the previous one. The subsumed is the candidate. The exception-bearing is protected. The two together say: forget the items that are redundant given what the store also holds, and protect the items that are most informative precisely because they are not redundant.

Keep the count, drop the copies

Twenty instances of a pattern can often become one statement plus the number twenty. The count preserves the strength of the evidence, which is most of what the twenty were carrying, at a fraction of the space. What is lost is the ability to re-derive the abstraction from scratch, which is a real loss and should be stated.

Math

The formal name for the operation is sufficient statistic, in the Neyman-Fisher sense: a function of the data that retains all the information in the data relevant to a parameter. Twenty Bernoulli observations of a coin collapse to the count of successes, which is sufficient for the probability parameter. The individual outcomes can be discarded without loss of inferential information, and the same idea, applied loosely, is what "keep the count, drop the copies" is doing. The right way to think about it is that a count is a compressed form of the data, not a degradation of it, and the decision to keep the count is the decision to keep the data in its most compressed sufficient form.

Stream clustering systems have shipped a version of this idea. CluStream's micro-clusters carry a cluster feature vector with linear sum, squared sum, and timestamp sums that are sufficient statistics for the cluster's center and spread, and the individual points are kept only as long as the micro-clusters need them. The same machinery, transposed to an agent memory store, is what a "keep the count, drop the copies" rule would look like in practice.

Make it observable

A store that forgets must be able to say what it forgot and roughly why, even if it cannot restore it. A silent lossy operation on a user's memory is not acceptable, and a tombstone is cheap compared to what it replaces. The user has the right to know what the store has decided is redundant, and the store that makes the decision has the obligation to surface it.

This is also the rule that makes the rest of the design auditable. Without an audit log of subsumption events, there is no way to tell whether the policy is doing what it claims to be doing, and there is no way to recover when the policy is wrong.

Part 05
The Connection
05

Compression, Understanding, and the Disabled Learning Loop

The larger argument, stated so it can be argued with.

Compression and learning are close to the same thing. A model that has found a shorter description of its experience has, in a real sense, identified regularity in it, and the identification is what model selection under the minimum description length principle treats as evidence the model is a better model. The cautious claim here is established in the MDL literature: shorter description length is a model selection criterion, and a more compressed model is in a precise sense a better model of the regularity in the data.

The stronger claim, sometimes drawn from this tradition, that "to understand is to compress," is an extrapolation and not a theorem. It is the working hypothesis used to motivate the design argument, and the design argument would still hold without it. State it precisely and the argument is that a system architecturally prevented from compressing its own experience is prevented from doing the work that model selection requires, however capable its reasoning is in the moment.

Insight

The cognitive-science version of this claim is older and better supported. Anderson, Bjork, and Bjork's 1994 paper on retrieval-induced forgetting established that retrieval of one item suppresses retention of related items, and the result is widely read as adaptive: the system is reducing interference, sharpening the items most likely to be needed next, at the cost of weakening items less likely to be retrieved. The same underlying logic, that the system gets better at what it is asked to do by getting rid of what it is not, is the move from which the argument here takes its license. The 2023 Annual Review of Psychology piece on active forgetting makes the adaptive case explicitly. Memory is not a recording. It is a system that selectively retains what the present task needs.

Current agent memory is architecturally prevented from compressing its own experience. It appends. It never reduces except under pressure, and the reduction it does perform is content-blind. So the store grows monotonically as an undigested record, and the ratio of what the system has understood to what it has stored falls with every session.

The provocative form, stated so it can be argued with: an agent that cannot forget cannot learn, only accumulate. Those look similar early on, when the store is small and everything in it is useful. They diverge completely at scale, and every system currently shipping is on the accumulation curve.

Part 06
Predictions
06

What an Experiment Would Have to Show

The argument is structural, not measured. Three predictions make it testable, and the third is the one most likely to come back negative.

Prediction 1. In an append-only store, retrieval precision on a fixed query set should fall as store size grows, and the fall should be steepest on the topics with the most stored items. The second clause is the discriminating one: uniform degradation would just be a scaling problem, while degradation concentrated where coverage is highest is the specific pathology Part 2 describes. This needs no new mechanism, only an existing store, a fixed query set, and per-query precision measurements stratified by store density.

Prediction 2. Replacing a cluster of near-identical items with one generalization plus a count should leave retrieval quality unchanged or better on queries about that cluster, while freeing slots that measurably improve unrelated queries. If quality on the cluster drops, the compression was lossy in a way that mattered and the policy needs narrowing. If unrelated queries do not improve, the freed slots are not the constraint and the rest of the analysis is wrong.

Prediction 3. A policy that preferentially retains contradiction-bearing items should outperform a usage-based policy on queries whose correct answer is an exception. This tests Part 4's inversion directly, and it is the one most likely to come back negative, because exceptions may simply be too rare to measure with any reasonable sample size. A negative result here is not a refutation of the policy. It is a refutation of the measurability of the property, and the design would have to fall back on the structural argument alone.

Prediction 1 first. It needs no new mechanism, only an existing store and a fixed query set, and it establishes whether the problem is real before anything is built.

Interactive · Demo 01

Two Stores, Same Items, Different Policies

A simulation of a small agent memory store under two policies at once. Add instances of a pattern (each near-duplicate of the last) and watch both stores behave. The left store evicts by usage: the item that was retrieved most recently is the one that survives. The right store applies principled forgetting: it notices when a new note subsumes the old ones, and collapses the cluster to a single statement plus a count. Add a counter-example, the one observation that does not fit the pattern, and watch what each policy does to it. The point to observe: usage-based eviction targets the rare item first, because rare means low usage. Principled forgetting targets the redundant cluster first and protects the exception.

12
Usage-based eviction (LRU)
Principled forgetting (subsumption)
The simulation uses a small deterministic model: a usage signal that rises on every retrieval, an LRU that drops the lowest-usage item when the store is full, and a subsumption rule that fires when a new note covers the content of an older one. Add enough items and the LRU store will eventually evict the counter-example to make room for the redundant cluster; the principled store will not. Deterministic per item index, so resets replay identically.

The closest published substrate for Prediction 1 is LongMemEval's knowledge-update split, which tests whether an agent can correctly apply information that was stated early and contradicted later. Existing runs report large accuracy drops on this split across the leading long-context and tool-augmented chat assistants. Whether the drop is concentrated on the topics with the most stored items is the question the experiment would have to answer, and it is one no current public run asks directly.

Close
The Line to Keep

Every agent memory system is built so that nothing is lost, and calls that a feature. But the shorter description is the understood one, so a system that cannot drop what it has already generalized is not remembering more. It is only understanding less, more expensively.

Principled forgetting is the operation that would let a memory store notice when one note is the abstraction of a hundred others, and act on the relationship. The store that has it can answer more questions with less, which is the whole point of abstraction. The store that does not have it is on the accumulation curve, and the accumulation curve is where every system currently shipping lives.

↑ Back to top
07

Sources

  • Anderson, M. C., Bjork, R. A., Bjork, E. L. "Remembering can cause forgetting: Retrieval dynamics in long-term memory." Journal of Experimental Psychology: Learning, Memory, and Cognition 20(5), 1994, pp. 1063-1087. The 1994 paper that established retrieval-induced forgetting. Quoted and relied on in Part 5.
  • Anderson, M. C., Bjork, E. L., Bjork, R. A. "Retrieval-induced forgetting: Evidence for a recall-specific mechanism." Psychonomic Bulletin & Review 7(3), 2000, pp. 522-530. Showed that retrieval, not mere exposure, is what drives the suppression. The 2000 result is the one that supports the adaptive reading. Part 5.
  • Anderson, M. C., Hulbert, J. C. "Active Forgetting: Adaptation of Memory by Prefrontal Control." Annual Review of Psychology 72, 2021, pp. 1-36. The consolidation of the active-forgetting argument, including the prefrontal-control neurobiology. Part 5.
  • Nørby, S. "Why Forget? On the Adaptive Value of Memory Loss." Perspectives on Psychological Science 10(5), 2015. Frames forgetting as functional across emotion regulation, abstraction, and context attunement. Background for Part 5.
  • McCloskey, M., Cohen, N. J. "Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem." In Psychology of Learning and Motivation, vol. 24, Academic Press, 1989, pp. 109-165. Original paper on catastrophic interference. The disambiguation from this line of work is in the introduction.
  • Li, M., Vitányi, P. An Introduction to Kolmogorov Complexity and Its Applications. Springer. The textbook treatment of MDL and its derivation from Bayes via Kolmogorov complexity. The formal claim Part 5 leans on.
  • Grünwald, P. D. "A Tutorial Introduction to the Minimum Description Length Principle." arXiv:math/0406077, 2004. The pedagogical treatment, also the opening chapters of Advances in Minimum Description Length: Theory and Applications, MIT Press. Part 5.
  • Fisher, R. A. "On the Mathematical Foundations of Theoretical Statistics." Philosophical Transactions of the Royal Society A 222, 1922, pp. 309-368. The original statement of the sufficient-statistic idea, and the source of the Neyman-Fisher factorization theorem used in the callout in Part 4.
  • Aggarwal, C. C., Han, J., Wang, J., Yu, P. S. "A Framework for Clustering Evolving Data Streams." VLDB 2003. The CluStream paper, source of the cluster feature vector that is the practical implementation of "keep the count, drop the copies" in stream clustering. Part 4.
  • Chhikara, P., Khant, D., Aryan, S., Singh, T., Yadav, D. Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory. arXiv:2504.19413. The four-operation update vocabulary; the absence of principled forgetting in the production design. Part 1.
  • Wu, D., Wang, H., Yu, W., Zhang, Y., Chang, K.-W., Yu, D. LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory. ICLR 2025, arXiv:2410.10813. The knowledge-update split and the accuracy drop it reports. Cited as the substrate for Prediction 1 in Part 6.