Article URL: https://tejassuds.com/blog/ai-cannot-forget Comments URL: https://news.ycombinator.com/item?id=48859047 Points: 10 # Comments: 4

A look at the actual plumbing of machine memory, why none of it decays the way ours does, and the one operation no architecture has. The phrase is forgive and forget, and we say it like the two things are cousins. They aren't. Forgetting is something that happens to you. Forgiveness is something you do. One is a property of the substrate and the other is a skill learned on top of it, and a machine has neither. It cannot forget, because nothing in it was built to decay. And it doesn't know how to forgive, because forgiveness is an operation no architecture we ship actually has. I want to make that literal, at the level of the plumbing, because this is one of those claims that sounds like a mood and is actually just engineering. When people say "AI never forgets," they're usually gesturing at one system and imagining it's the whole thing. It helps to separate them. A modern AI system holds your past in four different places, and each one forgets in its own broken way, or not at all. The weights are the oldest memory. Whatever a model saw in training is smeared across billions of parameters, and once it's in, we do not know how to get it out. This isn't a policy gap, it's an open research problem. Machine unlearning, removing the influence of specific training data without retraining from scratch, is unsolved at any real scale. You can delete the row from your database. You cannot delete the gradient it left behind. This is the quiet reason "the right to be forgotten" keeps colliding with machine learning: the law assumes forgetting is a delete, and the substrate has no delete. The context window is the working memory, and it forgets like a light switch, not a dimmer. Inside the window, attention treats every token as equally reachable; your first sentence is as addressable as your last, with no softening for age. Then the session ends and it is all gone, completely, at once. Two states, eidetic or void. Humans spend our entire lives in the space between those two, and that space is where nearly all of the social machinery lives. The retrieval store is where this gets its teeth. Embeddings don't blur. Cosine similarity has no time axis. A memory from three years ago is returned at exactly the fidelity of one from yesterday, with no felt sense of long ago attached. In vector space the whole past is co-present, sitting one nearest-neighbor lookup away. The past isn't a foreign country. It's the adjacent row. And the logs, the snapshots and replicas and backups, mean that even deliberate forgetting is a distributed-systems project: tombstones, retention windows, backups that outlive the delete you thought you ran.