Agent Memory: The Hardest Unsolved Problem in Agentic AI

An agent without memory is a goldfish with tools: brilliant for thirty seconds, amnesiac across sessions, doomed to re-ask, re-fetch, and re-offend. And yet memory is where I see the most architectural hand-waving in agentic designs — "we'll just store the conversation" is not a memory system.

Useful framing: agents need three different memories, and conflating them is the root failure. Working memory — the context window — is the desk: what this task needs right now. Episodic memory is the logbook: what happened in past interactions, checkpointed and queryable. Semantic memory is distilled knowledge: stable facts and preferences extracted from episodes — "this client reports in crores, fiscal-year April–March, hates bullet points."

Storing raw transcripts and vector-searching them back in feels like memory and behaves like noise: retrieval surfaces stale decisions next to superseding ones, contradictions accumulate, and the context fills with history instead of task. The failure I see repeatedly in production: an agent confidently acts on a preference the user reversed two weeks ago, because both memories scored similarly and nobody built supersession — new facts must overwrite, not coexist with, the facts they replace.

A write path with judgment: after each episode, an extraction step decides what's worth remembering — typed facts with provenance and timestamps, not prose blobs. A read path with discipline: retrieve memories by relevance and recency and confidence, inject few, label them as memory (so the model treats them as context, not gospel). Decay and conflict-resolution policies, because memory that only grows is a landfill. And checkpointed working state for long-running tasks, so a crash resumes instead of restarting — in LangGraph terms, that's your checkpointer, and in production it's non-negotiable.

Bottom line: treat memory as a designed subsystem — typed writes, disciplined reads, supersession, decay, governance. Bolt-on memory is how agents become confidently wrong with a perfect recollection of why.