
You know how every city has a library system — some branches just shelve books on arrival, others have librarians who read every book, write index cards, cross-reference them, and file summaries? The second system is smarter at query time. But the librarians cost money, and if nobody ever asks about that book, you paid for indexing you never used. That is the core tension this paper profiles, and it is the first to put numbers on it. The committed claim: no one has done a systems-level characterization of agent memory before. Not the algorithms — those have been benchmarked for accuracy. The infrastructure. Omri et al. built a phase-aware profiling harness that decomposes cost into three buckets — construction (writing memories), retrieval (reading them), and generation (the downstream LLM call that uses retrieved context). They ran ten representative systems across two benchmark suites and found that the dominant cost axis is not where most practitioners assume. The taxonomy is the load-bearing contribution. Four axes classify agent memory systems: storage granularity (raw chunks vs. extracted facts vs. consolidated knowledge), write-path complexity (append-only vs. LLM-mediated extraction vs. agentic multi-step), read-path complexity (embedding similarity vs. LLM-reranked vs. agentic retrieval), and control flow (static pipeline vs. dynamic agent-decided). This gives you a 2×2×2×2-ish design space where you can place any system and predict its cost profile before you build it. The key finding that matters for practitioners: construction cost dominates. Systems with LLM-mediated extraction or consolidating fact stores pay heavily on the write path — every incoming interaction triggers summarization, entity extraction, or fact-store updates. Flat retrieval systems (just embed and store) are cheap to write but expensive to read at scale. The paper frames this as a freshness-latency tradeoff: you can pay upfront for structured memory and get fast reads, or defer work to query time and eat retrieval latency. Neither is free. The ten system recommendations are where this crosses from academic to operational. Construction scheduling (batch vs. streaming writes), capability floors (minimum model size for extraction quality), amortization via query volume (how many reads justify expensive writes), and fleet-scale management (how memory systems behave when you run thousands of agents). These read like an SRE playbook, not a research paper, and that is the point. Integrity-wise, this is a characterization paper, not a competition paper. There is no single SOTA to beat — the contribution is the measurement framework itself. The two benchmark suites provide the workload, but the paper is honest that ten systems across two benchmarks is a sample, not a census. The profiling harness is the reusable artifact. The obvious next experiment — running this at genuine fleet scale with real production traffic patterns rather than benchmark proxies — is missing, almost certainly because the authors are in academia and do not have access to a 10,000-agent production deployment. The field fight here is structural: should agent memory be dumb-and-cheap (flat RAG, pay at read time) or smart-and-expensive (consolidated knowledge graphs, pay at write time)? This paper does not pick a side — it gives you the cost model to pick for your workload. That is more useful than another accuracy benchmark, and it is the kind of infrastructure paper that ages well because the tradeoffs it identifies are architectural, not tied to any specific model generation.
The analogy
Think of a city library system: some branches just shelve every book on arrival (cheap to stock, slow to find anything), while others employ librarians who read, index, and cross-reference every acquisition (expensive upfront, instant retrieval). This paper is the first audit of which library model actually costs less when you account for both stocking and searching.
Library systems
Shelve-on-arrival (cheap write, slow read) vs. librarian-indexed (expensive write, fast read) — total cost depends on how often patrons search
Agent memory
Flat retrieval (cheap construction, expensive query) vs. LLM-mediated extraction (expensive construction, cheap query) — total cost depends on query volume
Honest assessment
This is a genuine infrastructure contribution — the first paper to treat agent memory as a systems engineering problem rather than an accuracy competition. The taxonomy and profiling harness are the durable artifacts; the specific numbers on ten systems will age as architectures evolve. Most useful today for platform teams deciding how to architect memory for multi-agent deployments. The gap between benchmark profiling and production-scale validation is real but expected for an academic team. If you are building agent infrastructure, read this paper. If you are building a single chatbot, this is not for you yet.
What Is CLAIMS?
63
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
4/5
Integrity
3/5
Milestone
2/5
Successor
3/5
What is this paper actually committing to?
Credible first. No prior work profiled agent memory at the systems level — decomposing cost into write, read, and generation phases across architectures. The claim is 'measurement infrastructure,' not a new algorithm.
The field fight
Should agent memory invest cost at write time (structured extraction, consolidation) or defer it to read time (flat retrieval, reranking)?
Side A
Pay at write time — structured memory enables fast, precise retrieval and scales better with query volume
Held by: MemGPT, consolidating fact stores, entity-graph builders
Side B
Keep writes cheap — flat RAG with embedding search is simpler, and you only pay retrieval cost when you actually query
Held by: Flat retrieval systems, vanilla RAG pipelines
Milestone tracker
Unlocks: Production-grade cost models that translate architectural choices into dollar figures per agent-hour
Current
10
systems
benchmark-scale profiling
Next
1000+
agents
fleet-scale validation
~1-2 years, requires industry partnership or open-source fleet maturity
Verified Facts (7)
LLM agents are increasingly deployed on long-horizon tasks requiring sustained reasoning over extended interaction histories
A rich ecosystem of agent memory systems has emerged spanning flat retrieval, LLM-mediated extraction, consolidating fact stores, and agentic control flows
We present the first systems characterization of agent memory
We introduce a system-oriented taxonomy classifying agent memory systems along four axes
We build a phase-aware profiling harness attributing cost to construction, retrieval, and generation
We characterize ten representative systems across two benchmark suites
We derive 10 system recommendations covering construction scheduling, capability floors, amortization via query volume, freshness-latency tradeoffs, and fleet-scale management
Practical Implications (4)
Platform teams can use the four-axis taxonomy to classify their memory architecture and predict its cost profile before committing to implementation
The write-vs-read cost tradeoff is now quantified: high-write systems (LLM extraction, fact consolidation) only amortize if query volume is high enough to justify construction cost
Construction scheduling (batch vs. streaming) is a first-order cost lever — the paper's recommendations give concrete guidance on when to defer memory construction
Capability floors matter: below a certain model size, LLM-mediated extraction produces low-quality memories that cost as much to build but retrieve poorly — flat retrieval may win
More latest news
Read all