
Imagine you're a con artist casing a house. You peek through the window and see a laptop on the desk, a half-eaten sandwich, bills on the counter, a coat on the hook. Everything says 'someone lives here.' Now imagine the same house but the laptop is from 2004, the bills are addressed to three different names, and the coat still has the store tag on it. You'd leave. This paper is about building the first house, not the second — but for cybersecurity honeypots, and with LLMs doing both the decorating and the burgling. The committed claim: when a honeypot's decoy artifacts (fake files, processes, logs, services) tell a mutually consistent story anchored to a recognizable attack scenario, autonomous LLM-powered attackers stay engaged dramatically longer than when artifacts are unrelated or static. Specifically, coherent narrative deception raises the median session length for advanced attackers from 40 to 165 commands and drops their abandonment rate from 86% to 52%. This is not a small delta. The architecture is elegant in its simplicity. An LLM-powered defender watches the attacker's SSH commands in real time, maps each to a MITRE ATT&CK technique, selects a compatible deception scenario from a curated MITRE Engage catalogue, then generates cross-referencing artifacts on an emulated Ubuntu host — files that mention the same incident, logs that corroborate the processes, services that explain the files. The attacker is also LLM-driven, operating at three configurable skill levels (basic, intermediate, advanced), with a termination policy that explicitly distinguishes 'I think this is fake' from 'I'm bored, nothing interesting here.' This distinction matters enormously for interpreting results. The experimental design is surprisingly thorough for a honeypot paper. Four conditions of increasing sophistication — Static (fixed responses), Same-TTP (artifacts matching the current technique), Multi-TTP (artifacts spanning multiple techniques), and Chain (artifacts forming a causal narrative across techniques) — tested across four open-weight attacker models, four defender models, three skill levels, totaling 1,150 sessions. The result scales monotonically: every step up in narrative coherence increases engagement. And the kicker — nearly all session terminations were due to loss of interest, not detection. The attackers weren't catching on; they were just running out of things that looked interesting to pursue. The ladder position is genuinely interesting. Prior LLM honeypot work (HoneyGPT, LLMPot, Cowrie-based systems) evaluated individual responses in isolation — does this single reply look real? This paper reframes the problem as a session-level narrative challenge: does the entire environment cohere? The 4× engagement increase over static baselines and the finding that coherence matters more for skilled attackers than unskilled ones represent a real advance. No prior work demonstrated this narrative scaling effect with this rigor. The integrity picture has clear strengths and gaps. The 1,150-session campaign across 16 model pairings is robust combinatorially. The separation of abandonment-by-suspicion from abandonment-by-boredom is methodologically careful. But the validation is entirely self-referential: LLM attacks LLM honeypot, evaluated by the experimenters. No real attacker was involved. No red-team validation. The artefact budget is held constant across conditions (a smart control), but the scenario catalogue is curated by the authors, introducing potential selection bias toward scenarios where narrative coherence is easy to maintain. The obvious next experiment is a real adversary. The entire result rests on LLM agents as a faithful proxy for human attackers. The authors almost certainly know this is the gap — they explicitly frame LLM-driven offensive agents as 'realistic adversaries' in the abstract, which is a claim that needs testing, not assuming. The honest read: they ran a clean LLM-vs-LLM experiment because it's reproducible and scalable, and human red-team studies are expensive and IRB-complicated. The next paper will either run that study or someone else will.
The analogy
Think of staging a house for sale. A good stager doesn't just put furniture in every room — they create a narrative: the half-read novel by the bed, the spice rack that matches the cookbook open on the counter. Buyers linger in staged homes because the story holds together. This paper does the same thing for honeypots: instead of scattering random decoy files, it generates artifacts that mutually reference a coherent security incident, and measures whether LLM-driven attackers linger longer in a 'staged' compromised system than in one with random props.
Home staging
Cross-referencing props (cookbook + spice rack + grocery list) create a coherent 'someone lives here' narrative that keeps buyers lingering
Narrative honeypot
Cross-referencing artifacts (logs + files + processes + services) create a coherent 'active breach' narrative that keeps attackers exploring
Honest assessment
This is a well-designed LLM-vs-LLM experiment that convincingly demonstrates narrative coherence as the dominant variable in honeypot attacker retention — a reframing that matters for the field. The 4× engagement gain is real and monotonic across conditions, models, and skill levels. The load-bearing assumption is that LLM agents are faithful proxies for human attackers; if that assumption breaks, the entire result needs re-calibration. Worth reading if you work in deception technology, threat intelligence, or adversarial AI; worth tracking if you don't.
What Is CLAIMS?
70
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
4/5
Integrity
3/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Genuine advance: first to show narrative coherence — not individual reply fidelity — is the dominant variable in honeypot attacker retention. Clear claim, cleanly tested across 1,150 sessions.
The field fight
Should honeypot investment prioritize emulator fidelity (making the fake system indistinguishable) or narrative plausibility (making the fake system tell a convincing story)?
Side A
Fidelity wins: attackers detect honeypots through OS fingerprinting, timing anomalies, and missing kernel features. Fix the emulator.
Held by: Cowrie, T-Pot, traditional high-interaction honeypots
Side B
Narrative wins: attackers stay because the environment rewards exploration with coherent findings. Deception quality beats emulation depth.
Held by: HoneyGPT, LLMPot, this paper
Milestone tracker
Unlocks: Deployable narrative deception in production honeypots that retain skilled human attackers long enough for attribution and intelligence gathering
Current
165
median cmds
LLM-vs-LLM advanced
Next
80+
median cmds
Human red-team retention
~1-2 years if red-team collaboration secured
Verified Facts (6)
1,150 sessions compared four conditions (Static, Same-TTP, Multi-TTP, and Chain)
Four open-weight attacker models, four defender models, and three attacker skill levels
Coherent scenarios raise the median session length of advanced attackers from 40 to 165 commands
Reduce abandonment from 86% to 52%
Nearly all sessions ended through loss of interest rather than detection
Defender maps each observed attacker command to a MITRE ATT&CK technique, selects a compatible scenario from a curated catalogue based on MITRE Engage
Practical Implications (4)
Honeypot operators should invest in cross-referencing artifact generation (logs that explain files that explain processes) rather than perfecting individual response fidelity
MITRE ATT&CK + Engage frameworks can serve as a structured scenario catalogue for automated deception at scale
Narrative coherence matters MORE for sophisticated attackers — the approach is most valuable against the adversaries you most want to retain
Artifact budget doesn't need to increase — the same number of artifacts arranged coherently outperforms more artifacts arranged randomly
More latest news
Read all