arxiv paper

Emile Kroeger – ... @EmileAnd... · 13h
Not sure I approve of creating self-replicating LLM viruses even as a "proof of concept", this is basically gain-of-function research on a different class of viruses...

[quoted tweet]
Maxime Fourne... @FournesMa... · Aug 4
First successful proof of concept of a self-replicating AI virus, based on an open-source LLM from 2025 (!). Link to the paper in comment.

The authors write: "We must prepare for ...

[embedded arXiv page]
arXiv
Computer Science > Cryptography and Security
[Submitted on 2 Jun 2026]
AI Agents Enable Adaptive Computer Worms
Jonas Guan, Tom Blanchard, Hanna Foerster, Hengrui Jia, Gabriel Huang, Nicolas Papernot

A computer worm is malware that spreads on a network by replicating itself from one machine to another. Traditional worms, like WannaCry, exploited predetermined vulnerabilities, and their spread can be halted by patching those vulnerabilities. Here we show that artificial intelligence (AI) agents enable a fundamentally new threat: a worm that generates tailored attack strategies to each target it encounters. The worm parasitically uses compromised machines to run open-weight large language models (LLMs) to sustain its reasoning, or extend its reach for further attacks. Deployed on a network of machines spanning Linux, Windows, and IoT (Internet of Things) devices, the worm propagated by exploiting common, real-world computer network vulnerabilities. Since the worm is powered by stolen compute, the attacker's marginal cost per new infection is zero. This creates a destabilizing economic asymmetry between attackers and defenders. Moreover, because the worm requires no commercial AI platform, centralized safety controls, such as service refusals or rate limiting, are structurally irrelevant. Our results demonstrate that self-sustaining AI-driven cyber-threats are no longer theoretical. We must prepare for autonomous generative adversaries: malware systems that propagate without human operators and are defined not by fixed exploit code, but by the capacity to reason about targets, adapt to observations, and synthesize attack logic in real time.

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2606.03811 [cs.CR]
(or arXiv:2606.03811v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2606.03811
Submission history
From: Hengrui Jia [view email]
[v1] Tue, 2 Jun 2026 15:54:39 UTC (918 KB)

ai safetycybersecurityself-replicating malwarearxiv paperx twitter