AI text detectors struggle when language models mimic an author's style

AI text detectors struggle when language models mimic an author's style

Key Points

- A research team at Epoch AI has shown that popular AI text detectors like Pangram, GPTZero, and Originality.ai can identify AI-generated text with near-perfect accuracy under standard conditions.

- When AI models are prompted to imitate a specific author's writing style using text samples, the detectors' performance drops significantly, with an average of 13 percent of the generated passages slipping through undetected.

- Scientific writing is a weak spot: detectors failed to flag between 24 and 29 percent of style-mimicking AI-generated content in that category, raising concerns about the reliability of these tools in educational settings.

Popular AI text detectors catch plain AI-generated text with near-perfect accuracy. But when language models deliberately copy a specific author's writing style, up to one in five AI texts slips through undetected. Scientific writing is where the detectors fail the hardest.

A research team from Epoch AI tested three of the most widely used AI text detectors: Pangram (version 3.3.2), GPTZero (model 2026-05-11-base), and Originality.ai (Turbo 3.0.2). The test covered three categories: genuine human writing, AI text generated from simple prompts, and AI text that deliberately mimicked a specific author's style.

The team built a corpus of 495 human passages from 99 authors, evenly split across blogging, fiction, and scientific writing. All texts were written before ChatGPT's release in November 2022, which effectively rules out contamination by language models.

When dealing with plain AI-generated text, all three detectors performed almost flawlessly, with the false-negative rate topping out at 0.7 percent. Human texts were also classified correctly for the most part. Pangram and GPTZero didn't produce a single false alarm. Originality.ai, however, flagged 19 out of 495 human passages as AI-generated, a troublingly high false-positive rate of 3.8 percent.

Style imitation tanks detection rates

That result changes when language models receive writing samples from an author as reference material. For this test, three frontier models (Claude Opus 4.8, GPT-5.5, and Gemini 3.1 Pro) each received five real text passages from an author and were asked to write new text in the same style.

Of the 297 passages generated this way, an average of 38 went undetected, according to Epoch AI, which works out to a false-negative rate of about 13 percent. Pangram missed 10 percent of style-imitated texts, GPTZero missed 11 percent, and Originality.ai missed 18 percent.

For fiction, the false-negative rate across all detectors sat at just 1 to 5 percent. scientific writing told a very different story. Pangram failed to catch 25 percent of style-imitated academic AI texts, GPTZero missed 24 percent, and Originality.ai missed 29 percent.

The worst individual results showed up in specific model-genre combinations within scientific writing. Pangram missed 48 percent of Gemini-generated academic passages, according to the published data. At Originality.ai, 39 percent of academic GPT-5.5 texts went undetected.

Different methods, same blind spots

Pangram uses a neural network trained on human and machine-generated text, though its founder has called the system a black box since its verdicts can't be traced. GPTZero measures how predictable word choices are and how much that varies within a text, based on the idea that language models write more uniformly than humans. Originality.ai searches for statistical patterns it learned during training on human and AI-generated text.

Despite these differences, all three detectors show the same pattern. They catch text from simple prompts almost every time but miss imitations far more often. Scientific writing, the genre where AI detection probably sees the most real-world use, remains the hardest to flag correctly.

An earlier Authors Guild test found that Pangram and Originality.ai reliably classified human texts as human. The Epoch AI study fills in the other half of that picture: a low false-alarm rate on human writing says little about how many AI texts actually slip through.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Subscribe now