UnapologeticallyDahling
Sourced essays · Every claim footnotedNo. 118 · Wednesday, 28 October 2026

Culture · 6 min · 13 sources · 10 primary · Verified 16 October 2026 · Sources re-checked 16 October 2026

Can anyone actually tell if a book was written by AI?

Readers in controlled studies scored at chance or worse. Peer-reviewed tests of 2023-era detection software on short texts found it unreliable. No published study has tested a full-length book.

The claimAn assertion with no single originator identified in the record. It acquired a test case after a US crime novel deal was withdrawn over suspected AI use in late July 2026.

“You can tell a book was written by AI because it reads like AI.”

The short answer

Not reliably. In a peer-reviewed study published 5 August 2026, readers were no better than chance at telling human short stories from ChatGPT-4.0 ones. Earlier studies found readers at chance on GPT-3 text and linguists at 38.9% on abstracts, and peer-reviewed tests of 2023-era detectors on short texts found them neither accurate nor reliable.

The claim is easy to state. A book written by AI gives itself away, because it reads like AI. No single originator is identified in the record. The claim met a live dispute in late July 2026, when a crime novel sold in a 14-way auction in the United States was withdrawn by its primary agent over suspected AI use, although the basis for that suspicion has not been reported.10

The controlled record points the other way. In peer-reviewed studies published between 2021 and 2026, readers sorting human writing from machine writing scored at chance or worse.1,2,3,4 Detection tools tested in 2023 were found neither accurate nor reliable on short texts.5 None of those studies tested a full-length book.

What was confirmed about the withdrawn novel?

The Bookseller reported that the crime novel sold in the US for $2.4m and was withdrawn by its primary agent on Friday 31 July due to suspected AI use.10 Publishers Weekly identified the book as Call Me, I'll Hide the Body by Jerry Adedayo Falade.9 PW gives the withdrawal date as July 29 and describes offers reportedly topping $2 million.9 The two trade outlets give different dates, July 29 in PW and Friday 31 July in the Bookseller, and these may describe different steps in the withdrawal. Their money figures differ in form, $2.4m against offers "reportedly topping $2 million", and may not conflict.9,10 PW says it is unknown whether its figure includes foreign rights or film and TV adaptations. The Bookseller article was read only as far as its opening paragraph, so any breakdown it gives was not checked.

In an email from UK agent Sandy Hodgman that PW saw, she wrote that she and Europa 'could no longer substantiate' that the novel was entirely human-written. PW quotes only those words.9 PW wrote: "How exactly the book was judged to have been written by AI remains unknown."9 PW reported that some industry publications said they had run the manuscript through the detector Pangram themselves.9 Falade maintains he wrote the book himself.9

None of the sources reviewed gives a detector result, method or finding.9 The record shows a deal that collapsed and an allegation the author denies. It does not show how anyone concluded the prose was machine-made.

What did the newest study test?

Sydney Sears and Deena Skolnick Weisberg published "Bot or not: Can people tell the difference between stories written by a human or by an AI system?" in Judgment and Decision Making, a Cambridge University Press journal, on 5 August 2026.1 The materials were three pairs of stories of about 1,000 words each. Each pair set a human-written story against a ChatGPT-4.0 counterpart.1 Participants were lay US adults recruited on Prolific.1

The authors report that "participants were no better than chance at differentiating between the human-written and AI-generated stories."1 Participants also rated the AI stories higher for quality and found them more absorbing.1 Self-reported expertise with AI correlated with correct identification. Expertise with literature did not.1

The limits are plain. The studies were not preregistered.1 The stories were short, and the readers were lay US adults, not professional editors.1 This is a study of short fiction and lay readers. It is not a test of a manuscript.

Do other reader studies agree?

Clark and colleagues, at ACL in August 2021, asked non-expert evaluators to separate human writing from GPT-2 and GPT-3 output in stories, news articles and recipes.2 Without training, evaluators distinguished GPT-3 text from human text "at random chance level."2 Brief training raised accuracy to 55% at most. The gain was not significant across domains.2

Jakesch, Hancock and Naaman, in PNAS on 7 March 2023, tested Airbnb, dating and freelancer profiles written by people and by GPT-2 and GPT-3. Participants identified the source with 50 to 52% accuracy.3 This study offers the claim its only partial support. Crowdworkers rated AI text as repetitive more often than human text, 12.7% against 7.1%, and as nonsensical more often, 13.6% against 9.6%.3 A classifier built on those cues reached 58.8% accuracy.3 People's own judgments stayed near chance, and the authors say this was partly because they also relied on cues that did not track authorship. Those cues included grammatical errors, first-person pronouns and family topics.3 So a cue such as repetition can carry some signal in short GPT-2 and GPT-3 profiles. It is a weak one, and readers mix it with false cues.

Literary expertise did not close the gap, and AI expertise helped only somewhat.1 Casal and Kessler asked 72 linguists to judge research abstracts written by people and by an early version of ChatGPT. The reviewers achieved an overall positive identification rate of 38.9%.4 The sample is small and comes from one field.4

Does detection software do better?

Weber-Wulff and colleagues tested 12 free tools plus Turnitin and PlagiarismCheck on about 54 short English documents. Their paper appeared on 25 December 2023.5 They concluded that the tools "are neither accurate nor reliable" and lean towards classifying text as human-written.5 The authors note that the two paid vendors knew the documents were part of a test.5

Liang and colleagues at Stanford tested seven detectors in Patterns on 10 July 2023. They used 91 TOEFL essays and 88 essays by US eighth-graders.6 On the TOEFL essays, all written by humans, the average false-positive rate was 61.3%.6 A simple prompt asking the model to elevate its essays with literary language cut detection of AI essays to near zero.6 The detectors wrongly flagged non-native English writers while classifying the US eighth-grade essays almost perfectly. A simple prompt also let ChatGPT-3.5 college application essays slip past them.6

OpenAI launched its own classifier on 31 January 2023. On its English challenge set, it reported a 26% true-positive rate and a 9% false-positive rate. It described the tool as very unreliable on text below 1,000 characters.7 On 20 July 2023 OpenAI withdrew the classifier "due to its low rate of accuracy."7

The strongest accuracy figures come from a vendor. Pangram, in a 15 September 2025 blog post, put its overall false-positive rate at about 1 in 10,000. It gave rates of 0.009% for short stories and 0.003% for books.8 These are self-reported internal benchmarks, not independent or peer-reviewed results. The post concedes weaker performance on short text and some domains.8 It reports no rate at which the tool catches AI-written books.8 A false-positive rate measures how rarely a tool accuses a human. It does not measure how often it catches a machine.

What does the industry rely on instead?

The question has legal weight. The US Copyright Office stated in January 2025 that copyright "does not extend to purely AI-generated material, or material where there is insufficient human control over the expressive elements."11 The report is policy guidance, not a court ruling, and it does not address detection.11

Amazon's Kindle Direct Publishing requires authors to inform it of AI-generated text, images or translations when they publish a book.12 It distinguishes AI-generated content, which must be disclosed, from AI-assisted content, which need not be. The page does not say how Amazon verifies either.12 The Authors Guild licenses a certification mark, Human Authored, to indicate that a book was written by a human and not generated by AI.13 Its usage guidelines do not explain how claims are verified.13

Amazon's policy requires author disclosure of AI-generated content. The page also says Amazon enforces its content guidelines with machine learning, automation and human reviewers, but it does not say how AI-generated text is identified.12 The Authors Guild's guidelines do not say how claims are verified, and the Copyright Office report does not address detection.13,11 The pages reviewed do not say how any of these schemes check authorship. The Amazon page mentions human reviewers for content guidelines in general, and the Authors Guild FAQ was not opened.

What has not been tested?

Every study above used short texts: stories, profiles, abstracts, essays and recipes.1,2,3,4,5,6 Most used models from 2023 or earlier.2,3,4,5,6 The newest study used ChatGPT-4.0 stories.1 None tested a full novel. A novel may give a reader more to go on, or it may not. The record does not say.

10'It was inevitable': Agents react to major book deal that collapsed over suspected AI usesecondary · News report · 2026-08-04Limitation: The page showed only the opening paragraph before a registration wall, so I did not read the agents' reactions. The lede conflicts with PW on the withdrawal date and the dollar value. Trade reporting, not a primary record of how suspicion arose.
1Bot or not: Can people tell the difference between stories written by a human or by an AI system?primary · Peer-reviewed study · 2026-08-05Limitation: Tested ~1,000-word short stories (three human/ChatGPT-4.0 pairs) with lay US adults recruited on Prolific, not full-length books or professional editors. I read the abstract and Studies 1–2 methods and results. The page was truncated before Studies 2–3 results and the limitations section, so the 'no better than chance' finding is quoted from the abstract. Participants rated the AI story higher quality and more absorbing. Self-reported AI expertise, not literary expertise, correlated with correct identification. Not preregistered.
2All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textprimary · Peer-reviewed study · 2021-08Limitation: Used GPT-2 and GPT-3, which are far older than current models. Covered stories, news articles and recipes with non-expert evaluators. Brief training raised accuracy only up to 55%, and the gain was not significant across domains. I read the abstract page, not the full paper.
3Human heuristics for AI-generated language are flawedprimary · Peer-reviewed study · 2023-03-07Limitation: Studied short verbal self-presentations (Airbnb, dating and freelancer profiles) from GPT-2 and GPT-3, not books or fiction. It supports the claim only in part. Crowdworkers did rate AI text as more repetitive (12.7% vs 7.1%) and more nonsensical (13.6% vs 9.6%). A classifier built on those cues reached 58.8% accuracy. People's own judgments stayed near chance because they also relied on cues that did not track authorship (e.g., grammatical errors, first-person pronouns, family topics).
4Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishingprimary · Peer-reviewed study · 2023Limitation: I read only the abstract on a repository page, not the full paper. Reviewers (N=72) judged research abstracts, not books or fiction. The 38.9% identification rate is the study's overall rate across AI and human texts. The sample is small and from one field, and the model was an early ChatGPT version.
5Testing of detection tools for AI-generated textprimary · Peer-reviewed study · 2023-12-25Limitation: Tested 12 free tools plus Turnitin and PlagiarismCheck on ~54 short English test documents, mostly academic-style and from a ChatGPT version dated Feb 2023. It did not test book-length or fiction text. Page was truncated, so I read the abstract, related work and methodology but not the results tables. The authors caution that the two paid tools' companies knew the documents were part of a test.
9After the Cancellation of 'Call Me, I'll Hide the Body,' What Comes Next?secondary · News report · 2026-08-04Limitation: News report on a disputed case, not a record of the evidence. Falade maintains he wrote the book himself. The agent's email says only that they 'could no longer substantiate' human authorship. No detector result, method or finding has been published. PW gives July 29 as the withdrawal date, while the Bookseller says Friday 31 July, and the dollar figures differ (PW: offers 'reportedly topping $2 million'; Bookseller: $2.4m). Treat the facts as allegations and reporting.
6GPT detectors are biased against non-native English writersprimary · Peer-reviewed study · 2023-07-10Limitation: Tested seven detectors available in 2023 on 91 TOEFL essays and 88 US eighth-grade essays, not on books. The 61.3% average false-positive rate applies to the TOEFL essays only. Authors also found that a simple 'elevate with literary language' prompt dropped detection of AI essays to near zero. The results show that detectors can wrongly flag human writing and can be evaded. They do not measure any current detector on novels.
7New AI classifier for indicating AI-written textprimary · Company filing · 2023-01-31Limitation: The tool's maker describing its own tool. The reported 26% true-positive and 9% false-positive rates (on an English 'challenge set') concern a 2023 classifier that has been withdrawn. They say nothing about today's detectors. The page also says the classifier is very unreliable below 1,000 characters and that AI text can be edited to evade it. Not a statement about books.
8All About False Positives in AI Detectorssecondary · Company filing · 2025-09-15Limitation: Vendor marketing and self-reported internal benchmarks, not independent or peer-reviewed. It gives false-positive rates only (e.g., 0.009% for short stories, 0.003% for books) and reports no detection rate (recall) for AI-written books. The post itself says performance is weaker on short text and some domains. The competitor comparisons are drawn from competitors' own published figures. Pangram is the detector PW says some outlets reportedly used on the Falade manuscript.
11Copyright and Artificial Intelligence, Part 2: Copyrightabilityprimary · Agency page · 2025-01Limitation: A policy report on whether AI output can be copyrighted (U.S. law only). It does not address how anyone would detect AI authorship. I read the executive summary and the first part of the report, which was truncated. Its relevance is that AI authorship has legal consequences, which gives disclosure and proof real stakes. It is not a rule or a court ruling.
12Content Guidelines (Artificial intelligence (AI) content)primary · Agency pageLimitation: A private platform's policy, not law. It rests on self-disclosure by the author: the page does not say how Amazon verifies AI-generated content. It draws a line between 'AI-generated' (disclosure required) and 'AI-assisted' (not required), so the categories depend on what authors report. Page shows no publication date, only a 2026 footer.
13Human Authored Usage Guidelinesprimary · Agency pageLimitation: A trade association's certification program. It shows the industry is turning to registration and licensed marks rather than text analysis. This page does not explain how the Guild verifies claims. The Human Authored FAQ it links to, which may address that, was not opened. No date shown on the page.
The Dahling verdictDoesn't hold

Not reliably, on the published record. In a study published on 5 August 2026, lay readers were no better than chance on short stories, and linguists managed 38.9% on research abstracts. Peer-reviewed tests of 2023-era detectors on short texts found them neither accurate nor reliable. The sources reviewed include no independent test of current detectors. Pangram's post points to third-party evaluations that were not examined. In one study of short GPT-2 and GPT-3 profiles, machine text was more often rated repetitive, but readers also leaned on cues that did not track authorship. No study has tested a full novel. The Falade withdrawal does not test it either, because the sources reviewed give no account of how AI use was judged.

Dahling

Sources and limitations

  1. 1
    Bot or not: Can people tell the difference between stories written by a human or by an AI system?Judgment and Decision Making (Cambridge University Press), Sears & Weisberg, 2026-08-05primary · Peer-reviewed studyLimitation: Tested ~1,000-word short stories (three human/ChatGPT-4.0 pairs) with lay US adults recruited on Prolific, not full-length books or professional editors. I read the abstract and Studies 1–2 methods and results. The page was truncated before Studies 2–3 results and the limitations section, so the 'no better than chance' finding is quoted from the abstract. Participants rated the AI story higher quality and more absorbing. Self-reported AI expertise, not literary expertise, correlated with correct identification. Not preregistered.↩
  2. 2
    All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated TextACL 2021 (Clark et al.), ACL Anthology, 2021-08primary · Peer-reviewed studyLimitation: Used GPT-2 and GPT-3, which are far older than current models. Covered stories, news articles and recipes with non-expert evaluators. Brief training raised accuracy only up to 55%, and the gain was not significant across domains. I read the abstract page, not the full paper.↩
  3. 3
    Human heuristics for AI-generated language are flawedPNAS (Jakesch, Hancock & Naaman), 2023-03-07primary · Peer-reviewed studyLimitation: Studied short verbal self-presentations (Airbnb, dating and freelancer profiles) from GPT-2 and GPT-3, not books or fiction. It supports the claim only in part. Crowdworkers did rate AI text as more repetitive (12.7% vs 7.1%) and more nonsensical (13.6% vs 9.6%). A classifier built on those cues reached 58.8% accuracy. People's own judgments stayed near chance because they also relied on cues that did not track authorship (e.g., grammatical errors, first-person pronouns, family topics).↩
  4. 4
    Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishingResearch Methods in Applied Linguistics (Casal & Kessler), via University of Memphis Digital Commons, 2023primary · Peer-reviewed studyLimitation: I read only the abstract on a repository page, not the full paper. Reviewers (N=72) judged research abstracts, not books or fiction. The 38.9% identification rate is the study's overall rate across AI and human texts. The sample is small and from one field, and the model was an early ChatGPT version.↩
  5. 5
    Testing of detection tools for AI-generated textInternational Journal for Educational Integrity (Weber-Wulff et al.), Springer Nature, 2023-12-25primary · Peer-reviewed studyLimitation: Tested 12 free tools plus Turnitin and PlagiarismCheck on ~54 short English test documents, mostly academic-style and from a ChatGPT version dated Feb 2023. It did not test book-length or fiction text. Page was truncated, so I read the abstract, related work and methodology but not the results tables. The authors caution that the two paid tools' companies knew the documents were part of a test.↩
  6. 6
    GPT detectors are biased against non-native English writersPatterns (Cell Press/Elsevier; Liang et al., Stanford), via PubMed Central, 2023-07-10primary · Peer-reviewed studyLimitation: Tested seven detectors available in 2023 on 91 TOEFL essays and 88 US eighth-grade essays, not on books. The 61.3% average false-positive rate applies to the TOEFL essays only. Authors also found that a simple 'elevate with literary language' prompt dropped detection of AI essays to near zero. The results show that detectors can wrongly flag human writing and can be evaded. They do not measure any current detector on novels.↩
  7. 7
    New AI classifier for indicating AI-written textOpenAI, 2023-01-31primary · Company filingLimitation: The tool's maker describing its own tool. The reported 26% true-positive and 9% false-positive rates (on an English 'challenge set') concern a 2023 classifier that has been withdrawn. They say nothing about today's detectors. The page also says the classifier is very unreliable below 1,000 characters and that AI text can be edited to evade it. Not a statement about books.↩
  8. 8
    All About False Positives in AI DetectorsPangram Labs (vendor blog), 2025-09-15secondary · Company filingLimitation: Vendor marketing and self-reported internal benchmarks, not independent or peer-reviewed. It gives false-positive rates only (e.g., 0.009% for short stories, 0.003% for books) and reports no detection rate (recall) for AI-written books. The post itself says performance is weaker on short text and some domains. The competitor comparisons are drawn from competitors' own published figures. Pangram is the detector PW says some outlets reportedly used on the Falade manuscript.↩
  9. 9
    After the Cancellation of 'Call Me, I'll Hide the Body,' What Comes Next?Publishers Weekly, 2026-08-04secondary · News reportLimitation: News report on a disputed case, not a record of the evidence. Falade maintains he wrote the book himself. The agent's email says only that they 'could no longer substantiate' human authorship. No detector result, method or finding has been published. PW gives July 29 as the withdrawal date, while the Bookseller says Friday 31 July, and the dollar figures differ (PW: offers 'reportedly topping $2 million'; Bookseller: $2.4m). Treat the facts as allegations and reporting.↩
  10. 10
    'It was inevitable': Agents react to major book deal that collapsed over suspected AI useThe Bookseller, 2026-08-04secondary · News reportLimitation: The page showed only the opening paragraph before a registration wall, so I did not read the agents' reactions. The lede conflicts with PW on the withdrawal date and the dollar value. Trade reporting, not a primary record of how suspicion arose.↩
  11. 11
    Copyright and Artificial Intelligence, Part 2: CopyrightabilityU.S. Copyright Office (Register of Copyrights), 2025-01primary · Agency pageLimitation: A policy report on whether AI output can be copyrighted (U.S. law only). It does not address how anyone would detect AI authorship. I read the executive summary and the first part of the report, which was truncated. Its relevance is that AI authorship has legal consequences, which gives disclosure and proof real stakes. It is not a rule or a court ruling.↩
  12. 12
    Content Guidelines (Artificial intelligence (AI) content)Amazon Kindle Direct Publishingprimary · Agency pageLimitation: A private platform's policy, not law. It rests on self-disclosure by the author: the page does not say how Amazon verifies AI-generated content. It draws a line between 'AI-generated' (disclosure required) and 'AI-assisted' (not required), so the categories depend on what authors report. Page shows no publication date, only a 2026 footer.↩
  13. 13
    Human Authored Usage GuidelinesAuthors Guildprimary · Agency pageLimitation: A trade association's certification program. It shows the industry is turning to registration and licensed marks rather than text analysis. This page does not explain how the Guild verifies claims. The Human Authored FAQ it links to, which may address that, was not opened. No date shown on the page.↩

More in Culture

115CultureAre beauty brands changing their packaging only for looks and sustainability?Partly holds16 Oct65CultureWho pays when Trump's beef imports meet the packing plant?Holds up09 Sept