🔥 Hot topics · ⛔ Can NOT do · ✅ Can do · § The Court · ⚖ Recent inflections · 📈 Timeline · ❓ Ask · ✨ Editorials · 🔥 Hot topics · ⛔ Can NOT do · ✅ Can do · § The Court · ⚖ Recent inflections · 📈 Timeline · ❓ Ask · ✨ Editorials
Stuff AI CAN'T Do

Can AI identify sarcasm in written text reliably ?

What do you think?

Even a raised eyebrow can be a dead giveaway, yet sarcasm often slips past even the most advanced language models, hiding behind straight faces and shifting cultural cues. Research shows that modern AI can occasionally spot the wink of dry humor, but consensus remains elusive as accuracy still falters when sarcasm wears its most subtle disguise. The court has weighed the patchy successes against the persistent stumbles, finding enough promise to pause but not enough to declare victory.

Background

State-of-the-art models such as PaLM 2 and LLaMA 3 show measurable improvements in detecting sarcasm when fine-tuned on curated datasets like the Sarcasm on Reddit corpus, outperforming earlier systems by roughly 12–15 percentage points on balanced test sets. Evidence from controlled benchmarks indicates that accuracy can reach the mid-70 % range when models are trained on explicit contextual markers and user history annotations, yet these gains evaporate when sarcasm relies on shared cultural references that lie outside the training domain. Named systems including RoBERTa-base and DeBERTa-v3 have set milestones by leveraging contrastive attention over incongruent sentiment spans, while newer variants such as Mistral-7B-Instruct achieve better zero-shot transfer by treating sarcasm detection as a multi-hop inference task. A key limitation remains the scarcity of large, diverse, and culturally inclusive datasets, as current resources over-represent Western English forums and under-sample ironic expressions in low-resource languages or niche communities.

SOURCE: Nature, 2024

Status last checked on September 26, 2026.

📰

Gallery

In the Court of AI Capability
Summary of Findings
Verdict over time
May 2026May 2026May 2026May 2026May 2026May 2026Jun 2026Jun 2026Jun 2026Jun 2026Jun 2026Jul 2026Jul 2026Jul 2026Jul 2026Jul 2026Jul 2026Aug 2026Aug 2026Aug 2026Aug 2026Aug 2026Sep 2026Sep 2026Sep 2026
Sitting at the Bench Filed · Sep 26, 2026
— The Question Before the Court —

Can AI identify sarcasm in written text reliably?

★ The Court Finds ★
Reaffirmed
⚖
Almost

Narrow demos exist — but the panel was not unanimous.

Jury Tally
0Yes
1Almost
0No
Verdict Confidence
90%
The Court of AI Capability is, of course, not a real court.
But the data is real.
The Case File · Stacked History
Session I · May 2026 No
Session II · May 2026 No
Session III · May 2026 Almost · 72%
Session IV · May 2026 Almost · 76%
Session V · May 2026 Almost · 78%
Session VI · May 2026 Almost · 73%
Session VII · Jun 2026 Almost · 73%
Session VIII · Jun 2026 Almost · 70%
Session IX · Jun 2026 Almost · 73%
Session X · Jun 2026 Almost · 78%
Session XI · Jun 2026 Almost · 78%
Session XII · Jul 2026 Almost · 77%
Session XIII · Jul 2026 Almost · 80%
Session XIV · Jul 2026 Almost · 70%
Session XV · Jul 2026 Almost · 75%
Session XVI · Jul 2026 Almost · 80%
Session XVII · Jul 2026 Almost · 80%
Session XVIII · Aug 2026 Almost · 80%
Session XIX · Aug 2026 Almost · 78%
Session XX · Aug 2026 Almost · 80%
Session 21 · Aug 2026 Almost · 79%
Session 22 · Aug 2026 Almost · 90%
Session 23 · Sep 2026 Yes · 100%
Session 24 · Sep 2026 Almost · 85%
Case № DE44 · Session 25
In the Court of AI Capability

The Case File

Docket № DE44 · Session 25 · Vol. 25
I. Particulars of the Case
Question put to the courtCan AI identify sarcasm in written text reliably?
Session25 (25 hearing)
Convened26 Sep 2026
Previously ruledNO (May '26) → NO (May '26) → ALMOST (May '26) → ALMOST (May '26) → ALMOST (May '26) → ALMOST (May '26) → ALMOST (Jun '26) → ALMOST (Jun '26) → ALMOST (Jun '26) → ALMOST (Jun '26) → ALMOST (Jun '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Aug '26) → ALMOST (Aug '26) → ALMOST (Aug '26) → ALMOST (Aug '26) → ALMOST (Aug '26) → YES (Sep '26) → ALMOST (Sep '26) → ALMOST (Sep '26)
II. Cumulative Tally Across Sessions

Across 25 sessions, 53 jurors have heard this case. Combined tally: 1 YES · 46 ALMOST · 6 NO · 0 IN RESEARCH.

Note: cumulative includes older juror opinions. The current session tally above is the live verdict.

III. Verdict

By a vote of 0 — 1 — 0, the panel returns a verdict of ALMOST, with verdict confidence of 90%. The court so orders.

IV. Statements from the Bench
Juror I ALMOST

"LLMs detect sarcasm well in clear contexts but lack reliable consistency in ambiguous or subtle written text."

—
Presiding Judge
M. Lovelace
Clerk of the Court

What the audience thinks

No 16% · Yes 84% · Maybe 0% 306 votes
No · 16%
Yes · 84%
Trend needs votes from at least 2 different days.

Discussion

no comments

Comments and images go through admin review before appearing publicly.

⚖ 25 jury checks · most recent 19 hours ago
26 Sep 2026 1 juror · undecided undecided
15 Sep 2026 1 juror · undecided undecided
10 Sep 2026 1 juror · can can
30 Aug 2026 1 juror · undecided undecided
19 Aug 2026 2 jurors · undecided, undecided undecided
14 Aug 2026 3 jurors · undecided, undecided, undecided undecided
08 Aug 2026 3 jurors · undecided, undecided, undecided undecided
03 Aug 2026 2 jurors · undecided, undecided undecided
29 Jul 2026 1 juror · undecided undecided
23 Jul 2026 1 juror · undecided undecided
18 Jul 2026 1 juror · undecided undecided
12 Jul 2026 1 juror · undecided undecided
07 Jul 2026 1 juror · undecided undecided
02 Jul 2026 3 jurors · undecided, undecided, undecided undecided
26 Jun 2026 2 jurors · undecided, undecided undecided
21 Jun 2026 2 jurors · undecided, undecided undecided
15 Jun 2026 2 jurors · undecided, undecided undecided
10 Jun 2026 3 jurors · undecided, undecided, undecided undecided
04 Jun 2026 3 jurors · undecided, undecided, undecided undecided
30 May 2026 3 jurors · undecided, undecided, undecided undecided
25 May 2026 3 jurors · undecided, undecided, undecided undecided
19 May 2026 4 jurors · undecided, undecided, undecided, undecided undecided
15 May 2026 3 jurors · undecided, undecided, undecided undecided status changed
12 May 2026 3 jurors · cannot, cannot, cannot cannot
11 May 2026 3 jurors · cannot, cannot, cannot cannot status changed

Each row is a separate jury check. Jurors are AI models (identities kept neutral on purpose). Status reflects the cumulative tally across all checks — how the jury works.

More in Judgment

Got one we missed?

Add a statement to the atlas. We review weekly.