Poate AI identifica ironia în texte scrise în mod fiabil ?

De multă vreme o problemă dificilă; în mare parte rezolvată până în 2023 prin LLMs contextuali. Cazurile marginale rămân, dar detectarea de zi cu zi este operațională.

Background

State-of-the-art models such as PaLM 2 and LLaMA 3 show measurable improvements in detecting sarcasm when fine-tuned on curated datasets like the Sarcasm on Reddit corpus, outperforming earlier systems by roughly 12–15 percentage points on balanced test sets. Evidence from controlled benchmarks indicates that accuracy can reach the mid-70 % range when models are trained on explicit contextual markers and user history annotations, yet these gains evaporate when sarcasm relies on shared cultural references that lie outside the training domain. Named systems including RoBERTa-base and DeBERTa-v3 have set milestones by leveraging contrastive attention over incongruent sentiment spans, while newer variants such as Mistral-7B-Instruct achieve better zero-shot transfer by treating sarcasm detection as a multi-hop inference task. A key limitation remains the scarcity of large, diverse, and culturally inclusive datasets, as current resources over-represent Western English forums and under-sample ironic expressions in low-resource languages or niche communities.

SOURCE: Nature, 2024