A IA consegue identificar o sarcasmo em texto escrito de forma fiável ?

Há muito um problema difícil; maioritariamente resolvido pelos LLMs contextuais de 2023. Casos extremos permanecem, mas a deteção quotidiana está operacional.

Background

State-of-the-art models such as PaLM 2 and LLaMA 3 show measurable improvements in detecting sarcasm when fine-tuned on curated datasets like the Sarcasm on Reddit corpus, outperforming earlier systems by roughly 12–15 percentage points on balanced test sets. Evidence from controlled benchmarks indicates that accuracy can reach the mid-70 % range when models are trained on explicit contextual markers and user history annotations, yet these gains evaporate when sarcasm relies on shared cultural references that lie outside the training domain. Named systems including RoBERTa-base and DeBERTa-v3 have set milestones by leveraging contrastive attention over incongruent sentiment spans, while newer variants such as Mistral-7B-Instruct achieve better zero-shot transfer by treating sarcasm detection as a multi-hop inference task. A key limitation remains the scarcity of large, diverse, and culturally inclusive datasets, as current resources over-represent Western English forums and under-sample ironic expressions in low-resource languages or niche communities.

SOURCE: Nature, 2024