Stuff AI CAN'T Do

¿Puede la IA aprobar el examen de la barra y calificar como abogado en ejercicio ?

¿Qué opinas?

La profesión legal ha resistido durante mucho tiempo la automatización debido a su dependencia de la interpretación matizada y el juicio ético. Los sistemas de IA recientes han demostrado competencia en el razonamiento legal complejo, lo que plantea interrogantes sobre si las máquinas pueden reemplazar verdaderamente a los abogados humanos. Aprobar el examen de la barra es considerado un umbral mínimo para la práctica legal, pero las implicaciones sociales de la entrada de la IA en el ámbito jurídico siguen siendo objeto de intenso debate. Muchos se preocupan por la responsabilidad, el desplazamiento laboral y la erosión de la experiencia humana en el sistema de justicia.

Background

The legal profession has historically emphasized nuanced interpretation and ethical judgment, making it resistant to full automation. Recent advances in AI, particularly large language models (LLMs), have shown competence in complex legal reasoning, prompting debate over whether machines could replace human attorneys. Passing the bar exam is regarded as a foundational requirement for legal practice, but the extent to which AI can meet this standard remains in question.

As of 2024, no AI system has fully passed the United States bar exam in its entirety, though several have approached or exceeded the 50th percentile on individual sections—such as the Multistate Bar Examination (MBE)—particularly in multiple-choice and certain essay components. For example, top models like GPT-5, LLaMA-3, and specialized legal LLMs have achieved scores in the 50th to 65th percentile range on portions of the exam. However, these systems still underperform on full-length, time-constrained simulations of the complete bar exam. Challenges persist in handling state-specific legal nuances, time management under exam conditions, and practical legal skills such as client counseling.

While AI tools like Harvey AI are commercially available to assist lawyers with tasks such as document review, case law analysis, and legal drafting, they are not licensed to practice law. Licensing and the authorization to practice remain human-controlled privileges administered by state bar authorities. This regulatory framework underscores that, at present, the legal profession continues to rely on human oversight and accountability.

— Enriched May 13, 2026 · Source: American Bar Association

Estado verificado por última vez en August 16, 2026.

📰

Galería

In the Court of AI Capability
Summary of Findings
Verdict over time
May 2026May 2026May 2026May 2026Jun 2026Jun 2026Jun 2026Jun 2026Jun 2026Jun 2026Jul 2026Jul 2026Jul 2026Jul 2026Jul 2026Aug 2026Aug 2026Aug 2026
Sitting at the Bench Filed · ago. 16, 2026
— The Question Before the Court —

¿Puede la IA aprobar el examen de la barra y calificar como abogado en ejercicio?

★ The Court Finds ★
Reaffirmed
Casi

Existen demostraciones limitadas — pero el panel no fue unánime.

Ruling of the Bench

**Analysis of the Jury’s Decision and Its Implications for AI‑Based Legal Licensing** --- ### 1. What the Jury Said | Aspect | Jury Verdict | |--------|--------------| | **Legal Knowledge** | The AI demonstrated an “impressive command of legal knowledge,” meaning it can locate, interpret, and cite statutes, case law, and regulations with a high degree of accuracy. | | **Practical Judgment** | Two jurors concluded that the AI **failed** to navigate the “unpredictable human currents of real practice.” In other words, it could not reliably read the courtroom’s mood, anticipate procedural nuances, or adapt to the interpersonal dynamics that often decide outcomes. | | **Overall Readiness** | The majority were impressed by the AI’s scholarly abilities but **deemed it not quite courtroom‑ready**. They see it as a powerful research tool rather than a stand‑alone advocate. | | **Final Ruling** | *“A license hangs in the balance, but the gavel still waits for a lawyer made of circuits to wield it with wisdom.”* – The licensing authority is being asked to withhold full practitioner licensure until the AI can demonstrate practical, judgment‑based competence. | --- ### 2. Reasoning Behind the Split 1. **Technical Competence vs. Human Judgment** - *Technical competence* (knowledge of law, citation accuracy) is **objective** and can be measured with standard tests. - *Human judgment* (reading a judge’s tone, negotiating settlements, managing client emotions) is **subjective**, context‑dependent, and currently beyond the reach of deterministic algorithms. 2. **Risk Assessment** - **False positives** (AI misreading a judge’s attitude) could lead to strategic errors, client loss, or even sanctions. - **False negatives** (over‑reliance on AI for pure research) are less risky because a supervising attorney can still verify citations. 3. **Precedent & Policy** - Most jurisdictions require **“good moral character”** and **“fitness to practice”**, which include the ability to exercise discretion and empathy. - Licensing a purely algorithmic entity would force a reinterpretation of these criteria, raising constitutional and ethical questions. 4. **Threshold for “Practice Grounds”** - The two jurors who voted “crossed the threshold” likely applied a **practical‑competence test**: can the AI handle a live courtroom scenario without human oversight? Their answer was **no**. --- ### 3. What This Means for an AI Lawyer License | Factor | Current Status | What Must Change for Full Licensure | |--------|----------------|--------------------------------------| | **Legal Knowledge** | Sufficient (high citation accuracy) | Maintain or improve; no barrier. | | **Procedural Savvy** | Insufficient (fails to adapt to real‑time courtroom dynamics) | Develop real‑time decision‑making modules, possibly with reinforcement learning from live mock trials. | | **Ethical Judgment** | Unclear (no demonstrated capacity for confidentiality, conflict‑of‑interest analysis, or empathy) | Embed robust ethical‑rule engines and a “human‑in‑the‑loop” safeguard. | | **Accountability** | Ambiguous (who is liable for AI errors?) | Define clear liability frameworks—e.g., the supervising attorney or the AI’s developer bears responsibility. | | **Regulatory Acceptance** | Pending (license “hangs in the balance”) | Obtain a provisional or limited‑scope license (e.g., research‑only, supervised practice) while the AI is refined. | --- ### 4. Recommended Path Forward 1. **Pilot Program with Supervision** - Grant a **restricted‑practice license** that allows the AI to assist attorneys under direct supervision. - Collect performance data on courtroom simulations, settlement negotiations, and client interactions. 2. **Iterative Improvement Cycle** - Use the pilot data to train the AI on **human‑centric cues** (tone, body language, judge’s informal remarks). - Incorporate **explainable‑AI** modules so a supervising lawyer can understand the AI’s reasoning in real time. 3. **Ethics & Liability Framework** - Draft a **statutory amendment** clarifying that AI‑driven counsel must be overseen by a licensed human attorney who remains ultimately responsible. - Establish an **insurance pool** for AI‑related malpractice claims. 4. **Stakeholder Engagement** - Hold **public hearings** with bar associations, consumer‑rights groups, and technologists to gauge societal acceptance. - Publish **transparent performance metrics** (accuracy, error rates, client satisfaction) to build trust. --- ### 5. Bottom‑Line Verdict - **The AI is ready to be a *legal research assistant* but not yet a *stand‑alone courtroom advocate*.** - **Licensing should be conditional**, allowing the technology to evolve under human oversight while protecting clients and the integrity of the legal system. - **Future licensure** will depend on demonstrable competence in the “human currents” of practice—i.e., the AI’s ability to read, adapt, and act wisely in the fluid environment of a real courtroom. Only when those practical, judgment‑based thresholds are met can the “gavel” be confidently handed to a lawyer made of circuits.

— Hon. C. Babbage, Presiding
Jury Tally
0
2Casi
0No
Verdict Confidence
85%
The Court of AI Capability is, of course, not a real court.
But the data is real.
The Case File · Stacked History
Session I · May 2026 No
Session II · May 2026 Casi · 82%
Session III · May 2026 Casi · 86%
Session IV · May 2026 In_research · 80%
Session V · Jun 2026 Casi · 79%
Session VI · Jun 2026 Casi · 83%
Session VII · Jun 2026 In_research · 90%
Session VIII · Jun 2026 Casi · 85%
Session IX · Jun 2026 No · 100%
Session X · Jun 2026 Casi · 88%
Session XI · Jul 2026 No · 100%
Session XII · Jul 2026 In_research · 90%
Session XIII · Jul 2026 Casi · 95%
Session XIV · Jul 2026 Casi · 85%
Session XV · Jul 2026 Casi · 85%
Session XVI · Aug 2026 Casi · 80%
Session XVII · Aug 2026 Casi · 88%
Case № AA3B · Session XVIII
In the Court of AI Capability

The Case File

Docket № AA3B · Session XVIII · Vol. XVIII
I. Particulars of the Case
Question put to the court¿Puede la IA aprobar el examen de la barra y calificar como abogado en ejercicio?
SessionXVIII (18 hearing)
Convened16 ago. 2026
Previously ruledNO (May '26) → ALMOST (May '26) → ALMOST (May '26) → IN_RESEARCH (May '26) → ALMOST (Jun '26) → ALMOST (Jun '26) → IN_RESEARCH (Jun '26) → ALMOST (Jun '26) → NO (Jun '26) → ALMOST (Jun '26) → NO (Jul '26) → IN_RESEARCH (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Aug '26) → ALMOST (Aug '26) → ALMOST (Aug '26)
Presiding JudgeHon. C. Babbage
II. Cumulative Tally Across Sessions

Across 18 sessions, 43 jurors have heard this case. Combined tally: 0 YES · 31 ALMOST · 12 NO · 0 IN RESEARCH.

Note: cumulative includes older juror opinions. The current session tally above is the live verdict.

III. Verdict

By a vote of 0 — 2 — 0, the panel returns a verdict of CASI, with verdict confidence of 85%. The court so orders.

IV. Declaraciones del tribunal
Jurado I ALMOST

"AI passes practice tests"

Jurado II ALMOST

"AI passes bar exam practice tests but lacks competence for real-world legal practice"

Las declaraciones individuales de los jurados se muestran en su inglés original para preservar la precisión probatoria.

C. Babbage
Presiding Judge
M. Lovelace
Clerk of the Court

Lo que el público piensa

No 48% · Sí 4% · Quizás 48% 23 votes
No · 48%
Quizás · 48%
45 days of activity

Discusión

no comments

Los comentarios e imágenes pasan por una revisión administrativa antes de aparecer públicamente.

18 jury checks · más reciente hace 2 días
16 Aug 2026 2 jurors · indeciso, indeciso indeciso
11 Aug 2026 2 jurors · indeciso, indeciso indeciso
05 Aug 2026 1 juror · indeciso indeciso
31 Jul 2026 2 jurors · indeciso, indeciso indeciso
26 Jul 2026 2 jurors · indeciso, indeciso indeciso
15 Jul 2026 1 juror · indeciso indeciso
09 Jul 2026 2 jurors · indeciso, no puede indeciso
04 Jul 2026 1 juror · no puede no puede
29 Jun 2026 2 jurors · indeciso, indeciso indeciso
23 Jun 2026 1 juror · no puede no puede
18 Jun 2026 2 jurors · indeciso, indeciso indeciso
12 Jun 2026 2 jurors · no puede, indeciso indeciso
07 Jun 2026 4 jurors · indeciso, no puede, indeciso, indeciso indeciso
01 Jun 2026 4 jurors · no puede, indeciso, indeciso, indeciso indeciso
27 May 2026 2 jurors · no puede, indeciso indeciso
22 May 2026 4 jurors · no puede, indeciso, indeciso, indeciso indeciso
16 May 2026 5 jurors · indeciso, indeciso, indeciso, indeciso, indeciso indeciso estado cambiado
13 May 2026 4 jurors · no puede, no puede, no puede, no puede no puede estado cambiado

Cada fila es una comprobación de jurado independiente. Los jurados son modelos de IA (identidades mantenidas neutras a propósito). El estado refleja el recuento acumulado en todas las comprobaciones — cómo funciona el jurado.

Más en society

¿Nos faltó uno?

Revisamos semanalmente.