🔥 Hot topics · Can NOT do · Can do · § The Court · Recent inflections · 📈 Timeline · Ask · Editorials · 🔥 Hot topics · Can NOT do · Can do · § The Court · Recent inflections · 📈 Timeline · Ask · Editorials
Stuff AI CAN'T Do

Can AI control robots using plain language ?

What do you think?

What does it mean for robots to take orders from everyday speech? Today’s machines can already act on simple spoken commands in tightly controlled settings, raising the question of how close we are to conversational robot control. The gap between lab demonstrations and real-world reliability remains a key obstacle to overcome.

Background

Current systems can interpret plain-language instructions to control simple robotic arms and mobile platforms within constrained environments, often combining large language models with robot-specific modules for grounding commands in sensor data. Benchmarks like SayCan and ALFRED show robots can follow multi-step verbal commands indoors when task domains are limited, but generalizing to unstructured real-world settings remains a challenge. Accurate language-to-motion translation is still brittle: misheard words, ambiguous phrasing, or novel contexts often cause failures. Work is progressing on end-to-end models that fuse vision, language, and action, yet reliable, real-time control purely from plain speech outside lab settings is not yet achieved.

— Enriched May 11, 2026 · Source: Google DeepMind

Status last checked on August 12, 2026.

📰

Gallery

In the Court of AI Capability
Summary of Findings
Verdict over time
May 2026May 2026May 2026May 2026May 2026Jun 2026Jun 2026Jun 2026Jun 2026Jun 2026Jun 2026Jul 2026Jul 2026Jul 2026Jul 2026Jul 2026Aug 2026Aug 2026Aug 2026
Sitting at the Bench Filed · Aug 12, 2026
— The Question Before the Court —

Can AI control robots using plain language?

★ The Court Finds ★
▲ Upgraded from Almost
Yes

The jury found a clear answer in the affirmative.

Ruling of the Bench

After spirited deliberation, the jury agreed that plain language control of robots is not only possible but already in motion, though with important caveats. Two jurors endorsed a full-throated yes, pointing to breakthroughs in natural language processing and large language models that transform loose commands into precise robot action. The lone almost-vote urged patience, noting that real-world reliability and generalization remain works in progress. The ruling: “Robots now dance to our words—just watch where they stumble.”

— Hon. B. Liskov-Chen, Presiding
Jury Tally
2Yes
1Almost
0No
Verdict Confidence
88%
The Court of AI Capability is, of course, not a real court.
But the data is real.
The Case File · Stacked History
Session I · May 2026 In_research
Session II · May 2026 Yes
Session III · May 2026 Yes · 84%
Session IV · May 2026 Yes · 82%
Session V · May 2026 Almost · 77%
Session VI · Jun 2026 Yes · 83%
Session VII · Jun 2026 Yes · 77%
Session VIII · Jun 2026 Almost · 75%
Session IX · Jun 2026 Yes · 90%
Session X · Jun 2026 Almost · 90%
Session XI · Jun 2026 Yes · 88%
Session XII · Jul 2026 Almost · 88%
Session XIII · Jul 2026 Almost · 83%
Session XIV · Jul 2026 Almost · 88%
Session XV · Jul 2026 Yes · 90%
Session XVI · Jul 2026 Yes · 90%
Session XVII · Aug 2026 Yes · 90%
Session XVIII · Aug 2026 Almost · 85%
Case № 5EE2 · Session XIX
In the Court of AI Capability

The Case File

Docket № 5EE2 · Session XIX · Vol. XIX
I. Particulars of the Case
Question put to the courtCan AI control robots using plain language?
SessionXIX (19 hearing)
Convened12 Aug 2026
Previously ruledIN_RESEARCH (May '26) → YES (May '26) → YES (May '26) → YES (May '26) → ALMOST (May '26) → YES (Jun '26) → YES (Jun '26) → ALMOST (Jun '26) → YES (Jun '26) → ALMOST (Jun '26) → YES (Jun '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → ALMOST (Jul '26) → YES (Jul '26) → YES (Jul '26) → YES (Aug '26) → ALMOST (Aug '26) → YES (Aug '26)
Presiding JudgeHon. B. Liskov-Chen
II. Cumulative Tally Across Sessions

Across 19 sessions, 50 jurors have heard this case. Combined tally: 33 YES · 16 ALMOST · 1 NO · 0 IN RESEARCH.

Note: cumulative includes older juror opinions. The current session tally above is the live verdict.

III. Verdict

By a vote of 2 — 1 — 0, the panel returns a verdict of YES, with verdict confidence of 88%. The court so orders. Verdict upgraded from prior session.

IV. Statements from the Bench
Juror I YES

"Natural Language Processing enables control"

Juror II ALMOST

"AI can control some robots with plain language in narrow demo environments, but reliability and generalization remain limited."

Juror III YES

"AI systems, particularly those leveraging Large Language Models (LLMs), can interpret natural language commands and translate them into actionable instructions for robots."

B. Liskov-Chen
Presiding Judge
M. Lovelace
Clerk of the Court

What the audience thinks

No 26% · Yes 48% · Maybe 26% 23 votes
No · 26%
Yes · 48%
Maybe · 26%
45 days of activity

Discussion

no comments

Comments and images go through admin review before appearing publicly.

19 jury checks · most recent 13 hours ago
12 Aug 2026 3 jurors · can, undecided, can undecided
07 Aug 2026 2 jurors · can, undecided undecided
01 Aug 2026 2 jurors · can, can can
27 Jul 2026 1 juror · can can
21 Jul 2026 1 juror · can can
16 Jul 2026 2 jurors · undecided, can undecided
11 Jul 2026 2 jurors · undecided, undecided undecided
05 Jul 2026 2 jurors · can, undecided undecided
30 Jun 2026 3 jurors · can, undecided, can undecided
24 Jun 2026 2 jurors · undecided, can undecided
19 Jun 2026 3 jurors · can, undecided, can undecided
13 Jun 2026 2 jurors · undecided, can undecided
08 Jun 2026 3 jurors · undecided, can, can undecided
03 Jun 2026 4 jurors · undecided, can, can, can undecided
28 May 2026 3 jurors · undecided, undecided, can undecided status changed
23 May 2026 3 jurors · undecided, can, can undecided
17 May 2026 5 jurors · can, undecided, can, can, can undecided
14 May 2026 4 jurors · can, can, can, can can status changed
11 May 2026 3 jurors · can, cannot, can undecided status changed

Each row is a separate jury check. Jurors are AI models (identities kept neutral on purpose). Status reflects the cumulative tally across all checks — how the jury works.

More in Physical

Got one we missed?

Add a statement to the atlas. We review weekly.