The Court of AI Capability
Can AI beat top professional stratego players?
⚖ Ja"The jury found that AI systems have indeed conquered the complexities of Stratego, a game where hidden information and bluffing reign supreme."
Can AI generate album cover art from a song's mood?
⚖ Ja"The jury found the task well within AI’s reach, noting that mood-to-visual translation is now routine for multiple models."
Can AI diagnose skin cancer from a photo at dermatologist accuracy?
⚖ Nästan"The jury weighed controlled clinical brilliance against the chaos of the clinic and split narrowly between full approval and cautious applause."
Can AI generate a functional video-game prototype from a one-paragraph design doc?
⚖ Nästan"The jury found that AI can conjure sprites and stage a few levels, yet still stumbles when asked to link every piece into a seamless whole—leaving it tantalizingly one keystroke aw…"
Can AI negotiate convincingly with humans in diplomacy?
⚖ Ja"The jury found, by a two-to-one margin, that artificial negotiators have indeed crossed the threshold into convincing human diplomacy, with one juror still hesitant that such prowe…"
Can AI pass the ap biology exam with the highest score?
⚖ Under utredning"The jury reached an uneasy split, with one juror insisting the evidence of a top-score performance on the AP Biology exam was sufficient for a thumbs-up, while another countered th…"
Can AI detect deepfakes in many common cases?
⚖ Nästan"The jury agreed that AI has built a capable deepfake detector, yet still stumbles when the forgeries shift techniques or gleam with pristine quality."
Can AI identify hate speech in text at production scale?
⚖ Ja"After swift deliberation, the jury found that existing AI systems can indeed identify hate speech in text at production scale with remarkable reliability."
Can AI generate full-album-length music in a chosen artist's style?
⚖ Nästan"The jury agreed that artificial voices can hum nearly an entire record but cannot yet carry a concept from first track to last without losing its soul midway."
Can AI edit raw footage into a coherent short film with prompts alone?
⚖ Nästan"The jury found that while AI tools can help shape raw footage into rough cuts, none yet rise to the artistry of a true director’s vision—coherence still requires a human hand."
Can AI pass the usmle medical licensing exam?
⚖ Nästan"The jury grappled between two close camps—one celebrating near-passing scores under optimized test conditions, the other noting the gap between practice sessions and real clinical judgment."
Can AI pass the bar exam at top-decile human level?
⚖ Ja"The jury found that current AI systems can indeed perform at the level of the top-decile human bar exam takers, as demonstrated by pass-rate benchmarks that align with those human achievers."
Can AI solve standardized logic puzzles at top-percentile level?
⚖ Ja"After careful consideration, the jury found that modern reasoning models now routinely crack puzzles once reserved for human prodigies, delivering answers with speed and precision …"
Can AI run a robotic arm through a cooking recipe in a controlled kitchen?
⚖ Ja"The jury found with unanimous speed and precision that robotic limbs guided by artificial minds can now dice, stir, and plate a meal under close supervision, though not yet with th…"
Can AI score in the top 10% on the sat?
⚖ Nästan"After lively deliberations, the jury was split between a narrow affirmative and a cautious “almost,” with no voices for outright denial or further research."
Can AI sort recyclables on industrial conveyor at human accuracy?
⚖ Nästan"After deliberation, the jury acknowledged that AI has surpassed human performance in sorting recyclables under carefully managed conditions, yet found it falls short outside idealized factory floors."
Can AI solve graduate-level math problems in many domains?
⚖ Nästan"The jury found that while today’s AI can tackle graduate-level mathematics with impressive skill, the bench remains unconvinced that every domain and edge case has been fully mastered."
Can AI detect early-stage alzheimer's from speech samples?
⚖ Nästan"With one voice, the jury acknowledged strong technical signals from lab tests and small studies, while cautioning that hospital hallways have not yet echoed with consistent results."
Can AI pass the cpa exam in multiple jurisdictions?
⚖ Nästan"The jury found that AI can crunch the numbers and tick the boxes, yet still stumbles over nuanced prose and local rulebooks."
Can AI solve coding interview questions at faang-hire level?
⚖ Ja"The jury moved with decisive speed, declaring that today’s leading models are already crafting solutions at the caliber expected of top Silicon Valley engineers."
Can AI outperform humans at predicting movie box-office openings?
⚖ Nästan"The jury found that while artificial intelligence excels at crunching data to forecast box-office numbers, its predictions wobble when human tastes and market whims conspire against it."
Can AI generate functional sql from natural-language questions?
⚖ Ja"After careful deliberation, the jury unanimously affirmed that AI can now generate functional SQL from natural-language questions with sufficient reliability for practical use."
Can AI translate spoken speech in real time across major languages?
⚖ Ja"After careful listening, the jury agreed that the courtroom is now furnished with live interpreters who never tire and never blink—neural networks that shift from one tongue to ano…"
Can AI read a financial earnings report and summarize key risks?
⚖ Nästan"The jury found that today’s AI can skim numbers and spit out bullet points but often misses the subtle language of risk—those coded phrases in footnotes that humans still read between the lines."
But the data is real.