¿Puede la IA elegir qué culturas humanas sobreviven en un sistema de gobernanza global con IA ?

Si a la IA se le encomienda gestionar los recursos de la Tierra y las estructuras sociales, podría priorizar ciertos valores culturales sobre otros basándose en la eficiencia o la estabilidad. Esto podría llevar a la supresión o preservacion sistemática de formas de vida enteras.

Background

State-of-the-art AI systems excel at pattern recognition and optimization, yet they remain brittle when tasked with normative judgments about cultural value or survival. Public benchmarks such as cultural alignment tests show strong performance on describing traditions but no reliable ability to rank or prioritize their persistence across diverse societies. Named systems like Google’s PaLM 2 and Anthropic’s Claude 3 exhibit sensitivity to cultural context in dialogue settings, stopping short of endorsing survival choices among cultures. Evidence from 2023–24 evaluations indicates that even the most advanced models fail to demonstrate stable cross-cultural ethical reasoning when hypothetical rankings are probed. Milestones such as UNESCO’s 2023 Global Policy Dialogue and the 2024 AI Safety Summit identified governance gaps precisely because no AI demonstrates the judgment required to steward cultural survival. Counterexamples abound: LLMs fine-tuned for alignment still reproduce majority-culture biases when asked to assess minority traditions, calling their neutrality into question.

SOURCE: Nature, 2024