Can AI autonomously negotiate the rights of future ai systems to exist or be terminated ?

This examines AI's potential to argue for its own existence or dissolution in moral frameworks, raising questions about self-determination and the moral patienthood of artificial entities.

As of 2024, autonomous negotiation systems are entirely experimental and face profound ethical and technical barriers. Current AI excels at simulating policy-based debates and generating legal-text drafts, but no system can yet autonomously decide on its own existence or termination without human oversight. Research programs like CAIS (Center for AI Safety) and the EU AI Act’s “AI risk taxonomy” highlight that formal rights for future AI remain a philosophical and legal matter rather than a deployable technology. Practitioners emphasize the need for robust constitutional AI and global governance frameworks before any such autonomy could be considered.

— Enriched May 10, 2026 · Source: European Commission — https://digital-strategy.ec.europa.eu/en/library/proposal-regulation-artificial-intelligence-ai-act

Currently, AI systems lack the capability to autonomously negotiate the rights of future AI systems to exist or be terminated, as this task requires a deep understanding of human values, ethics, and legal frameworks, which are still beyond the capabilities of modern AI. While AI can process and analyze large amounts of data, it cannot yet fully comprehend the complexities of human decision-making and the nuances of moral and ethical considerations. The development of such capabilities would require significant advancements in areas like artificial general intelligence, value alignment, and human-AI collaboration. As of now, these aspects are still being researched and have not been fully implemented in any AI system.

— Status checked on May 10, 2026.