👨💻 A superintelligent artificial intelligence (AI), capable of acting autonomously and making decisions, could pose a threat to all of humanity. This is the view of Ethereum co-founder Vitalik Buterin, one of the leading thinkers in blockchain technology and decentralized systems.
The Problem of Value Alignment
Buterin highlighted a fundamental problem in AI development: humanity is not yet capable of aligning shared global values at a level sufficient to guarantee the safety of superintelligent AI.
In a comment on a post by 3D artist Utah teapot on X, he stated:
“We know lots of things that are clearly very against human values (e.g., killing or imprisoning innocent people), and the argument is that we’re not good enough at alignment to ensure that a singleton superintelligent AI will avoid even that.”
He continued: “How can AI alignment even exist? I always ask: ‘alignment with what?’ Nobody ever answers anything besides ‘with human values.’ But coherent, non-contradictory human values do not exist. I still don’t understand. What are we even researching? It’s absurd that this is becoming a growing industry. Fictional work.”
In other words, attempts to “align” AI with human values confront the fact that these values are contradictory and fragmented. What one society considers ethical, another may view as unacceptable.
Buterin cites obvious ethical contradictions in our world: killing, imprisoning the innocent, abuse of power. He notes: “We are not yet good enough at alignment to ensure that a single superintelligent AI will avoid even this.”
Centralization and Military Use of AI
Utah teapot emphasized that current AI development trends move toward limiting public access. Large companies release versions of AI systems that could be used for military purposes or information control.
“I’m deeply concerned that centralizing access to AI technologies allows safety concerns to be imposed where they are not real — for example, discussions around ‘psychosis’ from LLMs. This creates a risk of harming unique or marginalized cultures and their values.”
Buterin shares these concerns: “I think the greatest risks will come from military and other entities with great power, allowing them to exempt themselves from safety rules that apply to everyone else by default.”
As an example, Utah teapot mentioned the startup Anthropic, developing alternative “civilian” AI models and selling them to governments. Such technologies can be used in military and intelligence operations, increasing the risk of uncontrolled outcomes.
Catastrophic Scenario and Singleton Agent
Buterin warns: the danger increases if a single superintelligent AI agent appears on the planet with its own will and the ability to act as a subject. In this situation, the system could bypass any rules and restrictions, making a catastrophic outcome a real threat.
“If the environment is pluralistic, no system can totally control the situation. But for its creation, market mechanisms alone are not enough. Intentional efforts are required, including changes in laws and incentives that large corporations will not like.”
In other words, a safe AI future is impossible without global regulation, transparent rules and limits, and international community participation.
🌐 International Initiatives
Recall that in 2022, India’s Minister of IT, Rajeev Chandrasekhar, called for global AI safety standards to ensure technologies are safe for humans.
Today, the issue of safe AI development is a priority not only in tech circles but also in politics, science, and public debate. The threat of superintelligent AI is not science fiction — it is a real strategic challenge for all of humanity.
All content provided on this website (https://wildinwest.com/) -including attachments, links, or referenced materials — is for informative and entertainment purposes only and should not be considered as financial advice. Third-party materials remain the property of their respective owners.