Should Governments Impose a Mandatory Global Moratorium on AGI Development?
Analyze whether halting development of human-level and superintelligent AI is essential for human survival or a dangerous gift to geopolitical adversaries.
Pick a Side
Choose a position to defend, or let fate assign your stance.
Arguments FOR
1. Humanity has not solved the fundamental 'alignment problem'
Computer scientists currently do not know how to reliably ensure that an autonomous intelligence smarter than all humans combined will share human values and preservation.
2. A single alignment failure with superintelligence is irreversible
Unlike airplanes or pharmaceuticals where failures teach us how to build safety, a runaway superintelligent system cannot be turned off once deployed.
3. Thousands of leading scientists and tech founders signed the pause letter
Pioneering AI researchers (including Turing Award winners Yoshua Bengio and Geoffrey Hinton) warned that advanced AI poses an extinction-level threat comparable to pandemics and nuclear war.
4. Allows society time to construct international monitoring treaties
Pausing model scaling gives democratic institutions time to design safety benchmarks, chip registries, and inspection protocols before it is too late.
Arguments AGAINST
1. Unilateral pauses are geopolitical suicide against adversarial nations
Halting research in the US and Europe will not stop authoritarian regimes in China or Russia from sprinting to achieve military AGI superiority.
2. AGI is required to solve climate change, cancer, and global poverty
Superintelligent systems could design nuclear fusion reactors, cure intractable degenerative diseases, and synthesize clean energy materials within years.
3. Existential 'terminator' doom predictions are unproven science fiction
Current AI systems are sophisticated statistical text predictors, not sentient conscious entities plotting world conquest; pausing progress is fearmongering.
4. A moratorium is impossible to enforce across global software engineers
Unlike enriched uranium centrifuges, software training occurs on private servers and decentralized clusters that cannot be physically monitored worldwide.
Counter Questions
Questions to challenge claims and probe deeper into trade-offs.
- How would international inspectors verify that an underground server cluster in another country isn't secretly training frontier models?
- What specific mathematical safety milestones would have to be proven before an AGI moratorium could be lifted?
- Why did AI pioneer Geoffrey Hinton leave Google specifically to warn the public about the existential dangers of unchecked scaling?
- Can we solve the alignment problem theoretically before building superintelligence, or can it only be solved through empirical testing?
- Does framing AI as an existential catastrophe distract policymakers from urgent corporate monopolies and surveillance concerns?
Ready to debate this topic?
Prepare your arguments and test your speech against the clock.