# Should Governments Impose a Mandatory Global Moratorium on AGI Development?

> Analyze whether halting development of human-level and superintelligent AI is essential for human survival or a dangerous gift to geopolitical adversaries.

- Category: Artificial Intelligence
- Difficulty: hard
- Suitable for: College, Adults
- Web page: https://debatetopicideas.com/debate-topics/pause-agi-development-moratorium/

## Arguments for

- **Humanity has not solved the fundamental 'alignment problem'**: Computer scientists currently do not know how to reliably ensure that an autonomous intelligence smarter than all humans combined will share human values and preservation.
- **A single alignment failure with superintelligence is irreversible**: Unlike airplanes or pharmaceuticals where failures teach us how to build safety, a runaway superintelligent system cannot be turned off once deployed.
- **Thousands of leading scientists and tech founders signed the pause letter**: Pioneering AI researchers (including Turing Award winners Yoshua Bengio and Geoffrey Hinton) warned that advanced AI poses an extinction-level threat comparable to pandemics and nuclear war.
- **Allows society time to construct international monitoring treaties**: Pausing model scaling gives democratic institutions time to design safety benchmarks, chip registries, and inspection protocols before it is too late.

## Arguments against

- **Unilateral pauses are geopolitical suicide against adversarial nations**: Halting research in the US and Europe will not stop authoritarian regimes in China or Russia from sprinting to achieve military AGI superiority.
- **AGI is required to solve climate change, cancer, and global poverty**: Superintelligent systems could design nuclear fusion reactors, cure intractable degenerative diseases, and synthesize clean energy materials within years.
- **Existential 'terminator' doom predictions are unproven science fiction**: Current AI systems are sophisticated statistical text predictors, not sentient conscious entities plotting world conquest; pausing progress is fearmongering.
- **A moratorium is impossible to enforce across global software engineers**: Unlike enriched uranium centrifuges, software training occurs on private servers and decentralized clusters that cannot be physically monitored worldwide.

## Counter-questions for cross-examination

- How would international inspectors verify that an underground server cluster in another country isn't secretly training frontier models?
- What specific mathematical safety milestones would have to be proven before an AGI moratorium could be lifted?
- Why did AI pioneer Geoffrey Hinton leave Google specifically to warn the public about the existential dangers of unchecked scaling?
- Can we solve the alignment problem theoretically before building superintelligence, or can it only be solved through empirical testing?
- Does framing AI as an existential catastrophe distract policymakers from urgent corporate monopolies and surveillance concerns?

## Research sources

- <https://futureoflife.org/open-letter/pause-giant-ai-experiments/>
- <https://time.com/6266923/ai-existential-risk-yudkowsky-interview/>

## Related debate topics

- [Should Governments Strictly Regulate Artificial Intelligence?](https://debatetopicideas.com/debate-topics/artificial-intelligence-regulation.md)
- [Should Fully Autonomous Lethal Weapons Be Banned by International Treaty?](https://debatetopicideas.com/debate-topics/autonomous-weapons-ban.md)
- [Should Frontier AI Model Weights Be Kept Closed Rather Than Open-Sourced?](https://debatetopicideas.com/debate-topics/open-source-vs-closed-source-ai.md)
- [Should Creating Non-Consensual Deepfakes Be Classified as a Felony Crime?](https://debatetopicideas.com/debate-topics/deepfakes-criminalization-laws.md)
- [Should Self-Driving Cars Be Programmed to Sacrifice Passengers to Save Pedestrians?](https://debatetopicideas.com/debate-topics/self-driving-cars-moral-programming.md)

---

Source: Debate Topics (https://debatetopicideas.com/). Free to use for classroom and tournament practice.
