All topics / existential risk
Topic
You are reading the free Skim layer. Read unlocks the synthesis and sources.
Existential risk
3
episodes
3
thinkers
7h
of conversation
15
books & papers
6
terms defined
The neighbourhood: existential risk and the ideas it travels with. Drag to roam, click a star for the episode, click a neighbour to travel.
Drag to roam · scroll to zoom · click a neighbour to travel · click a star for the episode
From foundational to frontier
Climb the spectrum. The most accessible conversations come first.
Start here
ACCESSIBLECOREFRONTIER
The lexicon
Every term the guests lean on, in plain language. Read one in full, or filter to find it.
What the corpus says
The throughline across every conversation that touches this idea.
Roman Yampolskiy estimates a 99.99% chance that AGI will eventually destroy human civilization.
Roman Yampolskiy · Roman Yampolskiy: Dangers of Superintelligent AI
Yampolskiy introduces 'I-risk', where humanity loses meaning due to AI taking over jobs.
Roman Yampolskiy · Roman Yampolskiy: Dangers of Superintelligent AI
He argues against open-sourcing powerful AI tech, likening it to giving nuclear weapons to potential threats.
Roman Yampolskiy · Roman Yampolskiy: Dangers of Superintelligent AI
Yampolskiy believes the scaling hypothesis is correct, with the cost of achieving AGI decreasing rapidly.
Roman Yampolskiy · Roman Yampolskiy: Dangers of Superintelligent AI
He suggests that AI regulation is ineffective due to poorly defined terms and inadequate monitoring.
Roman Yampolskiy · Roman Yampolskiy: Dangers of Superintelligent AI
Max Tegmark argues that humanity is likely the only advanced technological life in the observable universe, placing a unique responsibility on us.
Max Tegmark · Max Tegmark: The Case for Halting AI Development
The open letter calling for a pause on AI development beyond GPT-4 has been signed by over 50,000 people, highlighting widespread concern.
Max Tegmark · Max Tegmark: The Case for Halting AI Development
AI development is described as a 'suicide race' where losing control could lead to catastrophic outcomes, regardless of intentions.
Max Tegmark · Max Tegmark: The Case for Halting AI Development
The concept of 'Moloch' is used to describe the competitive pressures driving unsafe AI development.
Max Tegmark · Max Tegmark: The Case for Halting AI Development
Tegmark suggests that compassion and understanding are essential to combat the divisive forces of Moloch.
Max Tegmark · Max Tegmark: The Case for Halting AI Development
Melanie Mitchell critiques the term 'artificial intelligence' as misleading, preferring 'complex information processing.'
Melanie Mitchell · Melanie Mitchell: Concepts, Analogies, Common Sense & Future of AI
Deep learning lacks the ability to prioritize relevant features, limiting its understanding of concepts like a paddle or a ball in games.
Melanie Mitchell · Melanie Mitchell: Concepts, Analogies, Common Sense & Future of AI
Voices on existential risk
12 standout quotes from across the corpus.
Go read
15 books and papers cited across these episodes.
For the specialist
What experts find new
7 expert-level takeaways for a specialist reader.
At the frontier
Still unresolved
5 open questions flagged across these conversations.
The thinkers
Who takes this idea on, by how often they return to it.
