All topics / double descent
Topic
You are reading the free Skim layer. Read unlocks the synthesis and sources.
Double descent
A phenomenon where model performance improves, worsens, then improves again as model size increases.
1
episodes
1
thinkers
2h
of conversation
5
books & papers
2
terms defined
The neighbourhood: double descent and the ideas it travels with. Drag to roam, click a star for the episode, click a neighbour to travel.
Drag to roam · scroll to zoom · click a neighbour to travel · click a star for the episode
From foundational to frontier
Climb the spectrum. The most accessible conversations come first.
Start here
ACCESSIBLECOREFRONTIER
The lexicon
Every term the guests lean on, in plain language. Read one in full, or filter to find it.
What the corpus says
The throughline across every conversation that touches this idea.
Ilya Sutskever co-authored the AlexNet paper, a pivotal moment in deep learning's rise.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Transformers have replaced RNNs due to their efficiency and scalability in deep learning tasks.
Ilya Sutskever · Ilya Sutskever: Deep Learning
OpenAI's staged release of GPT-2 was a strategy to mitigate potential misuse of powerful AI models.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Double descent is a phenomenon where model performance improves, worsens, then improves again as model size increases.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Sutskever envisions AGI systems as democratic entities, potentially serving as CEOs of cities or countries.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Voices on double descent
5 standout quotes from across the corpus.
Go read
5 books and papers cited across these episodes.
For the specialist
What experts find new
2 expert-level takeaways for a specialist reader.
At the frontier
Still unresolved
2 open questions flagged across these conversations.
The thinkers
Who takes this idea on, by how often they return to it.
