All topics / transformers
Topic
You are reading the free Skim layer. Read unlocks the synthesis and sources.
Transformers
1
episodes
1
thinkers
2h
of conversation
5
books & papers
2
terms defined
The neighbourhood: transformers and the ideas it travels with. Drag to roam, click a star for the episode, click a neighbour to travel.
Drag to roam · scroll to zoom · click a neighbour to travel · click a star for the episode
From foundational to frontier
Climb the spectrum. The most accessible conversations come first.
Start here
ACCESSIBLECOREFRONTIER
The lexicon
Every term the guests lean on, in plain language. Read one in full, or filter to find it.
What the corpus says
The throughline across every conversation that touches this idea.
Ilya Sutskever co-authored the AlexNet paper, a pivotal moment in deep learning's rise.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Transformers have replaced RNNs due to their efficiency and scalability in deep learning tasks.
Ilya Sutskever · Ilya Sutskever: Deep Learning
OpenAI's staged release of GPT-2 was a strategy to mitigate potential misuse of powerful AI models.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Double descent is a phenomenon where model performance improves, worsens, then improves again as model size increases.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Sutskever envisions AGI systems as democratic entities, potentially serving as CEOs of cities or countries.
Ilya Sutskever · Ilya Sutskever: Deep Learning
Voices on transformers
5 standout quotes from across the corpus.
Go read
5 books and papers cited across these episodes.
For the specialist
What experts find new
2 expert-level takeaways for a specialist reader.
At the frontier
Still unresolved
2 open questions flagged across these conversations.
The thinkers
Who takes this idea on, by how often they return to it.
