All topics / transfer learning
Topic
You are reading the free Skim layer. Read unlocks the synthesis and sources.
Transfer learning
A technique where a pre-trained model is adapted to a new task, requiring less data.
2
episodes
2
thinkers
2h
of conversation
15
books & papers
5
terms defined
The neighbourhood: transfer learning and the ideas it travels with. Drag to roam, click a star for the episode, click a neighbour to travel.
Drag to roam · scroll to zoom · click a neighbour to travel · click a star for the episode
From foundational to frontier
Climb the spectrum. The most accessible conversations come first.
Start here
ACCESSIBLECOREFRONTIER
The lexicon
Every term the guests lean on, in plain language. Read one in full, or filter to find it.
What the corpus says
The throughline across every conversation that touches this idea.
Fast.ai offers free, practical deep learning courses that emphasize accessibility and minimal BS.
Jeremy Howard · Jeremy Howard: fast.ai Deep Learning Courses and Research
Jeremy Howard argues that most deep learning research is a waste of time, advocating for practical problem-solving instead.
Jeremy Howard · Jeremy Howard: fast.ai Deep Learning Courses and Research
Howard claims that large datasets like ImageNet aren't necessary for breakthroughs; smaller datasets can be equally effective.
Jeremy Howard · Jeremy Howard: fast.ai Deep Learning Courses and Research
Transfer learning can achieve state-of-the-art results with significantly less data, challenging the notion that more data is always better.
Jeremy Howard · Jeremy Howard: fast.ai Deep Learning Courses and Research
Superconvergence allows networks to be trained ten times faster, improving both speed and generalization.
Jeremy Howard · Jeremy Howard: fast.ai Deep Learning Courses and Research
Pieter Abbeel estimates it will take 10-15 years for robots to achieve human-level tennis performance on clay courts.
Pieter Abbeel · Pieter Abbeel: Deep Reinforcement Learning
Reinforcement learning enables robots to learn complex tasks like swinging a racket through trial and error, requiring extensive training.
Pieter Abbeel · Pieter Abbeel: Deep Reinforcement Learning
Deep learning integrated with traditional reasoning can improve AI's planning and understanding of real-world scenarios.
Pieter Abbeel · Pieter Abbeel: Deep Reinforcement Learning
Self-play and third-person learning can accelerate reinforcement learning in robots and autonomous vehicles.
Pieter Abbeel · Pieter Abbeel: Deep Reinforcement Learning
Transfer learning allows models trained on one task to be fine-tuned for others, a major success since AlexNet's 2012 breakthrough.
Pieter Abbeel · Pieter Abbeel: Deep Reinforcement Learning
Voices on transfer learning
1 standout quotes from across the corpus.
Go read
15 books and papers cited across these episodes.
For the specialist
What experts find new
5 expert-level takeaways for a specialist reader.
At the frontier
Still unresolved
2 open questions flagged across these conversations.
The thinkers
Who takes this idea on, by how often they return to it.
