All topics / AI infrastructure
Topic
You are reading the free Skim layer. Read unlocks the synthesis and sources.
AI infrastructure
2
episodes
3
thinkers
9h
of conversation
7
books & papers
5
terms defined
The neighbourhood: AI infrastructure and the ideas it travels with. Drag to roam, click a star for the episode, click a neighbour to travel.
Drag to roam · scroll to zoom · click a neighbour to travel · click a star for the episode
From foundational to frontier
Climb the spectrum. The most accessible conversations come first.
Start here
ACCESSIBLECOREFRONTIER
The lexicon
Every term the guests lean on, in plain language. Read one in full, or filter to find it.
What the corpus says
The throughline across every conversation that touches this idea.
DeepSeek's R1 model is 27 times cheaper than OpenAI's o1 model, costing $2 per million tokens.
NVIDIA's H20 chip, despite having lower FLOPS than the H100, performs better on reasoning tasks due to higher memory bandwidth.
China's AI development is bolstered by a trillion RMB subsidy, but US export controls limit their access to cutting-edge GPUs.
OpenAI's joint venture with Oracle involves a $100 billion infrastructure investment, but funding remains uncertain.
DeepSeek's mixture of experts model activates only 37 billion of its 600 billion parameters, reducing compute costs.
Mojo, a superset of Python, achieves up to 35,000x speedup over Python by optimizing memory and eliminating interpreter overhead.
Chris Lattner · Chris Lattner: Future of Programming and AI
Mojo integrates features from Rust and Swift, focusing on value semantics and immutability to reduce bugs and improve performance.
Chris Lattner · Chris Lattner: Future of Programming and AI
Mojo's design allows it to be a universal platform for AI, adapting to new hardware without needing code rewrites.
Chris Lattner · Chris Lattner: Future of Programming and AI
Mojo's async await feature and memory management innovations aim to solve Modular's AI stack problems and enhance developer productivity.
Chris Lattner · Chris Lattner: Future of Programming and AI
Voices on AI infrastructure
7 standout quotes from across the corpus.
Go read
7 books and papers cited across these episodes.
For the specialist
What experts find new
4 expert-level takeaways for a specialist reader.
At the frontier
Still unresolved
2 open questions flagged across these conversations.
The thinkers
Who takes this idea on, by how often they return to it.
