Skip to content
TLexDR

DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

02-02-25 ▶ 5h 6m 📖 12 min read
Core Takeaways
DeepSeek's R1 model is 27 times cheaper than OpenAI's o1 model, costing $2 per million tokens.
Why it matters This cost difference positions DeepSeek as a highly competitive alternative in the AI model market.
NVIDIA's H20 chip, despite having lower FLOPS than the H100, performs better on reasoning tasks due to higher memory bandwidth. ▶ 1:23:45
Why it matters Memory bandwidth is crucial for reasoning tasks, highlighting the importance of architecture beyond raw compute power.
China's AI development is bolstered by a trillion RMB subsidy, but US export controls limit their access to cutting-edge GPUs. ▶ 1:23:45
Why it matters These controls aim to maintain US technological dominance but could incentivize China to develop independent capabilities.
OpenAI's joint venture with Oracle involves a $100 billion infrastructure investment, but funding remains uncertain. ▶ 1:23:45
Why it matters The financial uncertainty could impact OpenAI's ability to scale its infrastructure and maintain its competitive edge.
DeepSeek's mixture of experts model activates only 37 billion of its 600 billion parameters, reducing compute costs. ▶ 1:23:45
Why it matters Efficient parameter activation allows for significant compute savings, making large models more accessible.

How the conversation moved

The episode begins with a discussion on DeepSeek's innovative AI models, particularly focusing on the cost efficiency and technical advancements of the DeepSeek R1 model compared…

Ask this episode Deep

A preview of how Deep chat answers, grounded in this episode with citations and timestamps:

Cite this episode

For papers, blog posts, anywhere.

Copied!

Related episodes

Where to go next from this conversation.

AI-generated summary · last refreshed 2026-05-29 06:26:41 · how we make these

Quotes are matched verbatim against the source transcript; references are checked to resolve to real URLs. Even so, AI can misread structure or attribute claims imperfectly. If you spot an error, please let us know.

Report an inaccuracy →