Noam Chomsky: Language, Cognition, and Deep Learning

The conversation begins with Chomsky framing language as a unique cognitive capacity that is deeply intertwined with human nature. He argues that language is not merely a communication tool but a fundamental aspect of human cognition, allowing for the construction and expression of complex thoughts. This sets the stage for a broader discussion on the nature of human intelligence and its limitations, which Chomsky compares to the genetic constraints found in other biological organisms.

Chomsky presents the main argument that human intelligence, like that of other organisms, has inherent limits determined by genetic endowment. He supports this by referencing Marvin Minsky's experiment, which suggests that any higher intelligence would have at least basic arithmetic, implying a commonality in cognitive capabilities. Chomsky asserts that these limits are intrinsic to the human condition, setting boundaries on what can be achieved through human cognition and intelligence.

Lex doesn't challenge Chomsky's framing of language and cognition, though the obvious counter-position could be the view that language evolved primarily for communication rather than cognitive structuring. The real tension arises in Chomsky's critique of deep learning. He argues that while deep learning can identify patterns from large datasets, it fails to advance scientific understanding of language, as it does not address theoretical questions about language structure.

The conversation concludes with Chomsky exploring how human nature can lead to various types of institutions, shaped by historical contingencies rather than being essential to our nature. This pivot highlights the adaptability and complexity of human social structures, leaving open questions about the future role of AI and deep learning in understanding and replicating human cognitive processes. The episode ends without resolving the tension between the capabilities of deep learning and the theoretical understanding of language.