Leslie Kaelbling: Reinforcement Learning, Planning, and Robotics

The episode begins with Leslie Kaelbling reflecting on her academic journey from philosophy to AI, emphasizing how her background in symbolic systems has informed her work in robotics and AI. She outlines the philosophical underpinnings that continue to influence AI research, particularly in areas like belief and knowledge, which are crucial for developing intelligent systems. This sets the stage for a broader discussion on the evolution of AI from its early days focused on cybernetics to its current state, which increasingly mirrors human-like intelligence.

Kaelbling then delves into the technical aspects of AI, particularly the role of abstraction and Markov Decision Processes (MDPs) in managing complexity and uncertainty. She explains how these tools help reduce the state space and horizon in complex problems, making them more tractable for AI systems. The conversation also touches on Partially Observable Markov Decision Processes (POMDPs), which address the challenge of incomplete information, highlighting the need for approximations in optimal planning.

Despite the depth of the discussion, there was a notable lack of pushback from the host, Lex Fridman, on Kaelbling's assertions. This absence of challenge leaves some claims, such as the undecidability of optimal planning for POMDPs, without exploration of potential counterarguments or alternative perspectives. The conversation could have benefited from a deeper examination of these claims, perhaps questioning the feasibility of implementing such complex models in real-world scenarios.

The episode concludes with Kaelbling discussing the founding of the Journal of Machine Learning Research, highlighting issues with the current academic publishing model. She critiques the pressure on students to publish frequently, which she believes undermines long-term, deep research. Kaelbling argues for a future in AI that balances algorithm engineering with the careful design of objective functions, emphasizing the importance of value alignment. This pivot to publishing and research culture underscores her commitment to fostering an environment conducive to meaningful scientific progress.