
Link: https://youtu.be/lXUZvyajciY
Short Summary
Andrej Karpathy argues that the progress towards truly intelligent agents will take a decade, not just a year, due to the cognitive deficiencies in current LLMs, such as lack of continual learning and multimodality. He emphasizes that while existing AI tools are impressive, they are far from being the reliable "employees" envisioned for the future and much work is needed in various areas, algorithms, datasets, and compute, but particularly around removing knowledge in models to better build a "cognitive core". Karpathy also emphasizes the critical role of AI in transforming education, envisioning a future where it provides personalized learning experiences that are so engaging they are enjoyed simply for the sake of self-improvement.