LLM Reasoning: Key Ideas and Limitations

DENNY ZHOU – GOOGLE DEEPMIND

ABSTRACT

Reasoning has emerged as a central focus in the development of large language models (LLMs). This talk will largely be based on the work from the reasoning team that I founded and lead in Google DeepMind. I will talk about how we started and explored reasoning with LLMs, including the key ideas like chain of thought and self consistency, and the limitations that we have observed. No background is required for this talk.