Do large language models understand the world? (Andrew Ng)

[birkenkrahe]

I have little doubt that LLMs trained on human text also build world models. A lot of “emergent” behaviors of LLMs — for example, the fact that a model fine-tuned to follow English instructions can follow instructions written in other languages — seem very hard to explain unless we view them as understanding the world.

https://www.deeplearning.ai/the-batch/issue-209/