From Large Language Models to World Models

Yan Deli, a senior expert at Tencent: LLMs are probabilistic models. They do not truly understand language; rather, they predict the next token (Next Token Prediction). Essentially, they are monotonous “word-chain” machines—moving forward one step at a time without retracing their path. At their core, LLMs are probabilistic models that learn, from statistical co-occurrence patterns, “what often appears alongside what,” and output “this is usually the case,” without grasping “why it is so.”...