Agree. Token predicting machines will continue to be token predicting machines b...

breuleux · 2026-09-04T12:40:39

Next-token prediction is a general paradigm, though. In principle, there isn't really anything a sufficiently advanced token predictor couldn't do.

anthonyrstevens · 2026-09-04T13:51:49

This. People treat "token prediction" dismissively, as if it were a limit and not a foundational skill. Human brains do "token prediction" in all sorts of contexts.

Dlemlo · 2026-09-04T14:05:10

They learned generic concepts like our brain does to optimize for this particular surprisngly perfect task:

You have to be able to respond to a very generic question in a way that the other entity thinks this is good, comprehensive, etc.

You can call us situation predicting machines as well if you want.

But you undermine what the latent space of an LLM is representing.