Beyond Probability: The Limits and Real Potential of Language Models like GPT-4
The limits and potential of language models like GPT-4 have been the topic of a recent discussion on Hacker News. The question raised is whether these models, which can perform complex probability calculations, can truly understand concepts like humans do. While these models can be a game-changer for narrow tasks, they often require significant effort to refine their results, particularly when the user is not an expert in the topic. The conversation shifted to whether human reasoning is a stochastic or deterministic process, and whether or not punishing criminals in a deterministic universe can be justified.