LLMs aren’t world models

I’ve been thinking about LLMs a lot lately. Haven’t we all. Here’s my reading from the last few years: (skip) 2016 (easter egg!) Google says machine learning is the future. So I tried it myself 2023 Bite-size thoughts about AI Bing chat is the AI fire alarm Unpacking AI: “an exponential disruption” with Kate Crawford: podcast and transcript Losing the imitation game The LLMentalist Effect: how chat-based Large Language Models replicate the mechanisms of a psychic’s con Language Is a Poor H

The sixteenth draft of my Chinese dictionary lies abandoned in a folder deep within my repo. Two weeks of work, genuinely good code, completely functional. Pre-AI me would have shipped it just to justify the time spent. Post-AI me deleted it and started building something better. That folder of abandoned ideas tells the real story of how AI changes everything.