01
Anecdote◆
Teams using AI to fix bugs repeatedly end up depending on the AI (e.g., Claude) for answers, and then cannot tell whether anything the AI outputs is actually true.
Illustrates a recurring bug that the AI keeps failing to fix; the developer readily defers to Claude, and both watch an output wall whose truth—or falsehood—they cannot verify.
transcript
Florian Herrengt: But then users start to report a weird bug. It's the 4th time your team has been trying to fix it. I mean... asking AI to fix it. Unfortunately, it seems like not even Fable can figure it out. You go talk to the person who worked on this feature. "So where does the data come from?" "Hmm... actually I don't know. Let me ask Claude." You sit next to each other watching an endless wall of text appear on the screen. Neither of you has any idea whether any of it is true but Claude seems very confident.