AI is great at clearing out obviously useless marketing email, but when applied to a primary inbox it gets almost everything wrong because it can't tell what's actually important and the system is trivially gameable by senders who fake urgency.
Pierce describes letting AI clean his email: it nailed obvious junk mail but badly misjudged his primary inbox, since it just trusts whichever senders sound most urgent.
transcript
David Pierce: The minute it turned to my primary inbox, it started getting almost everything wrong. Because what it does is it looks at something and thinks, "Well, this person seems to think that what they're emailing you about is very important, so it's probably very important." ... It's a completely gameable system, and the LLM has no ability to look at this and say, "Here's what's important to me, David, right now."
gives example · 1