Enterprise teams on the ground, outside the Silicon Valley bubble, are already seeing measurable AI ROI (falling exception rates, rising handling rates) even though it hasn't yet been recognized at the top of their organizations.
Pash recounts meeting non-Silicon-Valley implementers at the AI Engineer World's Fair, like a Midwest logistics CTO, who brought AI in-house after external vendors proved too slow, and are now seeing day-to-day drops in customer-service exception rates. ✦ AI generated
Pash · The Cognitive Revolution · 2026-07-02 · original ↗
starts at this moment · 40:49
they have tried working with external vendors before and they have found it difficult because external vendors have not delivered as fast as they want them to deliver which you can imagine sitting out in the Midwest if you have a local external vendor and you outsource you know like a project to them and they have no idea what's going on they're like you know a year behind the frontier so his team internalize everything
verbatim transcript · starts at 40:49
40:49his CEO is completely AI the management is completely AI which which is Why I think the team is there at the AI engineers welfare if not your logistics team you're not going to send your logistics IT team to you know to SF right and they're completely AIDS uh they have tried working with external vendors before and they have found it difficult because external vendors have not delivered as fast as they want them
41:12to deliver which you can imagine sitting out in the Midwest if you have a local external vendor and you outsource you know like a project to them and they have no idea what's going on they're like you know a year behind the frontier so his team internalize everything. So they're they're doing all this stuff internally now and they're building evals they're building all these systems they're using guys like Arise and other
41:34guys like Brain Trust which have started to build out these frameworks to evaluate uh models you know widely when you when you implement them in enterprises and they are actually in the day-to-day process of implementing and as they implement they automatically they see the results because they they are very close to that edge they see that customer service calls or exceptions that used to happen are now getting
42:00handled immediately and then all of the more difficult stuff that they used to have to like you know jump on they can now start to address and so they are seeing I think the return on investment on a day-to-day basis and this is very different from I think the story that you get from like the big enterprise c CTO's because they're so far away from like the the the front line that they
42:24don't actually know what's going on very closely. They're just looking at the numbers and by the numbers the token spend is going up but you know are you really seeing the return on investment but if you go down to that working level and you see day-to-day on like the customer calls coming in and whether they're getting handled the handling rate and the exception rate the exception rate is falling the handling
42:42rate is going up and and they're seeing that on a day-to-day basis right so this is I think where we are uh the guys who are actually implementing and close to the implementations are actually seeing the results it hasn't really filtered up into the, you know, top layer of the enterprises yet, but the CEOs who are who are AI pilled kind of know what's going to happen and they're kind of